[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:11:09.300127 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:40469
I20260709 13:11:09.302549 28250 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:11:09.304041 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:09.328174 28256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.328083 28257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.328068 28259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.330859 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:10.572014 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:10.572350 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:10.572522 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602670572503 us; error 0 us; skew 500 ppm
I20260709 13:11:10.573455 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:10.580292 28250 webserver.cc:533] Webserver started at http://127.27.150.190:36143/ using document root <none> and password file <none>
I20260709 13:11:10.581360 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:10.581586 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:10.582069 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:10.589061 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "3ec86ff748604858992de9c24d8c3184"
format_stamp: "Formatted at 2026-07-09 13:11:10 on dist-test-slave-nvvq"
I20260709 13:11:10.599361 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.005s
I20260709 13:11:10.605691 28265 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:10.607179 28250 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:11:10.607597 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "3ec86ff748604858992de9c24d8c3184"
format_stamp: "Formatted at 2026-07-09 13:11:10 on dist-test-slave-nvvq"
I20260709 13:11:10.608004 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:10.668083 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:10.670231 28250 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:11:10.670900 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:10.765050 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:40469
I20260709 13:11:10.765121 28316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:40469 every 8 connection(s)
I20260709 13:11:10.775063 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:10.802522 28317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184: Bootstrap starting.
I20260709 13:11:10.810369 28317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.812930 28317 log.cc:826] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184: Log is configured to *not* fsync() on all Append() calls
I20260709 13:11:10.819058 28317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184: No bootstrap required, opened a new log
I20260709 13:11:10.843431 28317 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec86ff748604858992de9c24d8c3184" member_type: VOTER }
I20260709 13:11:10.844173 28317 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.844398 28317 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ec86ff748604858992de9c24d8c3184, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.845633 28317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec86ff748604858992de9c24d8c3184" member_type: VOTER }
I20260709 13:11:10.846199 28317 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:10.846494 28317 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:10.846860 28317 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.852103 28317 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec86ff748604858992de9c24d8c3184" member_type: VOTER }
I20260709 13:11:10.853049 28317 leader_election.cc:304] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ec86ff748604858992de9c24d8c3184; no voters: 
I20260709 13:11:10.855233 28317 leader_election.cc:290] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:10.855633 28320 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.859032 28320 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 1 LEADER]: Becoming Leader. State: Replica: 3ec86ff748604858992de9c24d8c3184, State: Running, Role: LEADER
I20260709 13:11:10.860219 28320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec86ff748604858992de9c24d8c3184" member_type: VOTER }
I20260709 13:11:10.861481 28317 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:10.873772 28322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ec86ff748604858992de9c24d8c3184. Latest consensus state: current_term: 1 leader_uuid: "3ec86ff748604858992de9c24d8c3184" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec86ff748604858992de9c24d8c3184" member_type: VOTER } }
I20260709 13:11:10.875061 28322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:10.876098 28321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ec86ff748604858992de9c24d8c3184" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec86ff748604858992de9c24d8c3184" member_type: VOTER } }
I20260709 13:11:10.876857 28321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:10.880110 28330 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:10.893930 28330 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:10.896910 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:10.915056 28330 catalog_manager.cc:1383] Generated new cluster ID: 05647479ea224822b2de469abd6215a8
I20260709 13:11:10.915472 28330 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:10.953154 28330 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:10.955281 28330 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:10.973798 28330 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184: Generated new TSK 0
I20260709 13:11:10.975301 28330 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:11.028797 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:11.039271 28339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:11.040617 28340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:11.046591 28250 server_base.cc:1061] running on GCE node
W20260709 13:11:11.046983 28342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:11.048283 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:11.048589 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:11.048799 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602671048780 us; error 0 us; skew 500 ppm
I20260709 13:11:11.049696 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:11.054693 28250 webserver.cc:533] Webserver started at http://127.27.150.129:35567/ using document root <none> and password file <none>
I20260709 13:11:11.055501 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:11.055797 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:11.056188 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:11.058000 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "6f5406d166ec4d46adb634784dc1e5a6"
format_stamp: "Formatted at 2026-07-09 13:11:11 on dist-test-slave-nvvq"
I20260709 13:11:11.066509 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:11.072724 28347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.073753 28250 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:11.074155 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "6f5406d166ec4d46adb634784dc1e5a6"
format_stamp: "Formatted at 2026-07-09 13:11:11 on dist-test-slave-nvvq"
I20260709 13:11:11.074687 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:11.096344 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:11.098556 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:11.102008 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:11.108137 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:11.108506 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.108860 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:11.109091 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.220381 28409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:36787 every 8 connection(s)
I20260709 13:11:11.220321 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:36787
I20260709 13:11:11.230008 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:11.250366 28414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:11.255337 28415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:11.259483 28417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:11.261590 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:11.262861 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:11.263240 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:11.263473 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602671263451 us; error 0 us; skew 500 ppm
I20260709 13:11:11.264328 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:11.267587 28250 webserver.cc:533] Webserver started at http://127.27.150.130:40427/ using document root <none> and password file <none>
I20260709 13:11:11.268347 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:11.268615 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:11.268954 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:11.270601 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "f3d9f899705748dcab7457361cc344c9"
format_stamp: "Formatted at 2026-07-09 13:11:11 on dist-test-slave-nvvq"
I20260709 13:11:11.275554 28410 heartbeater.cc:344] Connected to a master server at 127.27.150.190:40469
I20260709 13:11:11.276084 28410 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:11.277359 28410 heartbeater.cc:507] Master 127.27.150.190:40469 requested a full tablet report, sending...
I20260709 13:11:11.280084 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:11:11.281427 28282 ts_manager.cc:194] Registered new tserver with Master: 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787)
I20260709 13:11:11.284958 28282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47914
I20260709 13:11:11.286676 28422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.287930 28250 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:11:11.288306 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "f3d9f899705748dcab7457361cc344c9"
format_stamp: "Formatted at 2026-07-09 13:11:11 on dist-test-slave-nvvq"
I20260709 13:11:11.288729 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:11.310038 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:11.311805 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:11.314638 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:11.318794 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:11.319012 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.319365 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:11.319538 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.437032 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:46417
I20260709 13:11:11.437523 28484 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:46417 every 8 connection(s)
I20260709 13:11:11.446841 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:11.458770 28488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:11.460673 28489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:11.468261 28485 heartbeater.cc:344] Connected to a master server at 127.27.150.190:40469
I20260709 13:11:11.468878 28485 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:11.470201 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:11.470516 28485 heartbeater.cc:507] Master 127.27.150.190:40469 requested a full tablet report, sending...
W20260709 13:11:11.471412 28492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:11.472783 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:11.473147 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:11.473384 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602671473359 us; error 0 us; skew 500 ppm
I20260709 13:11:11.473649 28282 ts_manager.cc:194] Registered new tserver with Master: f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:11.474102 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:11.475824 28282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47926
I20260709 13:11:11.480691 28250 webserver.cc:533] Webserver started at http://127.27.150.131:35209/ using document root <none> and password file <none>
I20260709 13:11:11.481395 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:11.481659 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:11.481993 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:11.483349 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "33579d53dd28474aaaf5943d34eb14ab"
format_stamp: "Formatted at 2026-07-09 13:11:11 on dist-test-slave-nvvq"
I20260709 13:11:11.489135 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:11.493531 28496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.494633 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:11.494987 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "33579d53dd28474aaaf5943d34eb14ab"
format_stamp: "Formatted at 2026-07-09 13:11:11 on dist-test-slave-nvvq"
I20260709 13:11:11.495374 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:11.517941 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:11.519748 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:11.522046 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:11.525596 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:11.525866 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.526160 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:11.526361 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:11.658380 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:41931
I20260709 13:11:11.658583 28558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:41931 every 8 connection(s)
I20260709 13:11:11.680850 28559 heartbeater.cc:344] Connected to a master server at 127.27.150.190:40469
I20260709 13:11:11.681527 28559 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:11.683248 28559 heartbeater.cc:507] Master 127.27.150.190:40469 requested a full tablet report, sending...
I20260709 13:11:11.686044 28282 ts_manager.cc:194] Registered new tserver with Master: 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:11.686837 28250 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022194079s
I20260709 13:11:11.688222 28282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47940
I20260709 13:11:11.755041 28282 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47954:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:11.759940 28282 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:11.883973 28524 tablet_service.cc:1511] Processing CreateTablet for tablet 863cd51457434d5b9c46aa31b51c64f4 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:11.888413 28523 tablet_service.cc:1511] Processing CreateTablet for tablet cd87b0686ced4cda9611d71c0e4554c4 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
W20260709 13:11:11.890964 28329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:11.891783 28523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd87b0686ced4cda9611d71c0e4554c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.894986 28524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863cd51457434d5b9c46aa31b51c64f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.911652 28374 tablet_service.cc:1511] Processing CreateTablet for tablet cd87b0686ced4cda9611d71c0e4554c4 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:11.912371 28375 tablet_service.cc:1511] Processing CreateTablet for tablet 863cd51457434d5b9c46aa31b51c64f4 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:11.914523 28449 tablet_service.cc:1511] Processing CreateTablet for tablet cd87b0686ced4cda9611d71c0e4554c4 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:11.916229 28450 tablet_service.cc:1511] Processing CreateTablet for tablet 863cd51457434d5b9c46aa31b51c64f4 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:11.919746 28449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd87b0686ced4cda9611d71c0e4554c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.921311 28373 tablet_service.cc:1511] Processing CreateTablet for tablet 6db08713d99b4c17a13fda7338bd2ce3 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:11.920655 28374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd87b0686ced4cda9611d71c0e4554c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.923969 28450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863cd51457434d5b9c46aa31b51c64f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.926143 28375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863cd51457434d5b9c46aa31b51c64f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.927435 28373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db08713d99b4c17a13fda7338bd2ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.938699 28448 tablet_service.cc:1511] Processing CreateTablet for tablet 6db08713d99b4c17a13fda7338bd2ce3 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:11.943993 28448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db08713d99b4c17a13fda7338bd2ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.948838 28522 tablet_service.cc:1511] Processing CreateTablet for tablet 6db08713d99b4c17a13fda7338bd2ce3 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:11.951713 28522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db08713d99b4c17a13fda7338bd2ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.985695 28577 tablet_bootstrap.cc:492] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:11.984822 28447 tablet_service.cc:1511] Processing CreateTablet for tablet 17a148c8179a47d39e245217bb3af4b2 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:11.996083 28372 tablet_service.cc:1511] Processing CreateTablet for tablet 17a148c8179a47d39e245217bb3af4b2 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:12.000299 28372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a148c8179a47d39e245217bb3af4b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.004129 28447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a148c8179a47d39e245217bb3af4b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.023991 28523 tablet_service.cc:1511] Processing CreateTablet for tablet 17a148c8179a47d39e245217bb3af4b2 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:12.026237 28523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a148c8179a47d39e245217bb3af4b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.043738 28371 tablet_service.cc:1511] Processing CreateTablet for tablet ff4c1465958e45bfbf651c23406a6714 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:12.051252 28446 tablet_service.cc:1511] Processing CreateTablet for tablet ff4c1465958e45bfbf651c23406a6714 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:12.052999 28371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4c1465958e45bfbf651c23406a6714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.054977 28446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4c1465958e45bfbf651c23406a6714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.056294 28578 tablet_bootstrap.cc:492] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.062893 28522 tablet_service.cc:1511] Processing CreateTablet for tablet ff4c1465958e45bfbf651c23406a6714 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:12.065529 28522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4c1465958e45bfbf651c23406a6714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.068822 28375 tablet_service.cc:1511] Processing CreateTablet for tablet 89b0d89010aa41f59e09ae005522e477 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:12.070480 28375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b0d89010aa41f59e09ae005522e477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.075912 28577 tablet_bootstrap.cc:654] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.081800 28579 tablet_bootstrap.cc:492] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.083729 28450 tablet_service.cc:1511] Processing CreateTablet for tablet 89b0d89010aa41f59e09ae005522e477 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:12.085296 28450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b0d89010aa41f59e09ae005522e477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.084928 28524 tablet_service.cc:1511] Processing CreateTablet for tablet 89b0d89010aa41f59e09ae005522e477 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:12.086390 28524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b0d89010aa41f59e09ae005522e477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.106941 28373 tablet_service.cc:1511] Processing CreateTablet for tablet 20432f1e2c8d49e7a8e420ac3d32b665 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:12.108892 28373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20432f1e2c8d49e7a8e420ac3d32b665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.124505 28578 tablet_bootstrap.cc:654] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.133358 28447 tablet_service.cc:1511] Processing CreateTablet for tablet 20432f1e2c8d49e7a8e420ac3d32b665 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:12.135955 28447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20432f1e2c8d49e7a8e420ac3d32b665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.138777 28375 tablet_service.cc:1511] Processing CreateTablet for tablet 36dbb81d0dbd4a238b7746c213cee490 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:12.141309 28448 tablet_service.cc:1511] Processing CreateTablet for tablet 36dbb81d0dbd4a238b7746c213cee490 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:12.152151 28374 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9f8bbc62844706a2752d75e854d691 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:12.152379 28449 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9f8bbc62844706a2752d75e854d691 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:12.152670 28524 tablet_service.cc:1511] Processing CreateTablet for tablet 20432f1e2c8d49e7a8e420ac3d32b665 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:12.153570 28448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36dbb81d0dbd4a238b7746c213cee490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.154742 28449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9f8bbc62844706a2752d75e854d691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.157305 28522 tablet_service.cc:1511] Processing CreateTablet for tablet 36dbb81d0dbd4a238b7746c213cee490 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:12.158730 28522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36dbb81d0dbd4a238b7746c213cee490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.163148 28375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36dbb81d0dbd4a238b7746c213cee490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.163894 28374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9f8bbc62844706a2752d75e854d691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.165700 28524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20432f1e2c8d49e7a8e420ac3d32b665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.169308 28523 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9f8bbc62844706a2752d75e854d691 (DEFAULT_TABLE table=test-workload [id=151fa5163a9d42a6a50e750d83f8b9b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:12.170951 28523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9f8bbc62844706a2752d75e854d691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.217211 28579 tablet_bootstrap.cc:654] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.224676 28577 tablet_bootstrap.cc:492] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:12.225317 28577 ts_tablet_manager.cc:1403] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.241s	user 0.007s	sys 0.027s
I20260709 13:11:12.229638 28577 raft_consensus.cc:359] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.231184 28577 raft_consensus.cc:385] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.231549 28577 raft_consensus.cc:740] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.240408 28577 consensus_queue.cc:260] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.241518 28578 tablet_bootstrap.cc:492] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.242151 28578 ts_tablet_manager.cc:1403] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.199s	user 0.020s	sys 0.020s
I20260709 13:11:12.246848 28579 tablet_bootstrap.cc:492] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:12.247524 28579 ts_tablet_manager.cc:1403] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.183s	user 0.020s	sys 0.013s
I20260709 13:11:12.248297 28577 ts_tablet_manager.cc:1434] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.010s
I20260709 13:11:12.249264 28559 heartbeater.cc:499] Master 127.27.150.190:40469 was elected leader, sending a full tablet report...
I20260709 13:11:12.250249 28577 tablet_bootstrap.cc:492] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:12.251544 28579 raft_consensus.cc:359] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.252349 28579 raft_consensus.cc:385] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.252648 28579 raft_consensus.cc:740] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.253487 28579 consensus_queue.cc:260] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.256428 28578 raft_consensus.cc:359] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.257228 28578 raft_consensus.cc:385] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.257526 28578 raft_consensus.cc:740] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.258322 28577 tablet_bootstrap.cc:654] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.258338 28578 consensus_queue.cc:260] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.267908 28485 heartbeater.cc:499] Master 127.27.150.190:40469 was elected leader, sending a full tablet report...
I20260709 13:11:12.268936 28578 ts_tablet_manager.cc:1434] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:11:12.269986 28578 tablet_bootstrap.cc:492] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.280510 28578 tablet_bootstrap.cc:654] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.289845 28410 heartbeater.cc:499] Master 127.27.150.190:40469 was elected leader, sending a full tablet report...
I20260709 13:11:12.303107 28578 tablet_bootstrap.cc:492] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.303696 28578 ts_tablet_manager.cc:1403] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.002s
I20260709 13:11:12.306629 28579 ts_tablet_manager.cc:1434] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.059s	user 0.014s	sys 0.014s
I20260709 13:11:12.307688 28579 tablet_bootstrap.cc:492] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.307144 28578 raft_consensus.cc:359] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.308071 28578 raft_consensus.cc:385] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.308420 28578 raft_consensus.cc:740] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.309434 28578 consensus_queue.cc:260] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.312094 28578 ts_tablet_manager.cc:1434] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:12.313196 28578 tablet_bootstrap.cc:492] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.314806 28584 raft_consensus.cc:493] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.315394 28579 tablet_bootstrap.cc:654] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.318792 28577 tablet_bootstrap.cc:492] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:12.319388 28577 ts_tablet_manager.cc:1403] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.070s	user 0.040s	sys 0.011s
I20260709 13:11:12.315397 28584 raft_consensus.cc:515] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.323614 28577 raft_consensus.cc:359] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.324676 28577 raft_consensus.cc:385] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.324839 28584 leader_election.cc:290] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.325094 28577 raft_consensus.cc:740] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.330541 28579 tablet_bootstrap.cc:492] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:12.326197 28577 consensus_queue.cc:260] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.331125 28579 ts_tablet_manager.cc:1403] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.009s
I20260709 13:11:12.332877 28577 ts_tablet_manager.cc:1434] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:12.333966 28577 tablet_bootstrap.cc:492] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:12.336404 28578 tablet_bootstrap.cc:654] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.334640 28579 raft_consensus.cc:359] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.343657 28579 raft_consensus.cc:385] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.344034 28579 raft_consensus.cc:740] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.344863 28579 consensus_queue.cc:260] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.349931 28577 tablet_bootstrap.cc:654] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.354477 28579 ts_tablet_manager.cc:1434] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:11:12.355633 28579 tablet_bootstrap.cc:492] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.359999 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:12.361447 28460 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 0.
I20260709 13:11:12.363714 28585 raft_consensus.cc:493] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.364319 28585 raft_consensus.cc:515] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.364373 28351 leader_election.cc:304] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:12.366659 28584 raft_consensus.cc:2804] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.367115 28584 raft_consensus.cc:493] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.367453 28584 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.371802 28585 leader_election.cc:290] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931), 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787)
I20260709 13:11:12.411298 28579 tablet_bootstrap.cc:654] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.412883 28584 raft_consensus.cc:515] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
W20260709 13:11:12.418103 28560 tablet.cc:2406] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:12.419848 28577 tablet_bootstrap.cc:492] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:12.420509 28577 ts_tablet_manager.cc:1403] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.087s	user 0.037s	sys 0.013s
I20260709 13:11:12.425635 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.426883 28534 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 0.
I20260709 13:11:12.428099 28578 tablet_bootstrap.cc:492] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.430253 28584 leader_election.cc:290] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 election: Requested vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.428534 28577 raft_consensus.cc:359] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.431102 28577 raft_consensus.cc:385] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.431530 28577 raft_consensus.cc:740] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.432555 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:12.432471 28577 consensus_queue.cc:260] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.437011 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:12.437711 28534 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.439443 28577 ts_tablet_manager.cc:1434] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:11:12.442392 28577 tablet_bootstrap.cc:492] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:12.433248 28460 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.444731 28578 ts_tablet_manager.cc:1403] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.019s
I20260709 13:11:12.453536 28578 raft_consensus.cc:359] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.454396 28578 raft_consensus.cc:385] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.461656 28578 raft_consensus.cc:740] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.464273 28584 raft_consensus.cc:493] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.464982 28584 raft_consensus.cc:515] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.467684 28584 leader_election.cc:290] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:12.469134 28533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.464227 28578 consensus_queue.cc:260] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.471422 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:12.473528 28585 raft_consensus.cc:493] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.474999 28585 raft_consensus.cc:515] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.476246 28534 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 1.
I20260709 13:11:12.471709 28533 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 0.
I20260709 13:11:12.473250 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.470207 28460 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 1.
I20260709 13:11:12.483481 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:12.484961 28385 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:12.475047 28459 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 0.
I20260709 13:11:12.480242 28351 leader_election.cc:304] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:12.487895 28423 leader_election.cc:304] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:12.483908 28532 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:12.491904 28585 leader_election.cc:290] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.492923 28585 raft_consensus.cc:2804] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.492972 28351 leader_election.cc:304] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:12.493412 28585 raft_consensus.cc:493] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.493688 28579 tablet_bootstrap.cc:492] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:12.495141 28579 ts_tablet_manager.cc:1403] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.140s	user 0.022s	sys 0.028s
I20260709 13:11:12.493795 28585 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.490577 28584 raft_consensus.cc:2804] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.499646 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.500452 28532 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:12.502841 28426 leader_election.cc:304] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:12.507987 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:12.509179 28579 raft_consensus.cc:359] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.511989 28579 raft_consensus.cc:385] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:12.510263 28423 leader_election.cc:343] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.514221 28598 raft_consensus.cc:2804] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.511626 28577 tablet_bootstrap.cc:654] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.514865 28598 raft_consensus.cc:493] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.519934 28598 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.513873 28579 raft_consensus.cc:740] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.522552 28599 raft_consensus.cc:2804] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.523663 28578 ts_tablet_manager.cc:1434] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.073s	user 0.000s	sys 0.023s
I20260709 13:11:12.524232 28599 raft_consensus.cc:493] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.524613 28599 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.527416 28585 raft_consensus.cc:515] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.529938 28578 tablet_bootstrap.cc:492] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.532469 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:12.533704 28532 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.526316 28579 consensus_queue.cc:260] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.540011 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:12.536351 28585 leader_election.cc:290] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Requested vote from peers 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931), 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787)
I20260709 13:11:12.534961 28584 raft_consensus.cc:697] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:12.565156 28532 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 1.
I20260709 13:11:12.561879 28584 consensus_queue.cc:237] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.567185 28426 leader_election.cc:304] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:12.562124 28598 raft_consensus.cc:515] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.570236 28585 raft_consensus.cc:2804] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.572297 28578 tablet_bootstrap.cc:654] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.572659 28585 raft_consensus.cc:697] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:12.574404 28585 consensus_queue.cc:237] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.578181 28598 leader_election.cc:290] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.581692 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:12.582600 28577 tablet_bootstrap.cc:492] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:12.580317 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:12.584975 28577 ts_tablet_manager.cc:1403] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.143s	user 0.036s	sys 0.013s
I20260709 13:11:12.584882 28384 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.584510 28579 ts_tablet_manager.cc:1434] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.088s	user 0.015s	sys 0.023s
I20260709 13:11:12.582623 28532 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.590348 28579 tablet_bootstrap.cc:492] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.609902 28532 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 1.
I20260709 13:11:12.612594 28577 raft_consensus.cc:359] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.614880 28577 raft_consensus.cc:385] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.615310 28577 raft_consensus.cc:740] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.616058 28426 leader_election.cc:304] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:12.616276 28577 consensus_queue.cc:260] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.617251 28598 raft_consensus.cc:2804] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.620364 28384 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 1.
I20260709 13:11:12.618986 28598 raft_consensus.cc:697] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:12.631778 28598 consensus_queue.cc:237] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.635058 28599 raft_consensus.cc:515] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:12.638029 28385 raft_consensus.cc:2393] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d9f899705748dcab7457361cc344c9 in current term 1: Already voted for candidate 6f5406d166ec4d46adb634784dc1e5a6 in this term.
I20260709 13:11:12.637419 28577 ts_tablet_manager.cc:1434] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.002s
I20260709 13:11:12.640530 28280 catalog_manager.cc:5697] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.638608 28282 catalog_manager.cc:5697] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.647859 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:12.649382 28579 tablet_bootstrap.cc:654] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.651381 28532 raft_consensus.cc:2393] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5406d166ec4d46adb634784dc1e5a6 in current term 1: Already voted for candidate f3d9f899705748dcab7457361cc344c9 in this term.
I20260709 13:11:12.655768 28577 tablet_bootstrap.cc:492] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:12.661749 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:12.659126 28599 leader_election.cc:290] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 election: Requested vote from peers 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:12.666263 28351 leader_election.cc:304] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6; no voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9
I20260709 13:11:12.670936 28599 raft_consensus.cc:2749] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:12.682420 28578 tablet_bootstrap.cc:492] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.683769 28578 ts_tablet_manager.cc:1403] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.154s	user 0.037s	sys 0.009s
I20260709 13:11:12.699031 28578 raft_consensus.cc:359] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.702561 28578 raft_consensus.cc:385] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.703104 28578 raft_consensus.cc:740] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.704836 28578 consensus_queue.cc:260] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.707269 28578 ts_tablet_manager.cc:1434] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:11:12.708562 28578 tablet_bootstrap.cc:492] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.712512 28577 tablet_bootstrap.cc:654] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.716845 28579 tablet_bootstrap.cc:492] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:12.716997 28578 tablet_bootstrap.cc:654] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.717845 28579 ts_tablet_manager.cc:1403] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.129s	user 0.030s	sys 0.017s
I20260709 13:11:12.723505 28579 raft_consensus.cc:359] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.724632 28579 raft_consensus.cc:385] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.725086 28579 raft_consensus.cc:740] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.726094 28579 consensus_queue.cc:260] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.726958 28577 tablet_bootstrap.cc:492] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:12.727525 28577 ts_tablet_manager.cc:1403] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.015s
I20260709 13:11:12.729432 28579 ts_tablet_manager.cc:1434] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:12.730691 28579 tablet_bootstrap.cc:492] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.731503 28577 raft_consensus.cc:359] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.734513 28577 raft_consensus.cc:385] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.734892 28577 raft_consensus.cc:740] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.736214 28577 consensus_queue.cc:260] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.742776 28579 tablet_bootstrap.cc:654] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.747615 28578 tablet_bootstrap.cc:492] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.748219 28578 ts_tablet_manager.cc:1403] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.022s
I20260709 13:11:12.751969 28578 raft_consensus.cc:359] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.752847 28578 raft_consensus.cc:385] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.753181 28578 raft_consensus.cc:740] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.754089 28578 consensus_queue.cc:260] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.756839 28579 tablet_bootstrap.cc:492] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:12.757556 28579 ts_tablet_manager.cc:1403] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.010s
I20260709 13:11:12.740327 28577 ts_tablet_manager.cc:1434] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:11:12.760737 28578 ts_tablet_manager.cc:1434] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:11:12.761931 28578 tablet_bootstrap.cc:492] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.761523 28579 raft_consensus.cc:359] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.762553 28579 raft_consensus.cc:385] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.762991 28579 raft_consensus.cc:740] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.764108 28579 consensus_queue.cc:260] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.767088 28579 ts_tablet_manager.cc:1434] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:11:12.768980 28579 tablet_bootstrap.cc:492] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.771202 28578 tablet_bootstrap.cc:654] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.777722 28579 tablet_bootstrap.cc:654] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.788837 28578 tablet_bootstrap.cc:492] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.790491 28578 ts_tablet_manager.cc:1403] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.017s
I20260709 13:11:12.791320 28577 tablet_bootstrap.cc:492] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:12.788877 28279 catalog_manager.cc:5697] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.796231 28578 raft_consensus.cc:359] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.797111 28578 raft_consensus.cc:385] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.797421 28578 raft_consensus.cc:740] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.798322 28578 consensus_queue.cc:260] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.800918 28577 tablet_bootstrap.cc:654] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.803035 28579 tablet_bootstrap.cc:492] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:12.803603 28579 ts_tablet_manager.cc:1403] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.008s
I20260709 13:11:12.800930 28578 ts_tablet_manager.cc:1434] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:11:12.807150 28579 raft_consensus.cc:359] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.807977 28579 raft_consensus.cc:385] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.808316 28579 raft_consensus.cc:740] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.807142 28578 tablet_bootstrap.cc:492] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.809121 28579 consensus_queue.cc:260] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.812408 28579 ts_tablet_manager.cc:1434] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:12.813524 28579 tablet_bootstrap.cc:492] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.825212 28577 tablet_bootstrap.cc:492] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:12.825846 28577 ts_tablet_manager.cc:1403] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.004s
I20260709 13:11:12.826246 28578 tablet_bootstrap.cc:654] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.831755 28579 tablet_bootstrap.cc:654] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.833304 28577 raft_consensus.cc:359] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.834277 28577 raft_consensus.cc:385] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.834721 28577 raft_consensus.cc:740] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.835680 28577 consensus_queue.cc:260] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.842900 28577 ts_tablet_manager.cc:1434] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:11:12.844283 28577 tablet_bootstrap.cc:492] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:12.846302 28578 tablet_bootstrap.cc:492] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.846936 28578 ts_tablet_manager.cc:1403] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.008s
I20260709 13:11:12.850471 28578 raft_consensus.cc:359] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.851461 28578 raft_consensus.cc:385] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.852375 28578 raft_consensus.cc:740] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.853318 28577 tablet_bootstrap.cc:654] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.853745 28578 consensus_queue.cc:260] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.861990 28579 tablet_bootstrap.cc:492] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:12.862911 28579 ts_tablet_manager.cc:1403] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.003s
I20260709 13:11:12.864957 28578 ts_tablet_manager.cc:1434] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:11:12.867635 28579 raft_consensus.cc:359] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.868773 28579 raft_consensus.cc:385] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.869537 28599 raft_consensus.cc:493] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.870143 28599 raft_consensus.cc:515] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.872373 28599 leader_election.cc:290] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.872509 28577 tablet_bootstrap.cc:492] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:12.869189 28579 raft_consensus.cc:740] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.874251 28578 tablet_bootstrap.cc:492] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.874887 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.875088 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:12.874608 28579 consensus_queue.cc:260] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
W20260709 13:11:12.877240 28351 leader_election.cc:343] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.878239 28583 raft_consensus.cc:493] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.878824 28583 raft_consensus.cc:515] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.880600 28579 ts_tablet_manager.cc:1434] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:11:12.881814 28579 tablet_bootstrap.cc:492] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:12.882074 28583 leader_election.cc:290] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
W20260709 13:11:12.885583 28351 leader_election.cc:343] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.873220 28577 ts_tablet_manager.cc:1403] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.016s
I20260709 13:11:12.889810 28351 leader_election.cc:304] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6; no voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9
I20260709 13:11:12.892254 28599 raft_consensus.cc:2749] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:12.900508 28577 raft_consensus.cc:359] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.901728 28599 raft_consensus.cc:493] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.902916 28599 raft_consensus.cc:515] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.905714 28599 leader_election.cc:290] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.901465 28577 raft_consensus.cc:385] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.909586 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:12.907711 28577 raft_consensus.cc:740] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.910320 28459 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 0.
W20260709 13:11:12.907898 28329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:12.912190 28577 consensus_queue.cc:260] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.915241 28351 leader_election.cc:304] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:12.922998 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.923758 28532 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 0.
I20260709 13:11:12.925256 28599 raft_consensus.cc:2804] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.925678 28599 raft_consensus.cc:493] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.926028 28599 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.930238 28598 raft_consensus.cc:493] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.930816 28598 raft_consensus.cc:515] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.933180 28598 leader_election.cc:290] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.933543 28577 ts_tablet_manager.cc:1434] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:11:12.933295 28578 tablet_bootstrap.cc:654] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.934139 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
W20260709 13:11:12.937340 28423 leader_election.cc:343] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.940464 28583 raft_consensus.cc:493] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.940987 28583 raft_consensus.cc:515] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.939348 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.942612 28577 tablet_bootstrap.cc:492] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
I20260709 13:11:12.943111 28532 raft_consensus.cc:2468] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:12.943506 28583 leader_election.cc:290] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:12.945052 28426 leader_election.cc:304] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:12.946498 28598 raft_consensus.cc:2804] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.947258 28598 raft_consensus.cc:493] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.947665 28598 raft_consensus.cc:3060] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.950156 28579 tablet_bootstrap.cc:654] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.954193 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:12.954674 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:12.961783 28384 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 0.
I20260709 13:11:12.966271 28497 leader_election.cc:304] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:12.953786 28599 raft_consensus.cc:515] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.969069 28583 raft_consensus.cc:2804] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.964174 28598 raft_consensus.cc:515] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.970037 28583 raft_consensus.cc:493] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.971276 28583 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.975847 28578 tablet_bootstrap.cc:492] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:12.976436 28578 ts_tablet_manager.cc:1403] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.011s
I20260709 13:11:12.977100 28585 raft_consensus.cc:493] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.977670 28585 raft_consensus.cc:515] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.980825 28585 leader_election.cc:290] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.981220 28578 raft_consensus.cc:359] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.981992 28578 raft_consensus.cc:385] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.982291 28578 raft_consensus.cc:740] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.982170 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:12.982479 28385 raft_consensus.cc:2393] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33579d53dd28474aaaf5943d34eb14ab in current term 1: Already voted for candidate 6f5406d166ec4d46adb634784dc1e5a6 in this term.
I20260709 13:11:12.983172 28578 consensus_queue.cc:260] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.984472 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:12.986898 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:12.987483 28578 ts_tablet_manager.cc:1434] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:12.987591 28459 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 0.
I20260709 13:11:12.988657 28578 tablet_bootstrap.cc:492] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9: Bootstrap starting.
I20260709 13:11:12.988619 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:12.989262 28460 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 0.
I20260709 13:11:12.983013 28384 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:12.990641 28599 leader_election.cc:290] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 election: Requested vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.991235 28500 leader_election.cc:304] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:13.002257 28583 raft_consensus.cc:515] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:12.993443 28577 tablet_bootstrap.cc:654] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.993383 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:12.995237 28423 leader_election.cc:304] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:13.003671 28532 raft_consensus.cc:2393] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d9f899705748dcab7457361cc344c9 in current term 1: Already voted for candidate 33579d53dd28474aaaf5943d34eb14ab in this term.
I20260709 13:11:13.004448 28597 raft_consensus.cc:2804] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.004940 28597 raft_consensus.cc:493] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.005326 28597 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.005672 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
W20260709 13:11:13.007928 28423 leader_election.cc:343] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.003691 28460 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.012735 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:13.013088 28583 leader_election.cc:290] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.013496 28384 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.013726 28583 raft_consensus.cc:2804] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.014106 28583 raft_consensus.cc:493] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.014493 28583 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.016927 28597 raft_consensus.cc:515] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.000316 28578 tablet_bootstrap.cc:654] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.000723 28579 tablet_bootstrap.cc:492] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:13.024857 28579 ts_tablet_manager.cc:1403] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.143s	user 0.008s	sys 0.014s
I20260709 13:11:13.028093 28579 raft_consensus.cc:359] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.028903 28579 raft_consensus.cc:385] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.029204 28579 raft_consensus.cc:740] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.001610 28598 leader_election.cc:290] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:12.992015 28533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:13.002821 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:13.000967 28585 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.030910 28534 raft_consensus.cc:3060] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.030022 28579 consensus_queue.cc:260] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.033052 28597 leader_election.cc:290] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:13.035884 28627 raft_consensus.cc:493] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.037433 28579 ts_tablet_manager.cc:1434] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:13.042963 28579 tablet_bootstrap.cc:492] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6: Bootstrap starting.
I20260709 13:11:13.041299 28583 raft_consensus.cc:515] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
W20260709 13:11:13.045928 28500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:46417, user_credentials={real_user=slave}} blocked reactor thread for 54959.1us
I20260709 13:11:13.046986 28533 raft_consensus.cc:2393] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5406d166ec4d46adb634784dc1e5a6 in current term 1: Already voted for candidate 33579d53dd28474aaaf5943d34eb14ab in this term.
I20260709 13:11:13.028633 28384 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 1.
I20260709 13:11:13.052433 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:13.052846 28578 tablet_bootstrap.cc:492] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9: No bootstrap required, opened a new log
I20260709 13:11:13.053380 28459 raft_consensus.cc:2393] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33579d53dd28474aaaf5943d34eb14ab in current term 1: Already voted for candidate f3d9f899705748dcab7457361cc344c9 in this term.
I20260709 13:11:13.053514 28578 ts_tablet_manager.cc:1403] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.000s
I20260709 13:11:13.056113 28534 raft_consensus.cc:2468] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 1.
I20260709 13:11:13.056641 28627 raft_consensus.cc:515] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.057934 28460 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 1.
I20260709 13:11:13.067977 28627 leader_election.cc:290] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.071702 28583 leader_election.cc:290] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.072615 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:13.073580 28532 raft_consensus.cc:2393] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d9f899705748dcab7457361cc344c9 in current term 1: Already voted for candidate 33579d53dd28474aaaf5943d34eb14ab in this term.
I20260709 13:11:13.074795 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:13.074854 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:13.075444 28579 tablet_bootstrap.cc:654] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.075834 28384 raft_consensus.cc:2393] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d9f899705748dcab7457361cc344c9 in current term 1: Already voted for candidate 33579d53dd28474aaaf5943d34eb14ab in this term.
I20260709 13:11:13.077553 28426 leader_election.cc:304] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:13.078420 28597 raft_consensus.cc:2804] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.078959 28597 raft_consensus.cc:697] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:13.079319 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:13.080204 28351 leader_election.cc:304] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:13.080041 28597 consensus_queue.cc:237] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.085678 28599 raft_consensus.cc:2804] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.085407 28578 raft_consensus.cc:359] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.081413 28458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:13.086292 28578 raft_consensus.cc:385] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.086973 28458 raft_consensus.cc:2393] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33579d53dd28474aaaf5943d34eb14ab in current term 1: Already voted for candidate 6f5406d166ec4d46adb634784dc1e5a6 in this term.
I20260709 13:11:13.078979 28577 tablet_bootstrap.cc:492] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:13.087785 28577 ts_tablet_manager.cc:1403] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.151s	user 0.029s	sys 0.026s
I20260709 13:11:13.080135 28459 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 0.
I20260709 13:11:13.086865 28578 raft_consensus.cc:740] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.086171 28599 raft_consensus.cc:697] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:13.089694 28599 consensus_queue.cc:237] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.089429 28578 consensus_queue.cc:260] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.091418 28497 leader_election.cc:304] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.092897 28578 ts_tablet_manager.cc:1434] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:11:13.084755 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:13.094669 28426 leader_election.cc:304] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d9f899705748dcab7457361cc344c9; no voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:13.097297 28583 raft_consensus.cc:2804] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.096683 28577 raft_consensus.cc:359] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.097993 28585 raft_consensus.cc:2749] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.098205 28577 raft_consensus.cc:385] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.096735 28500 leader_election.cc:304] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:13.098587 28577 raft_consensus.cc:740] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.097965 28583 raft_consensus.cc:697] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Becoming Leader. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:13.099560 28626 raft_consensus.cc:2804] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.099385 28577 consensus_queue.cc:260] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.099977 28626 raft_consensus.cc:493] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.099813 28583 consensus_queue.cc:237] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.100416 28626 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.101899 28577 ts_tablet_manager.cc:1434] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:11:13.103020 28577 tablet_bootstrap.cc:492] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab: Bootstrap starting.
W20260709 13:11:13.099002 28497 leader_election.cc:343] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.116412 28626 raft_consensus.cc:515] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.119854 28577 tablet_bootstrap.cc:654] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.121210 28279 catalog_manager.cc:5697] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131). New cstate: current_term: 1 leader_uuid: "33579d53dd28474aaaf5943d34eb14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.109982 28497 leader_election.cc:304] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab; no voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.126596 28583 raft_consensus.cc:2749] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.127296 28626 leader_election.cc:290] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.127732 28585 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.129259 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
W20260709 13:11:13.133476 28497 leader_election.cc:343] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.125396 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:13.139320 28459 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.145326 28599 consensus_queue.cc:1048] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.149119 28579 tablet_bootstrap.cc:492] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6: No bootstrap required, opened a new log
I20260709 13:11:13.149902 28579 ts_tablet_manager.cc:1403] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.000s
I20260709 13:11:13.160388 28579 raft_consensus.cc:359] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.159912 28282 catalog_manager.cc:5697] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.161492 28579 raft_consensus.cc:385] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.164188 28579 raft_consensus.cc:740] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.165172 28579 consensus_queue.cc:260] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.178397 28599 consensus_queue.cc:1048] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.187497 28597 raft_consensus.cc:493] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.188819 28597 raft_consensus.cc:515] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.184988 28585 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:11:13.203284 28579 ts_tablet_manager.cc:1434] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6: Time spent starting tablet: real 0.053s	user 0.011s	sys 0.000s
I20260709 13:11:13.234931 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:13.236030 28385 raft_consensus.cc:2468] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:13.237385 28577 tablet_bootstrap.cc:492] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab: No bootstrap required, opened a new log
I20260709 13:11:13.238276 28577 ts_tablet_manager.cc:1403] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab: Time spent bootstrapping tablet: real 0.136s	user 0.027s	sys 0.071s
I20260709 13:11:13.241122 28423 leader_election.cc:304] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:13.245961 28637 raft_consensus.cc:2804] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.252014 28577 raft_consensus.cc:359] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.253835 28577 raft_consensus.cc:385] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.254760 28577 raft_consensus.cc:740] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.256814 28577 consensus_queue.cc:260] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.252260 28637 raft_consensus.cc:493] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.260212 28637 raft_consensus.cc:3060] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.264045 28577 ts_tablet_manager.cc:1434] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:11:13.260636 28598 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:13.268347 28597 leader_election.cc:290] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:13.270284 28626 raft_consensus.cc:493] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.270973 28459 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 1.
I20260709 13:11:13.270927 28626 raft_consensus.cc:515] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.271775 28532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:13.272538 28500 leader_election.cc:304] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:13.273442 28626 leader_election.cc:290] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.274006 28626 raft_consensus.cc:2804] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.275450 28383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:13.277936 28383 raft_consensus.cc:2468] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 0.
I20260709 13:11:13.278973 28599 raft_consensus.cc:493] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.279444 28599 raft_consensus.cc:515] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.282477 28599 leader_election.cc:290] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:13.275756 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:13.284675 28497 leader_election.cc:304] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:13.284536 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:13.272562 28532 raft_consensus.cc:2468] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:13.276140 28626 raft_consensus.cc:697] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Becoming Leader. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:13.291322 28583 raft_consensus.cc:2804] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.279364 28637 raft_consensus.cc:515] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.288358 28531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:13.295145 28280 catalog_manager.cc:5697] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.296439 28583 raft_consensus.cc:493] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.296921 28583 raft_consensus.cc:3060] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.290900 28626 consensus_queue.cc:237] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.300640 28459 raft_consensus.cc:2393] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5406d166ec4d46adb634784dc1e5a6 in current term 1: Already voted for candidate 33579d53dd28474aaaf5943d34eb14ab in this term.
I20260709 13:11:13.316381 28460 raft_consensus.cc:2393] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33579d53dd28474aaaf5943d34eb14ab in current term 1: Already voted for candidate f3d9f899705748dcab7457361cc344c9 in this term.
I20260709 13:11:13.326385 28351 leader_election.cc:304] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6; no voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.337157 28632 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.347856 28637 leader_election.cc:290] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:13.348810 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:13.349545 28531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:13.349871 28384 raft_consensus.cc:3060] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.350908 28648 raft_consensus.cc:493] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.352612 28583 raft_consensus.cc:515] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.354846 28531 raft_consensus.cc:2393] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d9f899705748dcab7457361cc344c9 in current term 1: Already voted for candidate 33579d53dd28474aaaf5943d34eb14ab in this term.
I20260709 13:11:13.356483 28583 leader_election.cc:290] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.359679 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:13.353188 28648 raft_consensus.cc:515] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.362100 28583 raft_consensus.cc:493] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.366017 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:13.364496 28583 raft_consensus.cc:515] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.368078 28648 leader_election.cc:290] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:13.363319 28384 raft_consensus.cc:2468] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 1.
I20260709 13:11:13.373775 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:13.372151 28460 raft_consensus.cc:2393] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33579d53dd28474aaaf5943d34eb14ab in current term 1: Already voted for candidate f3d9f899705748dcab7457361cc344c9 in this term.
I20260709 13:11:13.375326 28384 raft_consensus.cc:2468] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 0.
I20260709 13:11:13.376545 28423 leader_election.cc:304] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 33579d53dd28474aaaf5943d34eb14ab
I20260709 13:11:13.378901 28648 raft_consensus.cc:2804] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.379335 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:13.379490 28648 raft_consensus.cc:697] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:13.380085 28459 raft_consensus.cc:2468] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 0.
I20260709 13:11:13.380522 28648 consensus_queue.cc:237] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.374174 28383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6" is_pre_election: true
I20260709 13:11:13.374171 28282 catalog_manager.cc:5697] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131). New cstate: current_term: 1 leader_uuid: "33579d53dd28474aaaf5943d34eb14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.372354 28583 leader_election.cc:290] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.383132 28531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:13.381789 28383 raft_consensus.cc:2468] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:13.384398 28500 leader_election.cc:304] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:13.388445 28531 raft_consensus.cc:2468] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 0.
I20260709 13:11:13.391218 28500 leader_election.cc:304] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab; no voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.392508 28626 raft_consensus.cc:2804] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.392941 28626 raft_consensus.cc:493] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.393296 28626 raft_consensus.cc:3060] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.398900 28632 raft_consensus.cc:2749] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.388573 28423 leader_election.cc:304] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:13.404973 28597 raft_consensus.cc:2804] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.405408 28597 raft_consensus.cc:493] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.405742 28597 raft_consensus.cc:3060] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.410669 28583 raft_consensus.cc:2749] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.415426 28597 raft_consensus.cc:515] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.418457 28597 leader_election.cc:290] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:13.420452 28383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:13.421469 28383 raft_consensus.cc:3060] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.421768 28626 raft_consensus.cc:515] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.420765 28531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:13.423684 28531 raft_consensus.cc:2393] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3d9f899705748dcab7457361cc344c9 in current term 1: Already voted for candidate 33579d53dd28474aaaf5943d34eb14ab in this term.
I20260709 13:11:13.425544 28626 leader_election.cc:290] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.425693 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:13.426594 28460 raft_consensus.cc:2393] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33579d53dd28474aaaf5943d34eb14ab in current term 1: Already voted for candidate f3d9f899705748dcab7457361cc344c9 in this term.
I20260709 13:11:13.426964 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20432f1e2c8d49e7a8e420ac3d32b665" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:13.428766 28497 leader_election.cc:304] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab; no voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.430189 28626 raft_consensus.cc:2749] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.433123 28383 raft_consensus.cc:2468] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 1.
I20260709 13:11:13.435803 28423 leader_election.cc:304] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 33579d53dd28474aaaf5943d34eb14ab
I20260709 13:11:13.436594 28279 catalog_manager.cc:5697] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.437758 28648 raft_consensus.cc:2804] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.438180 28648 raft_consensus.cc:697] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:13.438971 28648 consensus_queue.cc:237] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.456243 28279 catalog_manager.cc:5697] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.481462 28632 raft_consensus.cc:493] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.482196 28632 raft_consensus.cc:515] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:13.484791 28632 leader_election.cc:290] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:13.485798 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d9f899705748dcab7457361cc344c9" is_pre_election: true
I20260709 13:11:13.486114 28531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33579d53dd28474aaaf5943d34eb14ab" is_pre_election: true
I20260709 13:11:13.487082 28531 raft_consensus.cc:2393] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5406d166ec4d46adb634784dc1e5a6 in current term 1: Already voted for candidate f3d9f899705748dcab7457361cc344c9 in this term.
I20260709 13:11:13.488317 28351 leader_election.cc:304] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6; no voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.489256 28632 raft_consensus.cc:3060] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.495211 28632 raft_consensus.cc:2749] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.528934 28648 consensus_queue.cc:1048] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.544461 28648 consensus_queue.cc:1048] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.572860 28626 consensus_queue.cc:1048] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.586670 28583 consensus_queue.cc:1048] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.595933 28632 consensus_queue.cc:1048] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.620144 28584 consensus_queue.cc:1048] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.743523 28460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:46646
I20260709 13:11:13.744483 28460 raft_consensus.cc:606] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Received request to transfer leadership to TS 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:13.753863 28460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:46646
I20260709 13:11:13.754591 28460 raft_consensus.cc:606] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Received request to transfer leadership to TS 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:13.766911 28648 raft_consensus.cc:993] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:13.767544 28648 raft_consensus.cc:1081] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Signalling peer 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:13.772348 28383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:40640
I20260709 13:11:13.773013 28383 raft_consensus.cc:493] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.773372 28383 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.778906 28627 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.781131 28383 raft_consensus.cc:515] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:13.785627 28383 leader_election.cc:290] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 2 election: Requested vote from peers 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:13.785872 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:13.786543 28459 raft_consensus.cc:3055] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.786903 28459 raft_consensus.cc:740] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:13.787880 28459 consensus_queue.cc:260] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:13.789203 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:13.789474 28459 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.789846 28534 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.798846 28534 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 2.
I20260709 13:11:13.804422 28627 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.807116 28351 leader_election.cc:304] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:13.808032 28584 raft_consensus.cc:2804] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:13.808521 28584 raft_consensus.cc:697] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:13.809397 28584 consensus_queue.cc:237] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:13.812743 28459 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 2.
I20260709 13:11:13.820575 28534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
mode: GRACEFUL
new_leader_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:49754
I20260709 13:11:13.822180 28534 raft_consensus.cc:606] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Received request to transfer leadership to TS f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.825248 28282 catalog_manager.cc:5697] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 reported cstate change: term changed from 1 to 2, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.841455 28534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
mode: GRACEFUL
new_leader_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:49754
I20260709 13:11:13.842347 28534 raft_consensus.cc:606] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Received request to transfer leadership to TS f3d9f899705748dcab7457361cc344c9
I20260709 13:11:13.849216 28460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:46646
I20260709 13:11:13.849956 28460 raft_consensus.cc:606] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Received request to transfer leadership to TS 33579d53dd28474aaaf5943d34eb14ab
I20260709 13:11:13.887256 28637 consensus_queue.cc:1048] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.888191 28597 consensus_queue.cc:1048] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.976438 28597 consensus_queue.cc:1048] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.987725 28585 raft_consensus.cc:993] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:13.988377 28585 raft_consensus.cc:1081] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Signalling peer 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:13.991355 28383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:40640
I20260709 13:11:13.991976 28383 raft_consensus.cc:493] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.992391 28383 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.999647 28648 consensus_queue.cc:1048] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.005587 28383 raft_consensus.cc:515] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.009085 28627 raft_consensus.cc:993] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab: : Instructing follower f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:14.009764 28627 raft_consensus.cc:1081] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Signalling peer f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:14.011758 28460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:46638
I20260709 13:11:14.012507 28460 raft_consensus.cc:493] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.013063 28460 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.013635 28383 leader_election.cc:290] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 2 election: Requested vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:14.015275 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:14.015956 28459 raft_consensus.cc:3055] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.016021 28531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:14.016320 28459 raft_consensus.cc:740] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:14.016899 28531 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.017364 28459 consensus_queue.cc:260] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.018795 28459 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.028450 28531 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 2.
I20260709 13:11:14.030752 28351 leader_election.cc:304] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:14.032227 28584 raft_consensus.cc:2804] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.032930 28584 raft_consensus.cc:697] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:14.034195 28584 consensus_queue.cc:237] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.027985 28460 raft_consensus.cc:515] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.038774 28460 leader_election.cc:290] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:14.036558 28459 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 2.
I20260709 13:11:14.039898 28383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:14.040107 28533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:14.040652 28383 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.040746 28533 raft_consensus.cc:3055] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.041150 28533 raft_consensus.cc:740] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:14.042243 28533 consensus_queue.cc:260] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.045496 28533 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.052416 28648 raft_consensus.cc:993] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:14.053046 28648 raft_consensus.cc:1081] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Signalling peer 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:14.055124 28531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:49742
I20260709 13:11:14.055776 28531 raft_consensus.cc:493] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.056203 28531 raft_consensus.cc:3060] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.055976 28280 catalog_manager.cc:5697] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 reported cstate change: term changed from 1 to 2, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.059029 28383 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:14.060714 28423 leader_election.cc:304] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:14.061822 28585 raft_consensus.cc:2804] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.062327 28585 raft_consensus.cc:697] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:14.063337 28585 consensus_queue.cc:237] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.064904 28531 raft_consensus.cc:515] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.070828 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:14.071583 28384 raft_consensus.cc:3060] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.073678 28533 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:14.079974 28531 leader_election.cc:290] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 2 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:14.079118 28281 catalog_manager.cc:5697] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 1 to 2, leader changed from 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131) to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.081346 28384 raft_consensus.cc:2468] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 2.
I20260709 13:11:14.082559 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f8bbc62844706a2752d75e854d691" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:14.082867 28497 leader_election.cc:304] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:14.083297 28459 raft_consensus.cc:3055] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.083659 28459 raft_consensus.cc:740] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:14.083900 28626 raft_consensus.cc:2804] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.084424 28626 raft_consensus.cc:697] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 2 LEADER]: Becoming Leader. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:14.084614 28459 consensus_queue.cc:260] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.085356 28626 consensus_queue.cc:237] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.086057 28459 raft_consensus.cc:3060] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.095887 28459 raft_consensus.cc:2468] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 2.
I20260709 13:11:14.097479 28281 catalog_manager.cc:5697] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab reported cstate change: term changed from 1 to 2, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131). New cstate: current_term: 2 leader_uuid: "33579d53dd28474aaaf5943d34eb14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.225509 28459 raft_consensus.cc:1275] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.227243 28667 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.241369 28531 raft_consensus.cc:1275] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.252082 28584 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:14.262454 28583 raft_consensus.cc:993] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: : Instructing follower f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:14.263083 28583 raft_consensus.cc:1081] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Signalling peer f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:14.265288 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:46638
I20260709 13:11:14.266008 28459 raft_consensus.cc:493] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.266486 28459 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.275213 28459 raft_consensus.cc:515] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.277877 28459 leader_election.cc:290] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:14.278340 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:14.279105 28384 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.279305 28531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:14.279968 28531 raft_consensus.cc:3055] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.280347 28531 raft_consensus.cc:740] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:14.281257 28531 consensus_queue.cc:260] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.282353 28531 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.288375 28531 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:14.287850 28384 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:14.289835 28426 leader_election.cc:304] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:14.290859 28585 raft_consensus.cc:2804] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.291388 28585 raft_consensus.cc:697] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:14.292280 28585 consensus_queue.cc:237] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:14.302851 28280 catalog_manager.cc:5697] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 1 to 2, leader changed from 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131) to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.491178 28384 raft_consensus.cc:1275] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.492888 28585 consensus_queue.cc:1048] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.497558 28531 raft_consensus.cc:1275] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.499272 28585 consensus_queue.cc:1048] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.548959 28531 raft_consensus.cc:1275] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.550748 28584 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:14.561255 28459 raft_consensus.cc:1275] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.563062 28645 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:14.588634 28459 raft_consensus.cc:1275] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.590147 28626 consensus_queue.cc:1048] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.598919 28384 raft_consensus.cc:1275] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.600868 28654 consensus_queue.cc:1048] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.850795 28531 raft_consensus.cc:1275] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.853140 28585 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:14.875072 28384 raft_consensus.cc:1275] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:14.878089 28648 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:15.956705 28313 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 28253
W20260709 13:11:15.957701 28313 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 28316
W20260709 13:11:15.958688 28313 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0ce0 after lost signal to thread 28409
W20260709 13:11:15.959512 28313 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4920 after lost signal to thread 28484
W20260709 13:11:15.960270 28313 debug-util.cc:398] Leaking SignalData structure 0x7b080019c4e0 after lost signal to thread 28558
I20260709 13:11:16.939559 28250 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:11:16.941256 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:16.969310 28459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:46650
I20260709 13:11:16.970045 28459 raft_consensus.cc:606] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Received request to transfer leadership to TS 33579d53dd28474aaaf5943d34eb14ab
I20260709 13:11:16.984221 28384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
mode: GRACEFUL
new_leader_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:40648
I20260709 13:11:16.984962 28384 raft_consensus.cc:606] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Received request to transfer leadership to TS 33579d53dd28474aaaf5943d34eb14ab
I20260709 13:11:16.986404 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:16.987053 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:17.363888 28677 raft_consensus.cc:993] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:17.364518 28637 raft_consensus.cc:1081] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Signalling peer 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:17.366469 28534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:49742
I20260709 13:11:17.367132 28534 raft_consensus.cc:493] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.367542 28534 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.374495 28534 raft_consensus.cc:515] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:17.377207 28534 leader_election.cc:290] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 3 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:17.378373 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:17.379289 28384 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.378753 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:17.380229 28459 raft_consensus.cc:3055] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:17.383459 28459 raft_consensus.cc:740] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:17.384594 28459 consensus_queue.cc:260] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:17.386142 28459 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.388509 28384 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 3.
I20260709 13:11:17.390331 28497 leader_election.cc:304] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:17.391337 28626 raft_consensus.cc:2804] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:17.395941 28459 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 3.
I20260709 13:11:17.403892 28626 raft_consensus.cc:697] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Becoming Leader. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:17.404918 28626 consensus_queue.cc:237] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:17.417582 28280 catalog_manager.cc:5697] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab reported cstate change: term changed from 2 to 3, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131). New cstate: current_term: 3 leader_uuid: "33579d53dd28474aaaf5943d34eb14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.481681 28684 raft_consensus.cc:993] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6: : Instructing follower 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:17.482257 28667 raft_consensus.cc:1081] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Signalling peer 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:17.484611 28534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:49734
I20260709 13:11:17.485374 28534 raft_consensus.cc:493] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.485800 28534 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.494606 28534 raft_consensus.cc:515] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:17.497231 28534 leader_election.cc:290] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 3 election: Requested vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787)
I20260709 13:11:17.498476 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:17.498493 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:17.499225 28459 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.499598 28384 raft_consensus.cc:3055] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:17.499949 28384 raft_consensus.cc:740] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:17.500916 28384 consensus_queue.cc:260] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:17.502313 28384 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.509524 28459 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 3.
I20260709 13:11:17.510886 28384 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 3.
I20260709 13:11:17.511227 28500 leader_election.cc:304] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:17.512341 28626 raft_consensus.cc:2804] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:17.512920 28626 raft_consensus.cc:697] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Becoming Leader. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:17.513756 28626 consensus_queue.cc:237] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:17.522555 28280 catalog_manager.cc:5697] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab reported cstate change: term changed from 2 to 3, leader changed from 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129) to 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131). New cstate: current_term: 3 leader_uuid: "33579d53dd28474aaaf5943d34eb14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.861127 28384 raft_consensus.cc:1275] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:17.862601 28626 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:17.877558 28457 raft_consensus.cc:1275] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:17.881068 28626 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:17.988181 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:17.999989 28534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
mode: GRACEFUL
new_leader_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:49754
I20260709 13:11:18.000619 28534 raft_consensus.cc:606] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Received request to transfer leadership to TS f3d9f899705748dcab7457361cc344c9
I20260709 13:11:18.019241 28384 raft_consensus.cc:1275] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:18.021109 28626 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:18.022612 28383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
mode: GRACEFUL
new_leader_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:40656
I20260709 13:11:18.023389 28383 raft_consensus.cc:606] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Received request to transfer leadership to TS f3d9f899705748dcab7457361cc344c9
I20260709 13:11:18.032557 28383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
mode: GRACEFUL
new_leader_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:40656
I20260709 13:11:18.033370 28383 raft_consensus.cc:606] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Received request to transfer leadership to TS f3d9f899705748dcab7457361cc344c9
I20260709 13:11:18.042908 28459 raft_consensus.cc:1275] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:18.045539 28626 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:18.059904 28678 raft_consensus.cc:993] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab: : Instructing follower f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.060490 28678 raft_consensus.cc:1081] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Signalling peer f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.062935 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:46638
I20260709 13:11:18.063653 28459 raft_consensus.cc:493] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.064069 28459 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.071475 28384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
mode: GRACEFUL
new_leader_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:40656
I20260709 13:11:18.072360 28384 raft_consensus.cc:606] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Received request to transfer leadership to TS f3d9f899705748dcab7457361cc344c9
I20260709 13:11:18.072832 28459 raft_consensus.cc:515] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:18.076716 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:18.077359 28534 raft_consensus.cc:3055] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:18.077728 28534 raft_consensus.cc:740] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:18.078737 28459 leader_election.cc:290] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 4 election: Requested vote from peers 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931), 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787)
I20260709 13:11:18.078685 28534 consensus_queue.cc:260] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:18.079670 28534 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.086659 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863cd51457434d5b9c46aa31b51c64f4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:18.087566 28384 raft_consensus.cc:3060] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.088500 28534 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 4.
I20260709 13:11:18.094007 28426 leader_election.cc:304] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:18.095112 28637 raft_consensus.cc:2804] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:18.097922 28533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
mode: GRACEFUL
new_leader_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:49754
I20260709 13:11:18.098878 28533 raft_consensus.cc:606] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Received request to transfer leadership to TS f3d9f899705748dcab7457361cc344c9
I20260709 13:11:18.101410 28384 raft_consensus.cc:2468] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 4.
I20260709 13:11:18.102984 28637 raft_consensus.cc:697] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 4 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:18.104056 28637 consensus_queue.cc:237] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } }
I20260709 13:11:18.110756 28282 catalog_manager.cc:5697] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 3 to 4, leader changed from 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131) to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.143149 28700 raft_consensus.cc:993] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6: : Instructing follower f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.143764 28667 raft_consensus.cc:1081] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Signalling peer f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.145638 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:46634
I20260709 13:11:18.146406 28459 raft_consensus.cc:493] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.146903 28459 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.156059 28459 raft_consensus.cc:515] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.158505 28459 leader_election.cc:290] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:18.159862 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:18.159862 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:18.160704 28384 raft_consensus.cc:3055] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.160764 28534 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.161072 28384 raft_consensus.cc:740] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:18.162029 28384 consensus_queue.cc:260] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.163249 28384 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.168850 28384 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:18.169751 28534 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:18.170135 28423 leader_election.cc:304] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:18.171221 28637 raft_consensus.cc:2804] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.171702 28637 raft_consensus.cc:697] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:18.172537 28637 consensus_queue.cc:237] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.182076 28282 catalog_manager.cc:5697] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 1 to 2, leader changed from 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129) to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.374070 28667 raft_consensus.cc:993] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6: : Instructing follower f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.374683 28700 raft_consensus.cc:1081] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Signalling peer f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.376464 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:46634
I20260709 13:11:18.377125 28459 raft_consensus.cc:493] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.377523 28459 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.386492 28459 raft_consensus.cc:515] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.389235 28459 leader_election.cc:290] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:18.390316 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:18.390694 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:18.391057 28384 raft_consensus.cc:3055] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:18.391268 28534 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.391490 28384 raft_consensus.cc:740] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:18.392371 28384 consensus_queue.cc:260] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.393649 28384 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.399214 28534 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 3.
I20260709 13:11:18.400687 28426 leader_election.cc:304] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:18.400962 28384 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 3.
I20260709 13:11:18.401648 28637 raft_consensus.cc:2804] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:18.402230 28637 raft_consensus.cc:697] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:18.403347 28637 consensus_queue.cc:237] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.413249 28282 catalog_manager.cc:5697] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 2 to 3, leader changed from 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129) to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.452724 28626 raft_consensus.cc:993] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: : Instructing follower f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.453298 28694 raft_consensus.cc:1081] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Signalling peer f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.455096 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:46638
I20260709 13:11:18.455910 28459 raft_consensus.cc:493] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.456321 28459 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.460994 28459 raft_consensus.cc:515] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.462704 28459 leader_election.cc:290] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:18.463616 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:18.463840 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dbb81d0dbd4a238b7746c213cee490" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:18.464223 28384 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.464347 28534 raft_consensus.cc:3055] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:18.464705 28534 raft_consensus.cc:740] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:18.465552 28534 consensus_queue.cc:260] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.466882 28534 raft_consensus.cc:3060] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.472637 28534 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 4.
I20260709 13:11:18.473269 28384 raft_consensus.cc:2468] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 4.
I20260709 13:11:18.473774 28426 leader_election.cc:304] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:18.474742 28637 raft_consensus.cc:2804] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:18.475274 28637 raft_consensus.cc:697] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 4 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:18.476073 28637 consensus_queue.cc:237] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.482584 28282 catalog_manager.cc:5697] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 3 to 4, leader changed from 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131) to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.502084 28667 raft_consensus.cc:993] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6: : Instructing follower f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.502687 28700 raft_consensus.cc:1081] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Signalling peer f3d9f899705748dcab7457361cc344c9 to start an election
I20260709 13:11:18.504505 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
 from {username='slave'} at 127.0.0.1:46634
I20260709 13:11:18.505211 28459 raft_consensus.cc:493] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.505605 28459 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.514806 28459 raft_consensus.cc:515] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.517154 28459 leader_election.cc:290] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:18.518411 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:18.518352 28384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "f3d9f899705748dcab7457361cc344c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:18.519260 28534 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.519330 28384 raft_consensus.cc:3055] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:18.519767 28384 raft_consensus.cc:740] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:18.520521 28384 consensus_queue.cc:260] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.527761 28384 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.533811 28384 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:18.534391 28534 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d9f899705748dcab7457361cc344c9 in term 2.
I20260709 13:11:18.535188 28423 leader_election.cc:304] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5406d166ec4d46adb634784dc1e5a6, f3d9f899705748dcab7457361cc344c9; no voters: 
I20260709 13:11:18.536166 28637 raft_consensus.cc:2804] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.536724 28637 raft_consensus.cc:697] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Leader. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:18.537595 28637 consensus_queue.cc:237] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:18.540478 28384 raft_consensus.cc:1275] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:18.542205 28696 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:18.548894 28282 catalog_manager.cc:5697] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 reported cstate change: term changed from 1 to 2, leader changed from 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129) to f3d9f899705748dcab7457361cc344c9 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "f3d9f899705748dcab7457361cc344c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.559039 28384 raft_consensus.cc:1275] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:18.560451 28534 raft_consensus.cc:1275] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:18.561024 28696 consensus_queue.cc:1048] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:18.565629 28637 consensus_queue.cc:1048] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:18.587832 28533 raft_consensus.cc:1275] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:18.589852 28707 consensus_queue.cc:1048] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:11:18.837845 28534 raft_consensus.cc:1275] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:18.839962 28708 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:18.852033 28383 raft_consensus.cc:1275] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:18.859292 28707 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:18.921344 28383 raft_consensus.cc:1275] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:18.922971 28708 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:18.933171 28533 raft_consensus.cc:1275] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:18.935137 28708 consensus_queue.cc:1048] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.007683 28383 raft_consensus.cc:1275] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.009479 28708 consensus_queue.cc:1048] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.025766 28533 raft_consensus.cc:1275] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Refusing update from remote peer f3d9f899705748dcab7457361cc344c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.027824 28707 consensus_queue.cc:1048] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.106850 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:21.115793 28459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:46650
I20260709 13:11:21.116640 28459 raft_consensus.cc:606] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Received request to transfer leadership to TS 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:21.119670 28459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:46650
I20260709 13:11:21.120253 28459 raft_consensus.cc:606] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 LEADER]: Received request to transfer leadership to TS 33579d53dd28474aaaf5943d34eb14ab
I20260709 13:11:21.122824 28459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:46650
I20260709 13:11:21.123449 28459 raft_consensus.cc:606] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Received request to transfer leadership to TS 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:21.125890 28459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:46650
I20260709 13:11:21.126284 28459 raft_consensus.cc:606] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Received request to transfer leadership to TS 6f5406d166ec4d46adb634784dc1e5a6
I20260709 13:11:21.128482 28459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714"
dest_uuid: "f3d9f899705748dcab7457361cc344c9"
mode: GRACEFUL
new_leader_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:46650
I20260709 13:11:21.128856 28459 raft_consensus.cc:606] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Received request to transfer leadership to TS 33579d53dd28474aaaf5943d34eb14ab
I20260709 13:11:21.129871 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:21.130328 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:21.156453 28707 raft_consensus.cc:993] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:21.157042 28707 raft_consensus.cc:1081] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Signalling peer 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:21.159102 28383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:40640
I20260709 13:11:21.159682 28383 raft_consensus.cc:493] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:21.160043 28383 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.167217 28383 raft_consensus.cc:515] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.169617 28383 leader_election.cc:290] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 3 election: Requested vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:21.170953 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:21.171363 28533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87b0686ced4cda9611d71c0e4554c4" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:21.171857 28459 raft_consensus.cc:3055] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:21.171958 28533 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.172147 28459 raft_consensus.cc:740] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:21.173061 28459 consensus_queue.cc:260] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.174182 28459 raft_consensus.cc:3060] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.178537 28533 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 3.
I20260709 13:11:21.179930 28459 raft_consensus.cc:2468] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 3.
I20260709 13:11:21.180487 28351 leader_election.cc:304] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:21.182559 28719 raft_consensus.cc:2804] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:21.183578 28718 raft_consensus.cc:993] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:21.183867 28719 raft_consensus.cc:697] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 LEADER]: Becoming Leader. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:21.184172 28707 raft_consensus.cc:1081] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 LEADER]: Signalling peer 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:21.185066 28719 consensus_queue.cc:237] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.186064 28533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:49742
I20260709 13:11:21.186692 28533 raft_consensus.cc:493] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:21.187085 28533 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.194717 28533 raft_consensus.cc:515] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.194656 28281 catalog_manager.cc:5697] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 reported cstate change: term changed from 2 to 3, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.196981 28533 leader_election.cc:290] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 4 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:21.198307 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:21.198278 28383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db08713d99b4c17a13fda7338bd2ce3" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:21.199128 28459 raft_consensus.cc:3055] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:21.199352 28383 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.199371 28459 raft_consensus.cc:740] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:21.200654 28459 consensus_queue.cc:260] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.202136 28459 raft_consensus.cc:3060] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.206213 28383 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 4.
I20260709 13:11:21.208005 28497 leader_election.cc:304] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:21.209272 28694 raft_consensus.cc:2804] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:21.210952 28459 raft_consensus.cc:2468] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 4.
I20260709 13:11:21.213586 28718 raft_consensus.cc:993] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:21.214162 28707 raft_consensus.cc:1081] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Signalling peer 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:21.214150 28694 raft_consensus.cc:697] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 4 LEADER]: Becoming Leader. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:21.216463 28383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:40640
I20260709 13:11:21.217007 28383 raft_consensus.cc:493] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:21.217350 28383 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.216753 28694 consensus_queue.cc:237] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.223855 28383 raft_consensus.cc:515] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.225957 28383 leader_election.cc:290] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 3 election: Requested vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:21.227619 28533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:21.227715 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0d89010aa41f59e09ae005522e477" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:21.226969 28281 catalog_manager.cc:5697] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab reported cstate change: term changed from 3 to 4, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131). New cstate: current_term: 4 leader_uuid: "33579d53dd28474aaaf5943d34eb14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.228344 28459 raft_consensus.cc:3055] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:21.228291 28533 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.228735 28459 raft_consensus.cc:740] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:21.229645 28459 consensus_queue.cc:260] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.230958 28459 raft_consensus.cc:3060] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.236218 28533 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 3.
I20260709 13:11:21.238003 28351 leader_election.cc:304] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:21.238933 28719 raft_consensus.cc:2804] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:21.239363 28719 raft_consensus.cc:697] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 LEADER]: Becoming Leader. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:21.240260 28719 consensus_queue.cc:237] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.240586 28459 raft_consensus.cc:2468] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 3.
I20260709 13:11:21.247581 28281 catalog_manager.cc:5697] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 reported cstate change: term changed from 2 to 3, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.466214 28718 raft_consensus.cc:993] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:21.466827 28707 raft_consensus.cc:1081] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Signalling peer 33579d53dd28474aaaf5943d34eb14ab to start an election
I20260709 13:11:21.468540 28534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714"
dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
 from {username='slave'} at 127.0.0.1:49742
I20260709 13:11:21.469064 28534 raft_consensus.cc:493] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:21.469377 28534 raft_consensus.cc:3060] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.473337 28718 raft_consensus.cc:993] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9: : Instructing follower 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:21.473878 28707 raft_consensus.cc:1081] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Signalling peer 6f5406d166ec4d46adb634784dc1e5a6 to start an election
I20260709 13:11:21.475534 28383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2"
dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
 from {username='slave'} at 127.0.0.1:40640
I20260709 13:11:21.476027 28383 raft_consensus.cc:493] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:21.476320 28383 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.476341 28534 raft_consensus.cc:515] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.478291 28534 leader_election.cc:290] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 2 election: Requested vote from peers 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787), f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417)
I20260709 13:11:21.479439 28385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f5406d166ec4d46adb634784dc1e5a6"
I20260709 13:11:21.479710 28459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c1465958e45bfbf651c23406a6714" candidate_uuid: "33579d53dd28474aaaf5943d34eb14ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:21.480432 28385 raft_consensus.cc:3060] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.480500 28459 raft_consensus.cc:3055] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:21.480901 28459 raft_consensus.cc:740] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:21.481793 28459 consensus_queue.cc:260] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.483263 28459 raft_consensus.cc:3060] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.484122 28383 raft_consensus.cc:515] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.486481 28383 leader_election.cc:290] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 3 election: Requested vote from peers f3d9f899705748dcab7457361cc344c9 (127.27.150.130:46417), 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131:41931)
I20260709 13:11:21.487763 28457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3d9f899705748dcab7457361cc344c9"
I20260709 13:11:21.488458 28457 raft_consensus.cc:3055] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:21.488785 28457 raft_consensus.cc:740] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3d9f899705748dcab7457361cc344c9, State: Running, Role: LEADER
I20260709 13:11:21.489351 28385 raft_consensus.cc:2468] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 2.
I20260709 13:11:21.489637 28457 consensus_queue.cc:260] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.490638 28497 leader_election.cc:304] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:21.491142 28457 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.491277 28459 raft_consensus.cc:2468] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33579d53dd28474aaaf5943d34eb14ab in term 2.
I20260709 13:11:21.492157 28694 raft_consensus.cc:2804] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:21.492393 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a148c8179a47d39e245217bb3af4b2" candidate_uuid: "6f5406d166ec4d46adb634784dc1e5a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33579d53dd28474aaaf5943d34eb14ab"
I20260709 13:11:21.492695 28694 raft_consensus.cc:697] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 2 LEADER]: Becoming Leader. State: Replica: 33579d53dd28474aaaf5943d34eb14ab, State: Running, Role: LEADER
I20260709 13:11:21.493064 28534 raft_consensus.cc:3060] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.493677 28694 consensus_queue.cc:237] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.500710 28534 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 3.
I20260709 13:11:21.501396 28457 raft_consensus.cc:2468] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5406d166ec4d46adb634784dc1e5a6 in term 3.
I20260709 13:11:21.501899 28351 leader_election.cc:304] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33579d53dd28474aaaf5943d34eb14ab, 6f5406d166ec4d46adb634784dc1e5a6; no voters: 
I20260709 13:11:21.502782 28719 raft_consensus.cc:2804] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:21.503276 28719 raft_consensus.cc:697] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 LEADER]: Becoming Leader. State: Replica: 6f5406d166ec4d46adb634784dc1e5a6, State: Running, Role: LEADER
I20260709 13:11:21.503399 28281 catalog_manager.cc:5697] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab reported cstate change: term changed from 1 to 2, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 33579d53dd28474aaaf5943d34eb14ab (127.27.150.131). New cstate: current_term: 2 leader_uuid: "33579d53dd28474aaaf5943d34eb14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.504205 28719 consensus_queue.cc:237] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } }
I20260709 13:11:21.516489 28281 catalog_manager.cc:5697] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 reported cstate change: term changed from 2 to 3, leader changed from f3d9f899705748dcab7457361cc344c9 (127.27.150.130) to 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "6f5406d166ec4d46adb634784dc1e5a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.640995 28534 raft_consensus.cc:1275] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.642872 28719 consensus_queue.cc:1048] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.654974 28457 raft_consensus.cc:1275] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.657375 28720 consensus_queue.cc:1048] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:21.747499 28457 raft_consensus.cc:1275] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.749114 28720 consensus_queue.cc:1048] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.760433 28534 raft_consensus.cc:1275] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.762964 28738 consensus_queue.cc:1048] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:21.782596 28457 raft_consensus.cc:1275] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:21.784030 28694 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:21.795374 28385 raft_consensus.cc:1275] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:21.798167 28741 consensus_queue.cc:1048] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:21.942700 28534 raft_consensus.cc:1275] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.944857 28738 consensus_queue.cc:1048] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33579d53dd28474aaaf5943d34eb14ab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.959331 28457 raft_consensus.cc:1275] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Refusing update from remote peer 6f5406d166ec4d46adb634784dc1e5a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.961913 28719 consensus_queue.cc:1048] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:21.994354 28385 raft_consensus.cc:1275] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:21.996167 28741 consensus_queue.cc:1048] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5406d166ec4d46adb634784dc1e5a6" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:22.006574 28457 raft_consensus.cc:1275] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Refusing update from remote peer 33579d53dd28474aaaf5943d34eb14ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:22.008051 28694 consensus_queue.cc:1048] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d9f899705748dcab7457361cc344c9" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 46417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:22.131470 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:22.137689 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
I20260709 13:11:22.167147 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:22.168231 28250 tablet_replica.cc:333] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.169552 28250 raft_consensus.cc:2243] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.170575 28250 raft_consensus.cc:2272] T 36dbb81d0dbd4a238b7746c213cee490 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.174368 28250 tablet_replica.cc:333] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.175273 28250 raft_consensus.cc:2243] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.176101 28250 raft_consensus.cc:2272] T 17a148c8179a47d39e245217bb3af4b2 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.178545 28250 tablet_replica.cc:333] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.179080 28250 raft_consensus.cc:2243] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.179502 28250 raft_consensus.cc:2272] T 863cd51457434d5b9c46aa31b51c64f4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.181389 28250 tablet_replica.cc:333] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.181957 28250 raft_consensus.cc:2243] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.182801 28250 raft_consensus.cc:2272] T 89b0d89010aa41f59e09ae005522e477 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.185380 28250 tablet_replica.cc:333] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.185885 28250 raft_consensus.cc:2243] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.186283 28250 raft_consensus.cc:2272] T 6db08713d99b4c17a13fda7338bd2ce3 P 6f5406d166ec4d46adb634784dc1e5a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.188899 28250 tablet_replica.cc:333] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.189479 28250 raft_consensus.cc:2243] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.189890 28250 raft_consensus.cc:2272] T ff4c1465958e45bfbf651c23406a6714 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.192055 28250 tablet_replica.cc:333] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.192529 28250 raft_consensus.cc:2243] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.192907 28250 raft_consensus.cc:2272] T 6a9f8bbc62844706a2752d75e854d691 P 6f5406d166ec4d46adb634784dc1e5a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.194696 28250 tablet_replica.cc:333] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.195114 28250 raft_consensus.cc:2243] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.195461 28250 raft_consensus.cc:2272] T 20432f1e2c8d49e7a8e420ac3d32b665 P 6f5406d166ec4d46adb634784dc1e5a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.197016 28250 tablet_replica.cc:333] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6: stopping tablet replica
I20260709 13:11:22.197433 28250 raft_consensus.cc:2243] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.198207 28250 raft_consensus.cc:2272] T cd87b0686ced4cda9611d71c0e4554c4 P 6f5406d166ec4d46adb634784dc1e5a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.307690 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
I20260709 13:11:22.331604 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
I20260709 13:11:22.360340 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:22.361519 28250 tablet_replica.cc:333] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.362681 28250 raft_consensus.cc:2243] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.363585 28250 raft_consensus.cc:2272] T 36dbb81d0dbd4a238b7746c213cee490 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.365700 28250 tablet_replica.cc:333] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.366307 28250 raft_consensus.cc:2243] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.368316 28250 raft_consensus.cc:2272] T 20432f1e2c8d49e7a8e420ac3d32b665 P f3d9f899705748dcab7457361cc344c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.371824 28250 tablet_replica.cc:333] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.372787 28250 raft_consensus.cc:2243] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.373567 28250 raft_consensus.cc:2272] T 6a9f8bbc62844706a2752d75e854d691 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.375681 28497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36787: connect: Connection refused (error 111)
I20260709 13:11:22.377079 28250 tablet_replica.cc:333] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.378041 28250 raft_consensus.cc:2243] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.378868 28250 raft_consensus.cc:2272] T ff4c1465958e45bfbf651c23406a6714 P f3d9f899705748dcab7457361cc344c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.380261 28497 consensus_peers.cc:597] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab -> Peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Couldn't send request to peer 6f5406d166ec4d46adb634784dc1e5a6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.382306 28250 tablet_replica.cc:333] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.383281 28250 raft_consensus.cc:2243] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.384207 28250 raft_consensus.cc:2272] T 863cd51457434d5b9c46aa31b51c64f4 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.386420 28250 tablet_replica.cc:333] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.387034 28250 raft_consensus.cc:2243] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.387465 28250 raft_consensus.cc:2272] T 89b0d89010aa41f59e09ae005522e477 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.389792 28250 tablet_replica.cc:333] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.390311 28250 raft_consensus.cc:2243] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.390832 28250 raft_consensus.cc:2272] T 17a148c8179a47d39e245217bb3af4b2 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.393986 28250 tablet_replica.cc:333] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.394841 28250 raft_consensus.cc:2243] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.395380 28250 raft_consensus.cc:2272] T 6db08713d99b4c17a13fda7338bd2ce3 P f3d9f899705748dcab7457361cc344c9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.397725 28497 consensus_peers.cc:597] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab -> Peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Couldn't send request to peer 6f5406d166ec4d46adb634784dc1e5a6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.398425 28250 tablet_replica.cc:333] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9: stopping tablet replica
I20260709 13:11:22.399044 28250 raft_consensus.cc:2243] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.399560 28250 raft_consensus.cc:2272] T cd87b0686ced4cda9611d71c0e4554c4 P f3d9f899705748dcab7457361cc344c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.431448 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
I20260709 13:11:22.453617 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
W20260709 13:11:22.461966 28497 consensus_peers.cc:597] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab -> Peer 6f5406d166ec4d46adb634784dc1e5a6 (127.27.150.129:36787): Couldn't send request to peer 6f5406d166ec4d46adb634784dc1e5a6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.484628 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:22.485483 28250 tablet_replica.cc:333] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.486256 28250 raft_consensus.cc:2243] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.486958 28250 raft_consensus.cc:2272] T 36dbb81d0dbd4a238b7746c213cee490 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.489741 28250 tablet_replica.cc:333] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.490572 28250 raft_consensus.cc:2243] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.491050 28250 raft_consensus.cc:2272] T 89b0d89010aa41f59e09ae005522e477 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.493999 28250 tablet_replica.cc:333] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.494699 28250 raft_consensus.cc:2243] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.495173 28250 raft_consensus.cc:2272] T 863cd51457434d5b9c46aa31b51c64f4 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.496941 28250 tablet_replica.cc:333] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.497509 28250 raft_consensus.cc:2243] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.498027 28250 raft_consensus.cc:2272] T 17a148c8179a47d39e245217bb3af4b2 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.500906 28250 tablet_replica.cc:333] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.501524 28250 raft_consensus.cc:2243] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.502357 28250 raft_consensus.cc:2272] T 6db08713d99b4c17a13fda7338bd2ce3 P 33579d53dd28474aaaf5943d34eb14ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.504550 28250 tablet_replica.cc:333] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.505014 28250 raft_consensus.cc:2243] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.505851 28250 raft_consensus.cc:2272] T 6a9f8bbc62844706a2752d75e854d691 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.507766 28250 tablet_replica.cc:333] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.508230 28250 raft_consensus.cc:2243] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.508606 28250 raft_consensus.cc:2272] T 20432f1e2c8d49e7a8e420ac3d32b665 P 33579d53dd28474aaaf5943d34eb14ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.510311 28250 tablet_replica.cc:333] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.510820 28250 raft_consensus.cc:2243] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.511658 28250 raft_consensus.cc:2272] T ff4c1465958e45bfbf651c23406a6714 P 33579d53dd28474aaaf5943d34eb14ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.513707 28250 tablet_replica.cc:333] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab: stopping tablet replica
I20260709 13:11:22.514181 28250 raft_consensus.cc:2243] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.514606 28250 raft_consensus.cc:2272] T cd87b0686ced4cda9611d71c0e4554c4 P 33579d53dd28474aaaf5943d34eb14ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.545789 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
I20260709 13:11:22.566881 28250 master.cc:562] Master@127.27.150.190:40469 shutting down...
I20260709 13:11:22.735718 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.736482 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.736829 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3ec86ff748604858992de9c24d8c3184: stopping tablet replica
I20260709 13:11:22.781780 28250 master.cc:584] Master@127.27.150.190:40469 shutdown complete.
33579d53dd28474aaaf5943d34eb14ab  1
6f5406d166ec4d46adb634784dc1e5a6  4
f3d9f899705748dcab7457361cc344c9  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13535 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:11:22.830973 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:33825
I20260709 13:11:22.832369 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:22.839366 28751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:22.839416 28752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:22.840755 28250 server_base.cc:1061] running on GCE node
W20260709 13:11:22.840826 28754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:22.842211 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:22.842417 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:22.843071 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602682843026 us; error 0 us; skew 500 ppm
I20260709 13:11:22.843716 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:22.846803 28250 webserver.cc:533] Webserver started at http://127.27.150.190:33565/ using document root <none> and password file <none>
I20260709 13:11:22.847430 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:22.847638 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:22.847997 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:22.849375 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "bcf20b36deb84ec992181b1336169a0e"
format_stamp: "Formatted at 2026-07-09 13:11:22 on dist-test-slave-nvvq"
I20260709 13:11:22.854995 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:11:22.859357 28759 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:22.860400 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:22.860738 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "bcf20b36deb84ec992181b1336169a0e"
format_stamp: "Formatted at 2026-07-09 13:11:22 on dist-test-slave-nvvq"
I20260709 13:11:22.861045 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:22.878383 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:22.880146 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:22.927578 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:33825
I20260709 13:11:22.927703 28810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:33825 every 8 connection(s)
I20260709 13:11:22.932029 28811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:22.943006 28811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e: Bootstrap starting.
I20260709 13:11:22.949208 28811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.954483 28811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e: No bootstrap required, opened a new log
I20260709 13:11:22.957187 28811 raft_consensus.cc:359] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcf20b36deb84ec992181b1336169a0e" member_type: VOTER }
I20260709 13:11:22.957701 28811 raft_consensus.cc:385] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.957978 28811 raft_consensus.cc:740] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf20b36deb84ec992181b1336169a0e, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.958702 28811 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcf20b36deb84ec992181b1336169a0e" member_type: VOTER }
I20260709 13:11:22.959219 28811 raft_consensus.cc:399] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:22.959443 28811 raft_consensus.cc:493] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:22.959802 28811 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.964859 28811 raft_consensus.cc:515] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcf20b36deb84ec992181b1336169a0e" member_type: VOTER }
I20260709 13:11:22.965464 28811 leader_election.cc:304] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcf20b36deb84ec992181b1336169a0e; no voters: 
I20260709 13:11:22.966818 28811 leader_election.cc:290] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:22.967334 28814 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.968811 28814 raft_consensus.cc:697] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 1 LEADER]: Becoming Leader. State: Replica: bcf20b36deb84ec992181b1336169a0e, State: Running, Role: LEADER
I20260709 13:11:22.969748 28814 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcf20b36deb84ec992181b1336169a0e" member_type: VOTER }
I20260709 13:11:22.970597 28811 sys_catalog.cc:565] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:22.975237 28815 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcf20b36deb84ec992181b1336169a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcf20b36deb84ec992181b1336169a0e" member_type: VOTER } }
I20260709 13:11:22.975337 28816 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcf20b36deb84ec992181b1336169a0e. Latest consensus state: current_term: 1 leader_uuid: "bcf20b36deb84ec992181b1336169a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcf20b36deb84ec992181b1336169a0e" member_type: VOTER } }
I20260709 13:11:22.976128 28815 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:22.976375 28816 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:22.984167 28820 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:22.989877 28820 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:22.991477 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:23.000617 28820 catalog_manager.cc:1383] Generated new cluster ID: bcc61ea7fdcc4815a8b5e137906b4cdc
I20260709 13:11:23.000967 28820 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:23.023892 28820 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:23.025378 28820 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:23.045372 28820 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e: Generated new TSK 0
I20260709 13:11:23.046183 28820 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:23.058918 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:23.066886 28832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.068542 28833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.070040 28835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.070065 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:23.071391 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:23.071583 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:23.071805 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602683071779 us; error 0 us; skew 500 ppm
I20260709 13:11:23.072436 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:23.075083 28250 webserver.cc:533] Webserver started at http://127.27.150.129:43993/ using document root <none> and password file <none>
I20260709 13:11:23.075647 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:23.075867 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:23.076174 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:23.077418 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "e43647297d384b6db15886f0f9e25361"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-nvvq"
I20260709 13:11:23.082386 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.005s
I20260709 13:11:23.086167 28840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.087103 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:23.087440 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "e43647297d384b6db15886f0f9e25361"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-nvvq"
I20260709 13:11:23.087713 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:23.101760 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:23.103430 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:23.105178 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:23.107861 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:23.108109 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.108371 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:23.108569 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.155963 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:43551
I20260709 13:11:23.156071 28902 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:43551 every 8 connection(s)
I20260709 13:11:23.161949 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:23.171017 28907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.173674 28908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.177752 28250 server_base.cc:1061] running on GCE node
W20260709 13:11:23.178117 28910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.179944 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:23.180213 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:23.180435 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602683180418 us; error 0 us; skew 500 ppm
I20260709 13:11:23.181046 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:23.183465 28903 heartbeater.cc:344] Connected to a master server at 127.27.150.190:33825
I20260709 13:11:23.183869 28903 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:23.184623 28250 webserver.cc:533] Webserver started at http://127.27.150.130:46413/ using document root <none> and password file <none>
I20260709 13:11:23.184790 28903 heartbeater.cc:507] Master 127.27.150.190:33825 requested a full tablet report, sending...
I20260709 13:11:23.185241 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:23.185433 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:23.185657 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:23.187156 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "85ee38972e334d7ba7538250bfdec19b"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-nvvq"
I20260709 13:11:23.187326 28776 ts_manager.cc:194] Registered new tserver with Master: e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551)
I20260709 13:11:23.189730 28776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52874
I20260709 13:11:23.192777 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:23.196821 28915 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.197587 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:11:23.197930 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "85ee38972e334d7ba7538250bfdec19b"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-nvvq"
I20260709 13:11:23.198226 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:23.222559 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:23.224218 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:23.225991 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:23.228752 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:23.229010 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.229298 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:23.229501 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.278354 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:35933
I20260709 13:11:23.278553 28977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:35933 every 8 connection(s)
I20260709 13:11:23.283993 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:23.293779 28981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.294158 28982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.299399 28978 heartbeater.cc:344] Connected to a master server at 127.27.150.190:33825
I20260709 13:11:23.300055 28978 heartbeater.cc:461] Registering TS with master...
W20260709 13:11:23.300769 28984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.301169 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:23.301630 28978 heartbeater.cc:507] Master 127.27.150.190:33825 requested a full tablet report, sending...
I20260709 13:11:23.302538 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:23.302876 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:23.303115 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602683303070 us; error 0 us; skew 500 ppm
I20260709 13:11:23.303970 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:23.304579 28776 ts_manager.cc:194] Registered new tserver with Master: 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:23.306588 28776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52876
I20260709 13:11:23.307134 28250 webserver.cc:533] Webserver started at http://127.27.150.131:33761/ using document root <none> and password file <none>
I20260709 13:11:23.307847 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:23.308149 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:23.308511 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:23.310062 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "4e42f004f6154b9d8a7547f6e863e13f"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-nvvq"
I20260709 13:11:23.315109 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:11:23.318769 28989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.319720 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:11:23.319999 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "4e42f004f6154b9d8a7547f6e863e13f"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-nvvq"
I20260709 13:11:23.320276 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:23.342669 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:23.344233 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:23.345901 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:23.348533 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:23.348758 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.349050 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:23.349221 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.397854 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:33219
I20260709 13:11:23.397964 29051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:33219 every 8 connection(s)
I20260709 13:11:23.414418 29052 heartbeater.cc:344] Connected to a master server at 127.27.150.190:33825
I20260709 13:11:23.414951 29052 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:23.415772 29052 heartbeater.cc:507] Master 127.27.150.190:33825 requested a full tablet report, sending...
I20260709 13:11:23.417966 28776 ts_manager.cc:194] Registered new tserver with Master: 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:23.418342 28250 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016845648s
I20260709 13:11:23.419992 28776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52884
I20260709 13:11:23.449946 28776 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52896:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:23.453347 28776 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:23.550830 28943 tablet_service.cc:1511] Processing CreateTablet for tablet 31e902a609ca4579a2e1b8dbead0b256 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:23.552173 29017 tablet_service.cc:1511] Processing CreateTablet for tablet 31e902a609ca4579a2e1b8dbead0b256 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:23.553227 29014 tablet_service.cc:1511] Processing CreateTablet for tablet 148528c259f04fd4b64bbf7e38774327 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:23.553802 29017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e902a609ca4579a2e1b8dbead0b256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.554152 28868 tablet_service.cc:1511] Processing CreateTablet for tablet 31e902a609ca4579a2e1b8dbead0b256 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:23.554740 29014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148528c259f04fd4b64bbf7e38774327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.555733 28868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e902a609ca4579a2e1b8dbead0b256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.557235 28864 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9be72518cf4c5bad8b2020486f02ce (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:23.558640 28864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9be72518cf4c5bad8b2020486f02ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.559814 29015 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0356f8846b46f4a5f85908bf3b93e6 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:23.559975 28942 tablet_service.cc:1511] Processing CreateTablet for tablet dcd28d392a7b4f668776a745ef594569 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:23.561218 29015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0356f8846b46f4a5f85908bf3b93e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.552644 28943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e902a609ca4579a2e1b8dbead0b256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.563714 28941 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0356f8846b46f4a5f85908bf3b93e6 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:23.565196 28941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0356f8846b46f4a5f85908bf3b93e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.567662 28940 tablet_service.cc:1511] Processing CreateTablet for tablet 148528c259f04fd4b64bbf7e38774327 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:23.567795 29016 tablet_service.cc:1511] Processing CreateTablet for tablet dcd28d392a7b4f668776a745ef594569 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:23.569214 29016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd28d392a7b4f668776a745ef594569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.570117 28866 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0356f8846b46f4a5f85908bf3b93e6 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:23.572444 28865 tablet_service.cc:1511] Processing CreateTablet for tablet 148528c259f04fd4b64bbf7e38774327 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:23.573611 28867 tablet_service.cc:1511] Processing CreateTablet for tablet dcd28d392a7b4f668776a745ef594569 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:23.574537 28863 tablet_service.cc:1511] Processing CreateTablet for tablet d486cc5d07ab48aea3790b59cb6f48b5 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:23.576381 28939 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9be72518cf4c5bad8b2020486f02ce (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:23.576630 29013 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9be72518cf4c5bad8b2020486f02ce (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:23.578140 29013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9be72518cf4c5bad8b2020486f02ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.578297 28866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0356f8846b46f4a5f85908bf3b93e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.577946 29009 tablet_service.cc:1511] Processing CreateTablet for tablet 079b1306e7794bc19cc41dc2ed9a54bb (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:23.579749 29012 tablet_service.cc:1511] Processing CreateTablet for tablet d486cc5d07ab48aea3790b59cb6f48b5 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:23.581099 28867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd28d392a7b4f668776a745ef594569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.582163 29008 tablet_service.cc:1511] Processing CreateTablet for tablet c9a60dcc9f694553be44abaebf177f7e (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:23.582239 29011 tablet_service.cc:1511] Processing CreateTablet for tablet cf1d02ad8ef74d53b334f9cbcf07367b (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:23.584141 29010 tablet_service.cc:1511] Processing CreateTablet for tablet 851f0ad59c694834a8ede67e35cf5955 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:23.586030 28942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd28d392a7b4f668776a745ef594569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.586560 28863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d486cc5d07ab48aea3790b59cb6f48b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.587021 29011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1d02ad8ef74d53b334f9cbcf07367b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.589020 28940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148528c259f04fd4b64bbf7e38774327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.589323 29010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851f0ad59c694834a8ede67e35cf5955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.590207 28865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148528c259f04fd4b64bbf7e38774327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.591594 28939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9be72518cf4c5bad8b2020486f02ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.597000 28938 tablet_service.cc:1511] Processing CreateTablet for tablet d486cc5d07ab48aea3790b59cb6f48b5 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:23.598728 28938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d486cc5d07ab48aea3790b59cb6f48b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.597039 28862 tablet_service.cc:1511] Processing CreateTablet for tablet cf1d02ad8ef74d53b334f9cbcf07367b (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:23.601836 28862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1d02ad8ef74d53b334f9cbcf07367b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.597239 28937 tablet_service.cc:1511] Processing CreateTablet for tablet cf1d02ad8ef74d53b334f9cbcf07367b (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:23.600752 29012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d486cc5d07ab48aea3790b59cb6f48b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.608479 28861 tablet_service.cc:1511] Processing CreateTablet for tablet 851f0ad59c694834a8ede67e35cf5955 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:23.609925 28861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851f0ad59c694834a8ede67e35cf5955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.610880 29008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a60dcc9f694553be44abaebf177f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.607910 28937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1d02ad8ef74d53b334f9cbcf07367b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.612356 29009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079b1306e7794bc19cc41dc2ed9a54bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.616863 28860 tablet_service.cc:1511] Processing CreateTablet for tablet 079b1306e7794bc19cc41dc2ed9a54bb (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:23.620810 28859 tablet_service.cc:1511] Processing CreateTablet for tablet c9a60dcc9f694553be44abaebf177f7e (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:23.621348 28936 tablet_service.cc:1511] Processing CreateTablet for tablet 851f0ad59c694834a8ede67e35cf5955 (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:23.622787 28936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851f0ad59c694834a8ede67e35cf5955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.626746 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079b1306e7794bc19cc41dc2ed9a54bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.627506 28859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a60dcc9f694553be44abaebf177f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.633944 28935 tablet_service.cc:1511] Processing CreateTablet for tablet 079b1306e7794bc19cc41dc2ed9a54bb (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:23.646968 28935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079b1306e7794bc19cc41dc2ed9a54bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.689800 28934 tablet_service.cc:1511] Processing CreateTablet for tablet c9a60dcc9f694553be44abaebf177f7e (DEFAULT_TABLE table=test-workload [id=4f4716fc6b744b6aa21f3b6c01f3b64c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:23.691741 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a60dcc9f694553be44abaebf177f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.716933 29067 tablet_bootstrap.cc:492] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:23.727100 29068 tablet_bootstrap.cc:492] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:23.782298 29068 tablet_bootstrap.cc:654] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.804524 29069 tablet_bootstrap.cc:492] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:23.803561 29067 tablet_bootstrap.cc:654] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.822311 29068 tablet_bootstrap.cc:492] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:23.823117 29068 ts_tablet_manager.cc:1403] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.014s
I20260709 13:11:23.826355 29069 tablet_bootstrap.cc:654] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.826130 29068 raft_consensus.cc:359] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.826886 29068 raft_consensus.cc:385] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.827167 29068 raft_consensus.cc:740] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.827924 29068 consensus_queue.cc:260] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.830832 29067 tablet_bootstrap.cc:492] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:23.831061 29052 heartbeater.cc:499] Master 127.27.150.190:33825 was elected leader, sending a full tablet report...
I20260709 13:11:23.831382 29067 ts_tablet_manager.cc:1403] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.115s	user 0.006s	sys 0.019s
I20260709 13:11:23.834844 29067 raft_consensus.cc:359] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.835610 29067 raft_consensus.cc:385] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.835943 29067 raft_consensus.cc:740] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.838258 29068 ts_tablet_manager.cc:1434] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:23.839411 29068 tablet_bootstrap.cc:492] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:23.844956 29067 consensus_queue.cc:260] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.853437 29068 tablet_bootstrap.cc:654] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.858430 29069 tablet_bootstrap.cc:492] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:23.859262 29069 ts_tablet_manager.cc:1403] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.013s
I20260709 13:11:23.859282 29067 ts_tablet_manager.cc:1434] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.013s
I20260709 13:11:23.861410 28978 heartbeater.cc:499] Master 127.27.150.190:33825 was elected leader, sending a full tablet report...
I20260709 13:11:23.863092 29069 raft_consensus.cc:359] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.863960 29069 raft_consensus.cc:385] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.864333 29069 raft_consensus.cc:740] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.865372 29069 consensus_queue.cc:260] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.866601 29067 tablet_bootstrap.cc:492] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:23.872740 29068 tablet_bootstrap.cc:492] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:23.873317 29068 ts_tablet_manager.cc:1403] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.012s
I20260709 13:11:23.874980 29069 ts_tablet_manager.cc:1434] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:11:23.875892 29067 tablet_bootstrap.cc:654] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.875856 28903 heartbeater.cc:499] Master 127.27.150.190:33825 was elected leader, sending a full tablet report...
I20260709 13:11:23.876652 29068 raft_consensus.cc:359] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.877447 29068 raft_consensus.cc:385] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.877748 29068 raft_consensus.cc:740] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.878572 29068 consensus_queue.cc:260] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.881381 29068 ts_tablet_manager.cc:1434] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:23.882479 29068 tablet_bootstrap.cc:492] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:23.882557 29069 tablet_bootstrap.cc:492] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:23.890558 29068 tablet_bootstrap.cc:654] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.895867 29069 tablet_bootstrap.cc:654] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.904141 29068 tablet_bootstrap.cc:492] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:23.904701 29068 ts_tablet_manager.cc:1403] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:11:23.908039 29068 raft_consensus.cc:359] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.908856 29068 raft_consensus.cc:385] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.909147 29068 raft_consensus.cc:740] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.910223 29068 consensus_queue.cc:260] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.914492 29068 ts_tablet_manager.cc:1434] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:11:23.915697 29068 tablet_bootstrap.cc:492] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:23.916002 29069 tablet_bootstrap.cc:492] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:23.916829 29069 ts_tablet_manager.cc:1403] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.008s
I20260709 13:11:23.921391 29069 raft_consensus.cc:359] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.922698 29069 raft_consensus.cc:385] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.923197 29069 raft_consensus.cc:740] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.923532 29068 tablet_bootstrap.cc:654] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.924553 29069 consensus_queue.cc:260] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.928117 29069 ts_tablet_manager.cc:1434] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:11:23.929621 29069 tablet_bootstrap.cc:492] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:23.936129 29068 tablet_bootstrap.cc:492] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:23.936748 29068 ts_tablet_manager.cc:1403] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:11:23.939800 29069 tablet_bootstrap.cc:654] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.940785 29068 raft_consensus.cc:359] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.941726 29067 tablet_bootstrap.cc:492] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:23.941643 29068 raft_consensus.cc:385] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.942267 29068 raft_consensus.cc:740] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.942526 29067 ts_tablet_manager.cc:1403] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.076s	user 0.040s	sys 0.035s
I20260709 13:11:23.943216 29068 consensus_queue.cc:260] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.945881 29068 ts_tablet_manager.cc:1434] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:23.947026 29068 tablet_bootstrap.cc:492] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:23.947096 29067 raft_consensus.cc:359] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.948336 29067 raft_consensus.cc:385] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.948819 29067 raft_consensus.cc:740] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.950009 29067 consensus_queue.cc:260] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.952557 29067 ts_tablet_manager.cc:1434] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:11:23.953740 29067 tablet_bootstrap.cc:492] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:23.957409 29068 tablet_bootstrap.cc:654] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.961170 29067 tablet_bootstrap.cc:654] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.965086 29069 tablet_bootstrap.cc:492] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:23.965845 29069 ts_tablet_manager.cc:1403] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.014s
I20260709 13:11:23.970754 29069 raft_consensus.cc:359] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.971673 29069 raft_consensus.cc:385] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.972252 29069 raft_consensus.cc:740] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.973078 29069 consensus_queue.cc:260] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.974154 29067 tablet_bootstrap.cc:492] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:23.974743 29067 ts_tablet_manager.cc:1403] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 13:11:23.975549 29069 ts_tablet_manager.cc:1434] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:23.974150 29068 tablet_bootstrap.cc:492] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:23.976632 29069 tablet_bootstrap.cc:492] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:23.976858 29068 ts_tablet_manager.cc:1403] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.012s
I20260709 13:11:23.977960 29067 raft_consensus.cc:359] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.978758 29067 raft_consensus.cc:385] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.979068 29067 raft_consensus.cc:740] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.979483 29074 raft_consensus.cc:493] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.980113 29068 raft_consensus.cc:359] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.980074 29067 consensus_queue.cc:260] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.981024 29068 raft_consensus.cc:385] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.980010 29074 raft_consensus.cc:515] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.981397 29068 raft_consensus.cc:740] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.982347 29068 consensus_queue.cc:260] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:23.984954 29069 tablet_bootstrap.cc:654] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.987337 29068 ts_tablet_manager.cc:1434] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:23.988423 29068 tablet_bootstrap.cc:492] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:23.990828 29074 leader_election.cc:290] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
W20260709 13:11:24.005981 28824 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:24.007308 29068 tablet_bootstrap.cc:654] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.008545 29067 ts_tablet_manager.cc:1434] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.006s
I20260709 13:11:24.014577 29067 tablet_bootstrap.cc:492] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:24.022946 29067 tablet_bootstrap.cc:654] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.037166 29069 tablet_bootstrap.cc:492] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:24.037837 29069 ts_tablet_manager.cc:1403] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.017s
I20260709 13:11:24.038600 29068 tablet_bootstrap.cc:492] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:24.039220 29068 ts_tablet_manager.cc:1403] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.016s
I20260709 13:11:24.041410 29069 raft_consensus.cc:359] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.042263 29069 raft_consensus.cc:385] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.042658 29069 raft_consensus.cc:740] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.042342 29068 raft_consensus.cc:359] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.043136 29068 raft_consensus.cc:385] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.043433 29068 raft_consensus.cc:740] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.044546 29072 raft_consensus.cc:493] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.044327 29068 consensus_queue.cc:260] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.045094 29072 raft_consensus.cc:515] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.050858 29072 leader_election.cc:290] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.043546 29069 consensus_queue.cc:260] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.061674 29069 ts_tablet_manager.cc:1434] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:11:24.066747 29069 tablet_bootstrap.cc:492] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:24.084322 29069 tablet_bootstrap.cc:654] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.083940 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.094269 29076 raft_consensus.cc:493] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.095089 29076 raft_consensus.cc:515] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
W20260709 13:11:24.103782 28918 leader_election.cc:343] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.104339 29076 leader_election.cc:290] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.124959 29069 tablet_bootstrap.cc:492] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:24.125779 29069 ts_tablet_manager.cc:1403] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.005s
I20260709 13:11:24.132018 29076 raft_consensus.cc:493] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.132782 29076 raft_consensus.cc:515] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.135864 29076 leader_election.cc:290] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.140558 29069 raft_consensus.cc:359] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.149941 28953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd28d392a7b4f668776a745ef594569" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.150254 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.150581 29072 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.150859 28953 raft_consensus.cc:2468] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 0.
I20260709 13:11:24.151134 29072 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
W20260709 13:11:24.152292 28843 leader_election.cc:343] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.153291 28843 leader_election.cc:304] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.153577 29072 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.154615 29076 raft_consensus.cc:2804] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.154884 29072 raft_consensus.cc:493] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.155124 29076 raft_consensus.cc:493] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.155622 29076 raft_consensus.cc:3060] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.155575 29072 raft_consensus.cc:515] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.158250 29072 leader_election.cc:290] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.160270 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.161214 29027 raft_consensus.cc:2468] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 0.
I20260709 13:11:24.141459 29069 raft_consensus.cc:385] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.165591 28916 leader_election.cc:304] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.166778 29084 raft_consensus.cc:2804] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.167120 29084 raft_consensus.cc:493] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.167438 29084 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.168087 29069 raft_consensus.cc:740] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.169273 28953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.170874 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.171309 29026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.172199 29068 ts_tablet_manager.cc:1434] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.133s	user 0.051s	sys 0.061s
I20260709 13:11:24.174080 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd28d392a7b4f668776a745ef594569" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
W20260709 13:11:24.174662 28841 leader_election.cc:343] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.175161 28841 leader_election.cc:304] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43647297d384b6db15886f0f9e25361; no voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:24.175277 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.176064 29067 tablet_bootstrap.cc:492] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:24.175170 29027 raft_consensus.cc:2468] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 0.
I20260709 13:11:24.177399 29068 tablet_bootstrap.cc:492] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:24.177649 29067 ts_tablet_manager.cc:1403] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.166s	user 0.065s	sys 0.071s
I20260709 13:11:24.176680 29069 consensus_queue.cc:260] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
W20260709 13:11:24.183122 28992 leader_election.cc:343] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:24.184000 28992 leader_election.cc:343] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.188081 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.188513 29068 tablet_bootstrap.cc:654] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.188196 29076 raft_consensus.cc:515] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.190495 29076 leader_election.cc:290] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.192031 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd28d392a7b4f668776a745ef594569" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:24.192705 28952 raft_consensus.cc:3060] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:24.192906 28992 leader_election.cc:343] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.192041 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.193526 28877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.192680 29084 raft_consensus.cc:515] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.201778 28878 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 0.
I20260709 13:11:24.201496 29067 raft_consensus.cc:359] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.202267 28951 raft_consensus.cc:2393] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e42f004f6154b9d8a7547f6e863e13f in current term 1: Already voted for candidate 85ee38972e334d7ba7538250bfdec19b in this term.
I20260709 13:11:24.202642 29067 raft_consensus.cc:385] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.203123 29067 raft_consensus.cc:740] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.204239 29067 consensus_queue.cc:260] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.194519 29076 raft_consensus.cc:2749] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.220450 29067 ts_tablet_manager.cc:1434] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.003s
I20260709 13:11:24.224745 29102 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.225584 29102 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.229246 29084 leader_election.cc:290] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.230959 29067 tablet_bootstrap.cc:492] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
W20260709 13:11:24.243187 28841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:33219, user_credentials={real_user=slave}} blocked reactor thread for 69093.2us
I20260709 13:11:24.243856 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.198756 28992 leader_election.cc:304] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f; no voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361
W20260709 13:11:24.245777 28992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:43551, user_credentials={real_user=slave}} blocked reactor thread for 52925.2us
I20260709 13:11:24.245862 29069 ts_tablet_manager.cc:1434] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.120s	user 0.010s	sys 0.010s
I20260709 13:11:24.245870 29090 raft_consensus.cc:2749] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:24.246105 28843 leader_election.cc:343] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.247704 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:24.247789 29026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd28d392a7b4f668776a745ef594569" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:24.244482 29102 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.248387 29027 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.249023 29026 raft_consensus.cc:3060] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.253050 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
W20260709 13:11:24.254323 28918 leader_election.cc:343] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:24.249095 28992 leader_election.cc:343] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.256234 28992 leader_election.cc:304] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f; no voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.257527 28992 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:24.250758 29067 tablet_bootstrap.cc:654] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.251142 29068 tablet_bootstrap.cc:492] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:24.258651 29068 ts_tablet_manager.cc:1403] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.013s
I20260709 13:11:24.260161 29027 raft_consensus.cc:2468] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 1.
I20260709 13:11:24.248274 28952 raft_consensus.cc:2468] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 1.
I20260709 13:11:24.251716 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.260406 29026 raft_consensus.cc:2468] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 1.
I20260709 13:11:24.261093 29025 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 0.
I20260709 13:11:24.262066 28841 leader_election.cc:304] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.262959 29102 raft_consensus.cc:2804] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.263473 29102 raft_consensus.cc:697] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 1 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:24.263176 28841 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:24.262224 29084 raft_consensus.cc:493] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.264427 29101 raft_consensus.cc:2804] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.264189 29084 raft_consensus.cc:515] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.264915 29101 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.264508 29102 consensus_queue.cc:237] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.265322 29101 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.266007 29069 tablet_bootstrap.cc:492] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:24.268011 29084 leader_election.cc:290] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.272243 29072 raft_consensus.cc:2749] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.272328 29090 raft_consensus.cc:2804] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.272825 29090 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.273203 29090 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.274137 28916 leader_election.cc:304] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.274770 29069 tablet_bootstrap.cc:654] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.275372 29084 raft_consensus.cc:2804] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.275928 29084 raft_consensus.cc:697] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:24.274385 29101 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.276024 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.276929 29084 consensus_queue.cc:237] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
W20260709 13:11:24.277710 28918 leader_election.cc:343] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.278093 29101 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.278622 29076 raft_consensus.cc:493] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.278677 29101 raft_consensus.cc:493] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.279347 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:24.279284 29076 raft_consensus.cc:515] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.279335 29101 raft_consensus.cc:515] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.281719 29076 leader_election.cc:290] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.282114 29101 leader_election.cc:290] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.286329 28953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.287709 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
W20260709 13:11:24.288095 28843 leader_election.cc:343] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.288473 28951 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 0.
I20260709 13:11:24.286695 29068 raft_consensus.cc:359] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.289194 29026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.288712 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.289867 29068 raft_consensus.cc:385] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.289171 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:24.290261 29068 raft_consensus.cc:740] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.290768 28843 leader_election.cc:304] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
W20260709 13:11:24.293695 28841 leader_election.cc:343] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.293540 29068 consensus_queue.cc:260] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
W20260709 13:11:24.294099 28843 leader_election.cc:343] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.294829 29102 raft_consensus.cc:2804] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.295308 29102 raft_consensus.cc:493] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.295687 29102 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.297623 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.297320 28773 catalog_manager.cc:5697] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 0 to 1, leader changed from <none> to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.300515 29068 ts_tablet_manager.cc:1434] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:11:24.298296 29027 raft_consensus.cc:2468] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 0.
I20260709 13:11:24.301865 29068 tablet_bootstrap.cc:492] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:24.302802 28916 leader_election.cc:304] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.304121 29074 raft_consensus.cc:2804] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:24.304301 28841 leader_election.cc:343] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.304549 29074 raft_consensus.cc:493] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.304967 29074 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.304854 28841 leader_election.cc:304] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43647297d384b6db15886f0f9e25361; no voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:24.311784 29068 tablet_bootstrap.cc:654] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.312682 29101 raft_consensus.cc:2749] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.301718 29067 tablet_bootstrap.cc:492] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:24.316383 29090 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.317876 29025 raft_consensus.cc:2393] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e43647297d384b6db15886f0f9e25361 in current term 1: Already voted for candidate 4e42f004f6154b9d8a7547f6e863e13f in this term.
I20260709 13:11:24.313644 29074 raft_consensus.cc:515] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.320039 28841 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43647297d384b6db15886f0f9e25361; no voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:24.321563 29072 raft_consensus.cc:493] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.321040 29067 ts_tablet_manager.cc:1403] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.004s
I20260709 13:11:24.323860 29072 raft_consensus.cc:515] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.326810 29074 leader_election.cc:290] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.327109 29067 raft_consensus.cc:359] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.328617 29101 raft_consensus.cc:2749] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.330753 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:24.331732 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:24.332166 29025 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.330240 29067 raft_consensus.cc:385] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.333467 29067 raft_consensus.cc:740] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
W20260709 13:11:24.335121 28918 leader_election.cc:343] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.335645 29072 leader_election.cc:290] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.335125 29067 consensus_queue.cc:260] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.334117 28776 catalog_manager.cc:5697] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 1 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.338814 29067 ts_tablet_manager.cc:1434] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:11:24.338681 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.338699 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.340315 29067 tablet_bootstrap.cc:492] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
W20260709 13:11:24.340544 28992 leader_election.cc:343] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:24.341329 28992 leader_election.cc:343] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.341773 28992 leader_election.cc:304] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f; no voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.342602 29072 raft_consensus.cc:2749] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.343849 29102 raft_consensus.cc:515] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.346148 29069 tablet_bootstrap.cc:492] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:24.346730 29069 ts_tablet_manager.cc:1403] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.014s
I20260709 13:11:24.347846 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:24.348703 28952 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.348940 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:24.350546 29102 leader_election.cc:290] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
W20260709 13:11:24.350849 28841 leader_election.cc:343] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.351100 29069 raft_consensus.cc:359] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.352619 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:24.354583 29068 tablet_bootstrap.cc:492] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:24.354359 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:24.355705 28878 raft_consensus.cc:2393] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e42f004f6154b9d8a7547f6e863e13f in current term 1: Already voted for candidate e43647297d384b6db15886f0f9e25361 in this term.
W20260709 13:11:24.356751 28992 leader_election.cc:343] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.357633 28992 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f; no voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.357897 29025 raft_consensus.cc:2468] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 1.
I20260709 13:11:24.358541 29072 raft_consensus.cc:2749] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.358882 29068 ts_tablet_manager.cc:1403] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.010s
I20260709 13:11:24.359136 28916 leader_election.cc:304] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.360066 29074 raft_consensus.cc:2804] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.360584 29074 raft_consensus.cc:697] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:24.361510 29074 consensus_queue.cc:237] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.362612 29069 raft_consensus.cc:385] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.362354 29068 raft_consensus.cc:359] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.363116 29069 raft_consensus.cc:740] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.363210 29068 raft_consensus.cc:385] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.363619 29068 raft_consensus.cc:740] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.364032 29069 consensus_queue.cc:260] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.364367 29068 consensus_queue.cc:260] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.352638 29090 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.367874 29069 ts_tablet_manager.cc:1434] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:11:24.368644 28952 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 1.
I20260709 13:11:24.347816 29067 tablet_bootstrap.cc:654] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.370051 28843 leader_election.cc:304] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 4e42f004f6154b9d8a7547f6e863e13f
I20260709 13:11:24.372759 29068 ts_tablet_manager.cc:1434] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:11:24.373996 29068 tablet_bootstrap.cc:492] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:24.374706 29102 raft_consensus.cc:2804] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.375331 29102 raft_consensus.cc:697] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:24.376291 29102 consensus_queue.cc:237] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.377396 29069 tablet_bootstrap.cc:492] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:24.395058 29068 tablet_bootstrap.cc:654] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.402067 29067 tablet_bootstrap.cc:492] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:24.402808 29067 ts_tablet_manager.cc:1403] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.009s
I20260709 13:11:24.407164 29069 tablet_bootstrap.cc:654] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.408267 28776 catalog_manager.cc:5697] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 0 to 1, leader changed from <none> to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.412804 29069 tablet_bootstrap.cc:492] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:24.413383 29069 ts_tablet_manager.cc:1403] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.002s
I20260709 13:11:24.413287 29067 raft_consensus.cc:359] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.414100 29067 raft_consensus.cc:385] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.414410 29067 raft_consensus.cc:740] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.415361 29067 consensus_queue.cc:260] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.417732 29067 ts_tablet_manager.cc:1434] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 13:11:24.418851 29067 tablet_bootstrap.cc:492] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:24.419902 29069 raft_consensus.cc:359] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.420676 29069 raft_consensus.cc:385] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.420980 29069 raft_consensus.cc:740] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.421501 28773 catalog_manager.cc:5697] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 1 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.422261 29069 consensus_queue.cc:260] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.425122 29069 ts_tablet_manager.cc:1434] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:24.425320 29068 tablet_bootstrap.cc:492] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:24.425788 29068 ts_tablet_manager.cc:1403] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.002s
I20260709 13:11:24.426211 29069 tablet_bootstrap.cc:492] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:24.427042 29067 tablet_bootstrap.cc:654] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.429150 29068 raft_consensus.cc:359] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.432484 29068 raft_consensus.cc:385] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.432760 29068 raft_consensus.cc:740] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.433486 29069 tablet_bootstrap.cc:654] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.433465 29068 consensus_queue.cc:260] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.445233 29069 tablet_bootstrap.cc:492] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:24.447139 29069 ts_tablet_manager.cc:1403] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:11:24.448402 29068 ts_tablet_manager.cc:1434] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.007s
I20260709 13:11:24.449908 29069 raft_consensus.cc:359] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.450695 29069 raft_consensus.cc:385] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.450981 29069 raft_consensus.cc:740] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.451929 29069 consensus_queue.cc:260] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.452538 29068 tablet_bootstrap.cc:492] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f: Bootstrap starting.
I20260709 13:11:24.454183 29069 ts_tablet_manager.cc:1434] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:11:24.455188 29069 tablet_bootstrap.cc:492] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:24.459394 29068 tablet_bootstrap.cc:654] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.461513 29069 tablet_bootstrap.cc:654] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.465471 29067 tablet_bootstrap.cc:492] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:24.466044 29067 ts_tablet_manager.cc:1403] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.025s
I20260709 13:11:24.467761 29068 tablet_bootstrap.cc:492] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f: No bootstrap required, opened a new log
I20260709 13:11:24.468390 29068 ts_tablet_manager.cc:1403] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:11:24.469571 29067 raft_consensus.cc:359] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.470186 29067 raft_consensus.cc:385] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.470471 29067 raft_consensus.cc:740] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.471192 29067 consensus_queue.cc:260] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.472466 29068 raft_consensus.cc:359] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.474009 29067 ts_tablet_manager.cc:1434] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:24.475425 29067 tablet_bootstrap.cc:492] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:24.474013 29068 raft_consensus.cc:385] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.475839 29068 raft_consensus.cc:740] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.476693 29068 consensus_queue.cc:260] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.477173 29069 tablet_bootstrap.cc:492] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:24.477651 29069 ts_tablet_manager.cc:1403] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 13:11:24.480468 29069 raft_consensus.cc:359] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.481143 29069 raft_consensus.cc:385] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.481423 29069 raft_consensus.cc:740] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.482281 29069 consensus_queue.cc:260] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.483560 29067 tablet_bootstrap.cc:654] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.484968 29069 ts_tablet_manager.cc:1434] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:24.485992 29069 tablet_bootstrap.cc:492] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361: Bootstrap starting.
I20260709 13:11:24.486847 29068 ts_tablet_manager.cc:1434] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260709 13:11:24.492700 29069 tablet_bootstrap.cc:654] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.498234 29069 tablet_bootstrap.cc:492] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361: No bootstrap required, opened a new log
I20260709 13:11:24.498735 29069 ts_tablet_manager.cc:1403] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:11:24.501667 29069 raft_consensus.cc:359] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.502183 29069 raft_consensus.cc:385] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.502434 29069 raft_consensus.cc:740] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.502566 29067 tablet_bootstrap.cc:492] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:24.503135 29067 ts_tablet_manager.cc:1403] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.010s
I20260709 13:11:24.503134 29069 consensus_queue.cc:260] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.504590 29074 raft_consensus.cc:493] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.505167 29069 ts_tablet_manager.cc:1434] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:24.505057 29074 raft_consensus.cc:515] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.506007 29067 raft_consensus.cc:359] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.506714 29067 raft_consensus.cc:385] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.507004 29067 raft_consensus.cc:740] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.507354 29074 leader_election.cc:290] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.507733 29067 consensus_queue.cc:260] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.508931 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.509502 28878 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 0.
I20260709 13:11:24.509954 29067 ts_tablet_manager.cc:1434] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:24.510491 28918 leader_election.cc:304] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.510968 29067 tablet_bootstrap.cc:492] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:24.511252 29074 raft_consensus.cc:2804] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.511540 29074 raft_consensus.cc:493] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.511821 29074 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.512111 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.512722 29025 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 0.
I20260709 13:11:24.518023 29067 tablet_bootstrap.cc:654] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.519513 29074 raft_consensus.cc:515] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.522646 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:24.523324 28878 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.525061 29067 tablet_bootstrap.cc:492] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:24.525519 29067 ts_tablet_manager.cc:1403] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:11:24.527037 29074 leader_election.cc:290] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.528347 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:24.528165 29067 raft_consensus.cc:359] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.528877 29067 raft_consensus.cc:385] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.528921 29025 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.529256 29067 raft_consensus.cc:740] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.529744 28878 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 1.
I20260709 13:11:24.530141 29067 consensus_queue.cc:260] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.530817 28918 leader_election.cc:304] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.531664 29074 raft_consensus.cc:2804] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.532120 29074 raft_consensus.cc:697] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:24.532334 29067 ts_tablet_manager.cc:1434] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:24.532968 29074 consensus_queue.cc:237] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.533478 29067 tablet_bootstrap.cc:492] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b: Bootstrap starting.
I20260709 13:11:24.534005 29072 raft_consensus.cc:493] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.534539 29072 raft_consensus.cc:515] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.537439 29072 leader_election.cc:290] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.540084 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.540887 28952 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 0.
I20260709 13:11:24.542394 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.542482 28992 leader_election.cc:304] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:24.543315 28878 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 0.
I20260709 13:11:24.543560 29072 raft_consensus.cc:2804] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.543952 29072 raft_consensus.cc:493] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.544349 29072 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.544941 29067 tablet_bootstrap.cc:654] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.546471 29090 raft_consensus.cc:493] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.546967 29090 raft_consensus.cc:515] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.549130 29090 leader_election.cc:290] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.550629 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.550729 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.551347 28952 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 0.
I20260709 13:11:24.551414 28878 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 0.
I20260709 13:11:24.552062 29072 raft_consensus.cc:515] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.553031 28992 leader_election.cc:304] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:24.554001 29072 leader_election.cc:290] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.554243 29090 raft_consensus.cc:2804] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.554774 29090 raft_consensus.cc:493] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.555215 29090 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.556455 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:24.557193 28878 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.557173 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:24.558257 28952 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.566193 29074 raft_consensus.cc:493] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.566650 28878 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 1.
I20260709 13:11:24.567008 29074 raft_consensus.cc:515] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.568394 28992 leader_election.cc:304] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.569459 29074 leader_election.cc:290] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.570503 29072 raft_consensus.cc:2804] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.570612 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.571632 28878 raft_consensus.cc:2468] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 0.
I20260709 13:11:24.571202 29090 raft_consensus.cc:515] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.573396 28918 leader_election.cc:304] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.573858 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.574514 29074 raft_consensus.cc:2804] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.574731 29027 raft_consensus.cc:2468] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 0.
I20260709 13:11:24.574990 29074 raft_consensus.cc:493] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.574062 29090 leader_election.cc:290] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.574767 29025 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 1.
I20260709 13:11:24.575726 28877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:24.575580 29074 raft_consensus.cc:3060] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.576407 28877 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.584834 29074 raft_consensus.cc:515] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.586403 28952 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 1.
I20260709 13:11:24.588721 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:24.589389 28878 raft_consensus.cc:3060] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.596078 29102 raft_consensus.cc:493] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.596634 29102 raft_consensus.cc:515] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.597709 28877 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 1.
I20260709 13:11:24.598902 29102 leader_election.cc:290] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.600034 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.600719 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.601076 29067 tablet_bootstrap.cc:492] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b: No bootstrap required, opened a new log
I20260709 13:11:24.601496 29025 raft_consensus.cc:2393] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e43647297d384b6db15886f0f9e25361 in current term 1: Already voted for candidate 85ee38972e334d7ba7538250bfdec19b in this term.
I20260709 13:11:24.601734 29067 ts_tablet_manager.cc:1403] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.037s
I20260709 13:11:24.603010 28841 leader_election.cc:304] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43647297d384b6db15886f0f9e25361; no voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:24.605206 29102 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.605938 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:24.606027 29067 raft_consensus.cc:359] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.607244 29067 raft_consensus.cc:385] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.607249 28952 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.597982 28776 catalog_manager.cc:5697] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 1 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.612623 28878 raft_consensus.cc:2468] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 1.
I20260709 13:11:24.613811 28918 leader_election.cc:304] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.614192 28992 leader_election.cc:304] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.614804 29084 raft_consensus.cc:2804] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.615042 29090 raft_consensus.cc:2804] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.615567 29090 raft_consensus.cc:697] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:24.616652 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:24.616433 29090 consensus_queue.cc:237] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.617273 29025 raft_consensus.cc:3060] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.607980 29067 raft_consensus.cc:740] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.621135 29067 consensus_queue.cc:260] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.622531 29072 raft_consensus.cc:697] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:24.623486 29072 consensus_queue.cc:237] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.624194 28952 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 1.
I20260709 13:11:24.604908 29074 leader_election.cc:290] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.629736 29025 raft_consensus.cc:2468] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 1.
I20260709 13:11:24.631341 29126 raft_consensus.cc:493] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.631918 29126 raft_consensus.cc:515] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.635840 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.638057 29102 raft_consensus.cc:2749] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.640481 29084 raft_consensus.cc:697] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:24.641059 29126 leader_election.cc:290] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.643369 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.644292 28952 raft_consensus.cc:2393] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e42f004f6154b9d8a7547f6e863e13f in current term 1: Already voted for candidate e43647297d384b6db15886f0f9e25361 in this term.
I20260709 13:11:24.645514 28992 leader_election.cc:304] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f; no voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.645836 29067 ts_tablet_manager.cc:1434] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b: Time spent starting tablet: real 0.044s	user 0.012s	sys 0.003s
I20260709 13:11:24.646824 29072 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.647078 29084 consensus_queue.cc:237] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.647984 28776 catalog_manager.cc:5697] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 1 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.652921 29072 raft_consensus.cc:2749] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.660598 28774 catalog_manager.cc:5697] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 1 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.664860 28776 catalog_manager.cc:5697] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 1 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.679167 29072 raft_consensus.cc:493] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.679821 29072 raft_consensus.cc:515] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.681865 29072 leader_election.cc:290] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.682821 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.683076 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:24.683410 28878 raft_consensus.cc:2468] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 0.
I20260709 13:11:24.683686 28952 raft_consensus.cc:2468] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 0.
I20260709 13:11:24.684496 28992 leader_election.cc:304] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.685158 29072 raft_consensus.cc:2804] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.685482 29072 raft_consensus.cc:493] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.685770 29072 raft_consensus.cc:3060] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.693958 29072 raft_consensus.cc:515] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.695828 29072 leader_election.cc:290] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:24.696691 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:24.696977 28952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:24.697245 28878 raft_consensus.cc:3060] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.697595 28952 raft_consensus.cc:3060] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.702654 28878 raft_consensus.cc:2468] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 1.
I20260709 13:11:24.702795 28952 raft_consensus.cc:2468] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 1.
I20260709 13:11:24.703855 28992 leader_election.cc:304] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:24.704574 29072 raft_consensus.cc:2804] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.704996 29072 raft_consensus.cc:697] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:24.705837 29072 consensus_queue.cc:237] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.713589 28774 catalog_manager.cc:5697] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 1 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.744385 29102 consensus_queue.cc:1048] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.760051 29076 consensus_queue.cc:1048] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.781318 29084 consensus_queue.cc:1048] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.796144 29084 consensus_queue.cc:1048] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.797288 29074 consensus_queue.cc:1048] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.807458 29076 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.812034 28878 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.821569 29074 consensus_queue.cc:1048] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.830513 29076 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.838358 29074 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.838967 29074 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:24.842016 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43647297d384b6db15886f0f9e25361" is_pre_election: true
I20260709 13:11:24.842258 29074 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:24.842981 28878 raft_consensus.cc:2393] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85ee38972e334d7ba7538250bfdec19b in current term 1: Already voted for candidate e43647297d384b6db15886f0f9e25361 in this term.
I20260709 13:11:24.843149 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:24.843973 29025 raft_consensus.cc:2393] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85ee38972e334d7ba7538250bfdec19b in current term 1: Already voted for candidate 4e42f004f6154b9d8a7547f6e863e13f in this term.
I20260709 13:11:24.845046 28916 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b; no voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361
I20260709 13:11:24.845894 29074 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.853559 29074 raft_consensus.cc:2749] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:25.014498 28824 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:25.027616 29074 consensus_queue.cc:1048] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.039912 29130 consensus_queue.cc:1048] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.080348 29072 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.081437 29130 consensus_queue.cc:1048] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.098281 29074 consensus_queue.cc:1048] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.099855 29149 consensus_queue.cc:1048] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.100257 29128 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.125820 29128 consensus_queue.cc:1048] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.175186 29128 consensus_queue.cc:1048] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.188089 29126 consensus_queue.cc:1048] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.950165 29101 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.950924 29101 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:25.952834 29101 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:25.954057 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f" is_pre_election: true
I20260709 13:11:25.954082 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b" is_pre_election: true
I20260709 13:11:25.954734 29025 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 1.
I20260709 13:11:25.954852 28951 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 1.
I20260709 13:11:25.955976 28841 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:25.956743 29101 raft_consensus.cc:2804] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:25.957103 29101 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.957340 29101 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.962689 29101 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:25.964550 29101 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:25.965654 29025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:25.965636 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:25.966482 28951 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.966427 29025 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.974335 28951 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:25.974335 29025 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:25.976224 28841 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:25.977133 29101 raft_consensus.cc:2804] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:25.978160 29101 raft_consensus.cc:697] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:25.979097 29101 consensus_queue.cc:237] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:25.987416 28773 catalog_manager.cc:5697] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 0 to 2, leader changed from <none> to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.361421 28951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:40080
I20260709 13:11:26.362110 28951 raft_consensus.cc:606] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:26.380409 29025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:59572
I20260709 13:11:26.381090 29025 raft_consensus.cc:606] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:26.387369 28951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:40080
I20260709 13:11:26.388070 28951 raft_consensus.cc:606] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:26.393950 28951 raft_consensus.cc:1275] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:26.395303 29101 consensus_queue.cc:1048] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.408978 29025 raft_consensus.cc:1275] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:26.409790 29027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
mode: GRACEFUL
new_leader_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:59572
I20260709 13:11:26.410511 29027 raft_consensus.cc:606] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Received request to transfer leadership to TS 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:26.410794 29101 consensus_queue.cc:1048] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.420814 29025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
mode: GRACEFUL
new_leader_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:59572
I20260709 13:11:26.421509 29025 raft_consensus.cc:606] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Received request to transfer leadership to TS 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:26.439546 28878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
mode: GRACEFUL
new_leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:38758
I20260709 13:11:26.440176 28878 raft_consensus.cc:606] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Received request to transfer leadership to TS 4e42f004f6154b9d8a7547f6e863e13f
I20260709 13:11:26.641192 29173 raft_consensus.cc:993] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:26.641702 29130 raft_consensus.cc:1081] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:26.643380 28878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38732
I20260709 13:11:26.643922 28878 raft_consensus.cc:493] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.644255 28878 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.650763 28878 raft_consensus.cc:515] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.652664 28878 leader_election.cc:290] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:26.653421 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:26.654124 28951 raft_consensus.cc:3055] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:26.654042 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:26.654693 28951 raft_consensus.cc:740] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:26.654866 29027 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.655496 28951 consensus_queue.cc:260] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.656611 28951 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.660629 29027 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:26.661831 28841 leader_election.cc:304] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:26.662586 28951 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:26.662708 29169 raft_consensus.cc:2804] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:26.663398 29169 raft_consensus.cc:697] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:26.664389 29169 consensus_queue.cc:237] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.668524 29090 raft_consensus.cc:993] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:26.669039 29162 raft_consensus.cc:1081] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:26.670852 28878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38744
I20260709 13:11:26.671495 28878 raft_consensus.cc:493] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.671931 28878 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.674865 28773 catalog_manager.cc:5697] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 1 to 2, leader changed from 85ee38972e334d7ba7538250bfdec19b (127.27.150.130) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.679945 28878 raft_consensus.cc:515] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.682070 28878 leader_election.cc:290] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:26.683215 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:26.683463 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:26.684017 28951 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.684135 29027 raft_consensus.cc:3055] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:26.684640 29027 raft_consensus.cc:740] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:26.685712 29027 consensus_queue.cc:260] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.687634 29027 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.692822 28951 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:26.694325 28843 leader_election.cc:304] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:26.695343 29169 raft_consensus.cc:2804] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:26.695835 29169 raft_consensus.cc:697] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:26.696756 29169 consensus_queue.cc:237] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.698364 29027 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:26.713622 28773 catalog_manager.cc:5697] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 1 to 2, leader changed from 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.724251 29090 raft_consensus.cc:993] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f: : Instructing follower 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:26.724718 29162 raft_consensus.cc:1081] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Signalling peer 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:26.726132 28951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:40078
I20260709 13:11:26.726668 28951 raft_consensus.cc:493] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.727003 28951 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.733222 28951 raft_consensus.cc:515] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.735015 28951 leader_election.cc:290] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 2 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:26.735805 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:26.736160 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:26.736490 28878 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.736742 29027 raft_consensus.cc:3055] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:26.737077 29027 raft_consensus.cc:740] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:26.737991 29027 consensus_queue.cc:260] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.739442 29027 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.744455 28878 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 2.
I20260709 13:11:26.745878 28918 leader_election.cc:304] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:26.746723 29130 raft_consensus.cc:2804] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:26.746992 29027 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 2.
I20260709 13:11:26.747272 29130 raft_consensus.cc:697] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:26.748240 29130 consensus_queue.cc:237] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.756520 28773 catalog_manager.cc:5697] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 1 to 2, leader changed from 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131) to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 2 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.780994 29130 raft_consensus.cc:993] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:26.781562 29173 raft_consensus.cc:1081] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:26.783073 28878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38732
I20260709 13:11:26.783569 28878 raft_consensus.cc:493] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.783843 28878 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.789557 28878 raft_consensus.cc:515] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.791402 28878 leader_election.cc:290] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:26.792117 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:26.792505 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:26.792825 28951 raft_consensus.cc:3055] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:26.793094 29027 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.793198 28951 raft_consensus.cc:740] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:26.794132 28951 consensus_queue.cc:260] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.795508 28951 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.801530 29027 raft_consensus.cc:2468] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:26.802897 28841 leader_election.cc:304] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:26.803416 28951 raft_consensus.cc:2468] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:26.803699 29101 raft_consensus.cc:2804] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:26.804268 29101 raft_consensus.cc:697] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:26.805171 29101 consensus_queue.cc:237] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.813688 28773 catalog_manager.cc:5697] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 1 to 2, leader changed from 85ee38972e334d7ba7538250bfdec19b (127.27.150.130) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.913478 29090 raft_consensus.cc:993] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f: : Instructing follower 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:26.913998 29162 raft_consensus.cc:1081] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Signalling peer 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:26.915621 28951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:40078
I20260709 13:11:26.916114 28951 raft_consensus.cc:493] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.916388 28951 raft_consensus.cc:3060] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.921923 28951 raft_consensus.cc:515] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.923801 28951 leader_election.cc:290] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 2 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:26.924888 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:26.925036 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079b1306e7794bc19cc41dc2ed9a54bb" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:26.925652 28878 raft_consensus.cc:3060] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.925763 29027 raft_consensus.cc:3055] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:26.926172 29027 raft_consensus.cc:740] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:26.927031 29027 consensus_queue.cc:260] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.928038 29027 raft_consensus.cc:3060] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.931339 28878 raft_consensus.cc:2468] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 2.
I20260709 13:11:26.932536 28918 leader_election.cc:304] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:26.933436 29173 raft_consensus.cc:2804] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:26.933866 29173 raft_consensus.cc:697] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 2 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:26.934340 29027 raft_consensus.cc:2468] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 2.
I20260709 13:11:26.934772 29173 consensus_queue.cc:237] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.943089 28773 catalog_manager.cc:5697] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 1 to 2, leader changed from 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131) to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 2 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.985169 29156 raft_consensus.cc:993] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361: : Instructing follower 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:26.985705 29101 raft_consensus.cc:1081] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Signalling peer 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:26.987399 29027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:59562
I20260709 13:11:26.987937 29027 raft_consensus.cc:493] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.988309 29027 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.993999 29027 raft_consensus.cc:515] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.995630 29027 leader_election.cc:290] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 3 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:26.996572 28878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:26.996896 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a60dcc9f694553be44abaebf177f7e" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:26.997107 28878 raft_consensus.cc:3055] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:26.997423 28878 raft_consensus.cc:740] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:26.997454 28951 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.998157 28878 consensus_queue.cc:260] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:26.999130 28878 raft_consensus.cc:3060] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.002977 28951 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 3.
I20260709 13:11:27.004033 28878 raft_consensus.cc:2468] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 3.
I20260709 13:11:27.004180 28992 leader_election.cc:304] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:27.004999 29162 raft_consensus.cc:2804] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:27.005426 29162 raft_consensus.cc:697] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:27.006196 29162 consensus_queue.cc:237] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:27.013368 28773 catalog_manager.cc:5697] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 2 to 3, leader changed from e43647297d384b6db15886f0f9e25361 (127.27.150.129) to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 3 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.085253 28951 raft_consensus.cc:1275] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.086773 29101 consensus_queue.cc:1048] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.097162 29027 raft_consensus.cc:1275] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.099897 29156 consensus_queue.cc:1048] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:27.103196 29027 raft_consensus.cc:1275] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.105196 29156 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.115092 28951 raft_consensus.cc:1275] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.116931 29101 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.312275 28878 raft_consensus.cc:1275] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.313530 29173 consensus_queue.cc:1048] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.322904 29027 raft_consensus.cc:1275] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.324556 29173 consensus_queue.cc:1048] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.345608 29027 raft_consensus.cc:1275] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.347260 29173 consensus_queue.cc:1048] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.348758 28951 raft_consensus.cc:1275] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.350260 29101 consensus_queue.cc:1048] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.360056 28878 raft_consensus.cc:1275] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.364374 29173 consensus_queue.cc:1048] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:27.367581 29027 raft_consensus.cc:1275] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:27.372612 29156 consensus_queue.cc:1048] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:27.391093 28878 raft_consensus.cc:1275] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:27.392443 29162 consensus_queue.cc:1048] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.401934 28951 raft_consensus.cc:1275] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:27.404008 29162 consensus_queue.cc:1048] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.478940 28250 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:11:29.480655 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.515525 28876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
mode: GRACEFUL
new_leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:38770
I20260709 13:11:29.516408 28876 raft_consensus.cc:606] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Received request to transfer leadership to TS 4e42f004f6154b9d8a7547f6e863e13f
I20260709 13:11:29.520008 28876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
mode: GRACEFUL
new_leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:38770
I20260709 13:11:29.520730 28876 raft_consensus.cc:606] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 LEADER]: Received request to transfer leadership to TS 4e42f004f6154b9d8a7547f6e863e13f
I20260709 13:11:29.522544 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:29.523342 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:29.788801 29169 raft_consensus.cc:993] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361: : Instructing follower 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:29.789402 29169 raft_consensus.cc:1081] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Signalling peer 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:29.791505 29027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:59562
I20260709 13:11:29.792133 29027 raft_consensus.cc:493] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.792510 29027 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.799937 29027 raft_consensus.cc:515] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:29.801844 29027 leader_election.cc:290] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 3 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:29.803104 28876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:29.803424 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:29.804093 28951 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.804046 28876 raft_consensus.cc:3055] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:29.804734 28876 raft_consensus.cc:740] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:29.805932 28876 consensus_queue.cc:260] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:29.807384 28876 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.811290 28951 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 3.
I20260709 13:11:29.812573 28992 leader_election.cc:304] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:29.813593 29201 raft_consensus.cc:2804] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:29.815094 29201 raft_consensus.cc:697] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:29.816315 29201 consensus_queue.cc:237] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:29.816813 28876 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 3.
I20260709 13:11:29.826870 28773 catalog_manager.cc:5697] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 2 to 3, leader changed from e43647297d384b6db15886f0f9e25361 (127.27.150.129) to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 3 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.935165 29207 raft_consensus.cc:993] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: : Instructing follower 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:29.935791 29169 raft_consensus.cc:1081] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 LEADER]: Signalling peer 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:29.937723 29027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:59562
I20260709 13:11:29.938279 29027 raft_consensus.cc:493] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.938723 29027 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.946329 29027 raft_consensus.cc:515] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:29.948032 29027 leader_election.cc:290] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 2 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:29.948906 28876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:29.949256 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:29.949512 28876 raft_consensus.cc:3055] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.949810 28951 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.949864 28876 raft_consensus.cc:740] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:29.950824 28876 consensus_queue.cc:260] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:29.951823 28876 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.954960 28951 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 2.
I20260709 13:11:29.956069 28992 leader_election.cc:304] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:29.956993 29201 raft_consensus.cc:2804] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:29.957438 29201 raft_consensus.cc:697] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:29.958122 28876 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 2.
I20260709 13:11:29.958289 29201 consensus_queue.cc:237] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:29.966048 28773 catalog_manager.cc:5697] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 1 to 2, leader changed from e43647297d384b6db15886f0f9e25361 (127.27.150.129) to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 2 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.346174 28951 raft_consensus.cc:1275] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:30.347622 29201 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:30.355227 28876 raft_consensus.cc:1275] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:30.356943 29201 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:30.524642 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:30.527164 28951 raft_consensus.cc:1275] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:30.528998 29201 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:30.543731 28876 raft_consensus.cc:1275] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:30.545341 29208 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:30.550962 29027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:59572
I20260709 13:11:30.551770 29027 raft_consensus.cc:606] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:30.561980 29027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:59572
I20260709 13:11:30.562809 29027 raft_consensus.cc:606] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:30.568271 28951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:40080
I20260709 13:11:30.568792 28951 raft_consensus.cc:606] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:30.574286 28951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:40080
I20260709 13:11:30.574860 28951 raft_consensus.cc:606] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:30.580214 28951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
mode: GRACEFUL
new_leader_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:40080
I20260709 13:11:30.580852 28951 raft_consensus.cc:606] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 LEADER]: Received request to transfer leadership to TS e43647297d384b6db15886f0f9e25361
I20260709 13:11:30.588521 29215 raft_consensus.cc:993] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.589226 29173 raft_consensus.cc:1081] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.591090 28876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38732
I20260709 13:11:30.591739 28876 raft_consensus.cc:493] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:30.592106 28876 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:30.599054 28876 raft_consensus.cc:515] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.601325 28876 leader_election.cc:290] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:30.602233 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:30.602736 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:30.602960 28951 raft_consensus.cc:3055] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:30.603308 29027 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:30.603334 28951 raft_consensus.cc:740] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:30.604185 28951 consensus_queue.cc:260] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.605180 28951 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:30.609025 29027 raft_consensus.cc:2468] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:30.610498 28951 raft_consensus.cc:2468] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:30.610594 28841 leader_election.cc:304] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:30.611567 29169 raft_consensus.cc:2804] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:30.612046 29169 raft_consensus.cc:697] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:30.612958 29169 consensus_queue.cc:237] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.622632 28776 catalog_manager.cc:5697] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 1 to 2, leader changed from 85ee38972e334d7ba7538250bfdec19b (127.27.150.130) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.714349 29215 raft_consensus.cc:993] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.714928 29173 raft_consensus.cc:1081] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.716630 28876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38732
I20260709 13:11:30.717181 28876 raft_consensus.cc:493] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:30.717446 28876 raft_consensus.cc:3060] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:30.723417 28876 raft_consensus.cc:515] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.725497 28876 leader_election.cc:290] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:30.726320 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:30.726696 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1d02ad8ef74d53b334f9cbcf07367b" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:30.726990 28951 raft_consensus.cc:3055] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:30.727236 29027 raft_consensus.cc:3060] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:30.727341 28951 raft_consensus.cc:740] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:30.728241 28951 consensus_queue.cc:260] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.729189 28951 raft_consensus.cc:3060] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:30.732602 29027 raft_consensus.cc:2468] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:30.733652 28841 leader_election.cc:304] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:30.734546 29169 raft_consensus.cc:2804] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:30.734598 28951 raft_consensus.cc:2468] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 2.
I20260709 13:11:30.735037 29169 raft_consensus.cc:697] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:30.735940 29169 consensus_queue.cc:237] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.742158 29208 raft_consensus.cc:993] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.742952 29217 raft_consensus.cc:1081] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.744813 28876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38744
I20260709 13:11:30.745477 28876 raft_consensus.cc:493] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:30.744979 28773 catalog_manager.cc:5697] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 1 to 2, leader changed from 85ee38972e334d7ba7538250bfdec19b (127.27.150.130) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.745890 28876 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.753849 28876 raft_consensus.cc:515] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.756284 28876 leader_election.cc:290] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 4 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:30.757277 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:30.758059 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0356f8846b46f4a5f85908bf3b93e6" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:30.758490 28951 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.758698 29027 raft_consensus.cc:3055] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:30.759092 29027 raft_consensus.cc:740] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:30.760237 29027 consensus_queue.cc:260] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.761628 29027 raft_consensus.cc:3060] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.765949 28951 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 4.
I20260709 13:11:30.767413 28843 leader_election.cc:304] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:30.767808 29027 raft_consensus.cc:2468] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 4.
I20260709 13:11:30.768321 29169 raft_consensus.cc:2804] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:30.768847 29169 raft_consensus.cc:697] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 4 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:30.769747 29169 consensus_queue.cc:237] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.776834 28773 catalog_manager.cc:5697] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 3 to 4, leader changed from 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 4 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.923308 29215 raft_consensus.cc:993] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.923893 29229 raft_consensus.cc:1081] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:30.925542 28876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38732
I20260709 13:11:30.926152 28876 raft_consensus.cc:493] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:30.926532 28876 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.932184 28876 raft_consensus.cc:515] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.933909 28876 leader_election.cc:290] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 3 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:30.934811 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:30.934955 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851f0ad59c694834a8ede67e35cf5955" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:30.935346 28951 raft_consensus.cc:3055] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:30.935489 29027 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.935699 28951 raft_consensus.cc:740] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:30.936538 28951 consensus_queue.cc:260] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.937505 28951 raft_consensus.cc:3060] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.940724 29027 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 3.
I20260709 13:11:30.941788 28841 leader_election.cc:304] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:30.942461 28951 raft_consensus.cc:2468] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 3.
I20260709 13:11:30.942729 29169 raft_consensus.cc:2804] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:30.943274 29169 raft_consensus.cc:697] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 3 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:30.944139 29169 consensus_queue.cc:237] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:30.953444 28773 catalog_manager.cc:5697] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 2 to 3, leader changed from 85ee38972e334d7ba7538250bfdec19b (127.27.150.130) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.046043 29027 raft_consensus.cc:1275] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:31.047438 29169 consensus_queue.cc:1048] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.060046 28951 raft_consensus.cc:1275] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:31.062902 29233 consensus_queue.cc:1048] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.064517 29208 raft_consensus.cc:993] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f: : Instructing follower e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:31.065062 29208 raft_consensus.cc:1081] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 LEADER]: Signalling peer e43647297d384b6db15886f0f9e25361 to start an election
I20260709 13:11:31.066967 28876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
 from {username='slave'} at 127.0.0.1:38744
I20260709 13:11:31.067552 28876 raft_consensus.cc:493] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.067984 28876 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.076910 28876 raft_consensus.cc:515] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:31.079258 28876 leader_election.cc:290] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 3 election: Requested vote from peers 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:31.080380 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:31.080597 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "e43647297d384b6db15886f0f9e25361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:31.081027 28951 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.081038 29027 raft_consensus.cc:3055] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:31.081576 29027 raft_consensus.cc:740] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:31.082485 29027 consensus_queue.cc:260] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:31.083359 29027 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.087057 28951 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 3.
I20260709 13:11:31.088303 28843 leader_election.cc:304] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ee38972e334d7ba7538250bfdec19b, e43647297d384b6db15886f0f9e25361; no voters: 
I20260709 13:11:31.089217 29233 raft_consensus.cc:2804] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:31.089737 29233 raft_consensus.cc:697] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 LEADER]: Becoming Leader. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:31.090677 29233 consensus_queue.cc:237] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:31.091413 29027 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43647297d384b6db15886f0f9e25361 in term 3.
I20260709 13:11:31.100064 28776 catalog_manager.cc:5697] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 reported cstate change: term changed from 2 to 3, leader changed from 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131) to e43647297d384b6db15886f0f9e25361 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "e43647297d384b6db15886f0f9e25361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.181643 28951 raft_consensus.cc:1275] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:31.183164 29233 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:31.189556 28951 raft_consensus.cc:1275] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:31.191244 29169 consensus_queue.cc:1048] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.193288 29026 raft_consensus.cc:1275] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 4 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:31.195487 29169 consensus_queue.cc:1048] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:31.206976 29026 raft_consensus.cc:1275] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:31.208891 29238 consensus_queue.cc:1048] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.335942 28951 raft_consensus.cc:1275] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:31.337379 29238 consensus_queue.cc:1048] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:31.347761 29026 raft_consensus.cc:1275] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:31.349903 29238 consensus_queue.cc:1048] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:31.555403 28951 raft_consensus.cc:1275] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:31.556838 29238 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:31.566859 29026 raft_consensus.cc:1275] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Refusing update from remote peer e43647297d384b6db15886f0f9e25361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:31.569608 29169 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.590055 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:33.598687 28876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
mode: GRACEFUL
new_leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:38770
I20260709 13:11:33.599247 28876 raft_consensus.cc:606] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Received request to transfer leadership to TS 4e42f004f6154b9d8a7547f6e863e13f
I20260709 13:11:33.601735 28876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
mode: GRACEFUL
new_leader_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:38770
I20260709 13:11:33.602154 28876 raft_consensus.cc:606] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Received request to transfer leadership to TS 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:33.604379 28876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
mode: GRACEFUL
new_leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:38770
I20260709 13:11:33.604794 28876 raft_consensus.cc:606] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 LEADER]: Received request to transfer leadership to TS 4e42f004f6154b9d8a7547f6e863e13f
I20260709 13:11:33.606825 28876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5"
dest_uuid: "e43647297d384b6db15886f0f9e25361"
mode: GRACEFUL
new_leader_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:38770
I20260709 13:11:33.607218 28876 raft_consensus.cc:606] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Received request to transfer leadership to TS 85ee38972e334d7ba7538250bfdec19b
I20260709 13:11:33.608153 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:33.608600 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:33.719611 29238 raft_consensus.cc:993] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361: : Instructing follower 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:33.720186 29238 raft_consensus.cc:1081] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Signalling peer 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:33.721787 28951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:40072
I20260709 13:11:33.722347 28951 raft_consensus.cc:493] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.722743 28951 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.727922 28951 raft_consensus.cc:515] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:33.729578 28951 leader_election.cc:290] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 3 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:33.730747 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:33.730747 28876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e902a609ca4579a2e1b8dbead0b256" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:33.731673 29027 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.731720 28876 raft_consensus.cc:3055] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:33.732190 28876 raft_consensus.cc:740] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:33.733156 28876 consensus_queue.cc:260] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:33.734944 28876 raft_consensus.cc:3060] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.738181 29027 raft_consensus.cc:2468] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 3.
I20260709 13:11:33.739509 28916 leader_election.cc:304] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:33.740307 29229 raft_consensus.cc:2804] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:33.741425 29229 raft_consensus.cc:697] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 3 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:33.741719 28876 raft_consensus.cc:2468] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 3.
I20260709 13:11:33.742583 29229 consensus_queue.cc:237] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:33.750285 28774 catalog_manager.cc:5697] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 2 to 3, leader changed from e43647297d384b6db15886f0f9e25361 (127.27.150.129) to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 3 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.976392 29207 raft_consensus.cc:993] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361: : Instructing follower 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:33.976991 29238 raft_consensus.cc:1081] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Signalling peer 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:33.978690 29027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:59562
I20260709 13:11:33.979249 29027 raft_consensus.cc:493] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.979645 29027 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.985934 29027 raft_consensus.cc:515] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:33.987460 29027 leader_election.cc:290] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 3 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:33.988366 28876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:33.988541 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148528c259f04fd4b64bbf7e38774327" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:33.989090 28876 raft_consensus.cc:3055] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:33.989173 28951 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.989522 28876 raft_consensus.cc:740] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:33.990263 28876 consensus_queue.cc:260] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:33.991272 28876 raft_consensus.cc:3060] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.994318 28951 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 3.
I20260709 13:11:33.995489 28992 leader_election.cc:304] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:33.996253 29208 raft_consensus.cc:2804] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:33.996996 28876 raft_consensus.cc:2468] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 3.
I20260709 13:11:33.998577 29208 raft_consensus.cc:697] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:33.999423 29208 consensus_queue.cc:237] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:34.008577 28774 catalog_manager.cc:5697] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 2 to 3, leader changed from e43647297d384b6db15886f0f9e25361 (127.27.150.129) to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 3 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.051049 29207 raft_consensus.cc:993] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: : Instructing follower 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:34.051548 29207 raft_consensus.cc:1081] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 LEADER]: Signalling peer 4e42f004f6154b9d8a7547f6e863e13f to start an election
I20260709 13:11:34.053114 29027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce"
dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
 from {username='slave'} at 127.0.0.1:59562
I20260709 13:11:34.053643 29027 raft_consensus.cc:493] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.053900 29027 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:34.059468 29027 raft_consensus.cc:515] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:34.061149 29027 leader_election.cc:290] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 4 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 85ee38972e334d7ba7538250bfdec19b (127.27.150.130:35933)
I20260709 13:11:34.062443 28876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:34.062659 28951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9be72518cf4c5bad8b2020486f02ce" candidate_uuid: "4e42f004f6154b9d8a7547f6e863e13f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
I20260709 13:11:34.063280 28876 raft_consensus.cc:3055] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:34.063339 28951 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:34.063637 28876 raft_consensus.cc:740] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:34.064357 28876 consensus_queue.cc:260] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:34.065339 28876 raft_consensus.cc:3060] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:34.069042 28951 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 4.
I20260709 13:11:34.070262 28992 leader_election.cc:304] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:34.070626 28876 raft_consensus.cc:2468] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e42f004f6154b9d8a7547f6e863e13f in term 4.
I20260709 13:11:34.071298 29208 raft_consensus.cc:2804] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:34.071915 29208 raft_consensus.cc:697] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 4 LEADER]: Becoming Leader. State: Replica: 4e42f004f6154b9d8a7547f6e863e13f, State: Running, Role: LEADER
I20260709 13:11:34.072844 29208 consensus_queue.cc:237] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:34.081054 28774 catalog_manager.cc:5697] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f reported cstate change: term changed from 3 to 4, leader changed from e43647297d384b6db15886f0f9e25361 (127.27.150.129) to 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131). New cstate: current_term: 4 leader_uuid: "4e42f004f6154b9d8a7547f6e863e13f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.121544 29238 raft_consensus.cc:993] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: : Instructing follower 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:34.122123 29207 raft_consensus.cc:1081] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Signalling peer 85ee38972e334d7ba7538250bfdec19b to start an election
I20260709 13:11:34.123823 28951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5"
dest_uuid: "85ee38972e334d7ba7538250bfdec19b"
 from {username='slave'} at 127.0.0.1:40072
I20260709 13:11:34.124387 28951 raft_consensus.cc:493] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.124735 28951 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.132295 28951 raft_consensus.cc:515] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:34.134325 28951 leader_election.cc:290] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 3 election: Requested vote from peers e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551), 4e42f004f6154b9d8a7547f6e863e13f (127.27.150.131:33219)
I20260709 13:11:34.135269 28876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e43647297d384b6db15886f0f9e25361"
I20260709 13:11:34.135462 29027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d486cc5d07ab48aea3790b59cb6f48b5" candidate_uuid: "85ee38972e334d7ba7538250bfdec19b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e42f004f6154b9d8a7547f6e863e13f"
I20260709 13:11:34.135987 28876 raft_consensus.cc:3055] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:34.136034 29027 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.136394 28876 raft_consensus.cc:740] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43647297d384b6db15886f0f9e25361, State: Running, Role: LEADER
I20260709 13:11:34.137188 28876 consensus_queue.cc:260] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:34.138162 28876 raft_consensus.cc:3060] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.142189 29027 raft_consensus.cc:2468] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 3.
I20260709 13:11:34.143332 28916 leader_election.cc:304] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e42f004f6154b9d8a7547f6e863e13f, 85ee38972e334d7ba7538250bfdec19b; no voters: 
I20260709 13:11:34.144037 29229 raft_consensus.cc:2804] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:34.144317 28876 raft_consensus.cc:2468] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85ee38972e334d7ba7538250bfdec19b in term 3.
I20260709 13:11:34.144644 29229 raft_consensus.cc:697] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 3 LEADER]: Becoming Leader. State: Replica: 85ee38972e334d7ba7538250bfdec19b, State: Running, Role: LEADER
I20260709 13:11:34.145596 29229 consensus_queue.cc:237] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } }
I20260709 13:11:34.153622 28774 catalog_manager.cc:5697] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b reported cstate change: term changed from 2 to 3, leader changed from e43647297d384b6db15886f0f9e25361 (127.27.150.129) to 85ee38972e334d7ba7538250bfdec19b (127.27.150.130). New cstate: current_term: 3 leader_uuid: "85ee38972e334d7ba7538250bfdec19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.164903 28876 raft_consensus.cc:1275] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.166016 29244 consensus_queue.cc:1048] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.179922 29027 raft_consensus.cc:1275] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.181303 29244 consensus_queue.cc:1048] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.571200 28876 raft_consensus.cc:1275] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 4 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:34.572917 29208 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:34.586061 28951 raft_consensus.cc:1275] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:34.587636 29208 consensus_queue.cc:1048] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:34.589705 28876 raft_consensus.cc:1275] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.591136 29208 consensus_queue.cc:1048] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.600932 28952 raft_consensus.cc:1275] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Refusing update from remote peer 4e42f004f6154b9d8a7547f6e863e13f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.603307 29260 consensus_queue.cc:1048] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ee38972e334d7ba7538250bfdec19b" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:34.609439 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:34.614315 28876 raft_consensus.cc:1275] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.616192 29244 consensus_queue.cc:1048] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43647297d384b6db15886f0f9e25361" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 43551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.619761 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
W20260709 13:11:34.633142 28918 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:11:34.634305 29027 raft_consensus.cc:1275] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Refusing update from remote peer 85ee38972e334d7ba7538250bfdec19b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:11:34.637091 28918 consensus_peers.cc:597] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b -> Peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Couldn't send request to peer e43647297d384b6db15886f0f9e25361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.637370 29266 consensus_queue.cc:1048] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e42f004f6154b9d8a7547f6e863e13f" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:34.673467 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:34.674253 28250 tablet_replica.cc:333] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.674994 28250 raft_consensus.cc:2243] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.675849 28250 raft_consensus.cc:2272] T cf1d02ad8ef74d53b334f9cbcf07367b P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.678622 28250 tablet_replica.cc:333] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.679363 28250 raft_consensus.cc:2243] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.679832 28250 pending_rounds.cc:70] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: Trying to abort 1 pending ops.
I20260709 13:11:34.680145 28250 pending_rounds.cc:77] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636635229155328 op_type: NO_OP noop_request { }
I20260709 13:11:34.680485 28250 raft_consensus.cc:2889] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:34.680747 28250 raft_consensus.cc:2272] T d486cc5d07ab48aea3790b59cb6f48b5 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.682934 28250 tablet_replica.cc:333] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.683495 28250 raft_consensus.cc:2243] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.683874 28250 raft_consensus.cc:2272] T 31e902a609ca4579a2e1b8dbead0b256 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.687111 28250 tablet_replica.cc:333] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.687708 28250 raft_consensus.cc:2243] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.688151 28250 raft_consensus.cc:2272] T 148528c259f04fd4b64bbf7e38774327 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.690877 28250 tablet_replica.cc:333] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.691515 28250 raft_consensus.cc:2243] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.692694 28250 raft_consensus.cc:2272] T 851f0ad59c694834a8ede67e35cf5955 P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.695429 28250 tablet_replica.cc:333] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.696059 28250 raft_consensus.cc:2243] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.696614 28250 raft_consensus.cc:2272] T 6a9be72518cf4c5bad8b2020486f02ce P e43647297d384b6db15886f0f9e25361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.699347 28250 tablet_replica.cc:333] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.699920 28250 raft_consensus.cc:2243] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.700803 28250 raft_consensus.cc:2272] T dcd28d392a7b4f668776a745ef594569 P e43647297d384b6db15886f0f9e25361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.702813 28250 tablet_replica.cc:333] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.703349 28250 raft_consensus.cc:2243] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.703794 28250 raft_consensus.cc:2272] T 079b1306e7794bc19cc41dc2ed9a54bb P e43647297d384b6db15886f0f9e25361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.705714 28250 tablet_replica.cc:333] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.706220 28250 raft_consensus.cc:2243] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.707065 28250 raft_consensus.cc:2272] T 0e0356f8846b46f4a5f85908bf3b93e6 P e43647297d384b6db15886f0f9e25361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.708853 28250 tablet_replica.cc:333] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361: stopping tablet replica
I20260709 13:11:34.709355 28250 raft_consensus.cc:2243] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.709774 28250 raft_consensus.cc:2272] T c9a60dcc9f694553be44abaebf177f7e P e43647297d384b6db15886f0f9e25361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.733925 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
I20260709 13:11:34.760123 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
W20260709 13:11:34.786378 28918 consensus_peers.cc:597] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b -> Peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Couldn't send request to peer e43647297d384b6db15886f0f9e25361. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:43551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:34.795156 28918 consensus_peers.cc:597] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b -> Peer e43647297d384b6db15886f0f9e25361 (127.27.150.129:43551): Couldn't send request to peer e43647297d384b6db15886f0f9e25361. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:43551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.798123 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:34.798941 28250 tablet_replica.cc:333] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.799630 28250 raft_consensus.cc:2243] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.800235 28250 raft_consensus.cc:2272] T 851f0ad59c694834a8ede67e35cf5955 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.802623 28250 tablet_replica.cc:333] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.803220 28250 raft_consensus.cc:2243] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.803678 28250 raft_consensus.cc:2272] T cf1d02ad8ef74d53b334f9cbcf07367b P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.805658 28250 tablet_replica.cc:333] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.806197 28250 raft_consensus.cc:2243] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.806668 28250 raft_consensus.cc:2272] T c9a60dcc9f694553be44abaebf177f7e P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.808650 28250 tablet_replica.cc:333] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.809227 28250 raft_consensus.cc:2243] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.810081 28250 raft_consensus.cc:2272] T 079b1306e7794bc19cc41dc2ed9a54bb P 85ee38972e334d7ba7538250bfdec19b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.811856 28250 tablet_replica.cc:333] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.812390 28250 raft_consensus.cc:2243] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.812836 28250 raft_consensus.cc:2272] T 0e0356f8846b46f4a5f85908bf3b93e6 P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.814687 28250 tablet_replica.cc:333] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.815193 28250 raft_consensus.cc:2243] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.815645 28250 raft_consensus.cc:2272] T 6a9be72518cf4c5bad8b2020486f02ce P 85ee38972e334d7ba7538250bfdec19b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.818704 28250 tablet_replica.cc:333] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.819252 28250 raft_consensus.cc:2243] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.819746 28250 raft_consensus.cc:2272] T dcd28d392a7b4f668776a745ef594569 P 85ee38972e334d7ba7538250bfdec19b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.821627 28250 tablet_replica.cc:333] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.822119 28250 raft_consensus.cc:2243] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.823087 28250 raft_consensus.cc:2272] T d486cc5d07ab48aea3790b59cb6f48b5 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.825124 28250 tablet_replica.cc:333] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.825644 28250 raft_consensus.cc:2243] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.826076 28250 raft_consensus.cc:2272] T 148528c259f04fd4b64bbf7e38774327 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.828118 28250 tablet_replica.cc:333] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b: stopping tablet replica
I20260709 13:11:34.828615 28250 raft_consensus.cc:2243] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.829423 28250 raft_consensus.cc:2272] T 31e902a609ca4579a2e1b8dbead0b256 P 85ee38972e334d7ba7538250bfdec19b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.853019 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
I20260709 13:11:34.877195 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
I20260709 13:11:34.908097 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:34.908921 28250 tablet_replica.cc:333] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.909993 28250 raft_consensus.cc:2243] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.911113 28250 raft_consensus.cc:2272] T 6a9be72518cf4c5bad8b2020486f02ce P 4e42f004f6154b9d8a7547f6e863e13f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.913447 28250 tablet_replica.cc:333] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.914007 28250 raft_consensus.cc:2243] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.914505 28250 raft_consensus.cc:2272] T 851f0ad59c694834a8ede67e35cf5955 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.916476 28250 tablet_replica.cc:333] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.917212 28250 raft_consensus.cc:2243] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.917635 28250 raft_consensus.cc:2272] T d486cc5d07ab48aea3790b59cb6f48b5 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.920049 28250 tablet_replica.cc:333] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.920821 28250 raft_consensus.cc:2243] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.921408 28250 raft_consensus.cc:2272] T 079b1306e7794bc19cc41dc2ed9a54bb P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.924384 28250 tablet_replica.cc:333] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.924875 28250 raft_consensus.cc:2243] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.925237 28250 raft_consensus.cc:2272] T 0e0356f8846b46f4a5f85908bf3b93e6 P 4e42f004f6154b9d8a7547f6e863e13f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.926927 28250 tablet_replica.cc:333] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.927416 28250 raft_consensus.cc:2243] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.928285 28250 raft_consensus.cc:2272] T c9a60dcc9f694553be44abaebf177f7e P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.929980 28250 tablet_replica.cc:333] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.930426 28250 raft_consensus.cc:2243] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.930891 28250 raft_consensus.cc:2272] T 31e902a609ca4579a2e1b8dbead0b256 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.933172 28250 tablet_replica.cc:333] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.933634 28250 raft_consensus.cc:2243] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.934552 28250 raft_consensus.cc:2272] T 148528c259f04fd4b64bbf7e38774327 P 4e42f004f6154b9d8a7547f6e863e13f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.936681 28250 tablet_replica.cc:333] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.937131 28250 raft_consensus.cc:2243] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.937472 28250 raft_consensus.cc:2272] T dcd28d392a7b4f668776a745ef594569 P 4e42f004f6154b9d8a7547f6e863e13f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.939265 28250 tablet_replica.cc:333] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f: stopping tablet replica
I20260709 13:11:34.939653 28250 raft_consensus.cc:2243] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.940006 28250 raft_consensus.cc:2272] T cf1d02ad8ef74d53b334f9cbcf07367b P 4e42f004f6154b9d8a7547f6e863e13f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.971207 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
I20260709 13:11:34.994146 28250 master.cc:562] Master@127.27.150.190:33825 shutting down...
I20260709 13:11:35.020900 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.021524 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.021845 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P bcf20b36deb84ec992181b1336169a0e: stopping tablet replica
I20260709 13:11:35.044526 28250 master.cc:584] Master@127.27.150.190:33825 shutdown complete.
4e42f004f6154b9d8a7547f6e863e13f  1
85ee38972e334d7ba7538250bfdec19b  4
e43647297d384b6db15886f0f9e25361  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12261 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:11:35.092839 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:35447
I20260709 13:11:35.094228 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:35.101086 29271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.101370 29270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.101423 29273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.102597 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:35.103552 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:35.103775 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:35.103965 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602695103930 us; error 0 us; skew 500 ppm
I20260709 13:11:35.104544 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:35.107254 28250 webserver.cc:533] Webserver started at http://127.27.150.190:41493/ using document root <none> and password file <none>
I20260709 13:11:35.107781 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:35.108016 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:35.108331 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:35.109617 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "41140e47adf040c7a76a599e7698358d"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.114573 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:11:35.118227 29278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.119071 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:35.119365 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "41140e47adf040c7a76a599e7698358d"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.119678 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:35.138466 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:35.140076 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:35.189360 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:35447
I20260709 13:11:35.189467 29329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:35447 every 8 connection(s)
I20260709 13:11:35.193984 29330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.205380 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Bootstrap starting.
I20260709 13:11:35.211153 29330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:35.216027 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: No bootstrap required, opened a new log
I20260709 13:11:35.218400 29330 raft_consensus.cc:359] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41140e47adf040c7a76a599e7698358d" member_type: VOTER }
I20260709 13:11:35.218921 29330 raft_consensus.cc:385] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:35.219106 29330 raft_consensus.cc:740] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41140e47adf040c7a76a599e7698358d, State: Initialized, Role: FOLLOWER
I20260709 13:11:35.219663 29330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41140e47adf040c7a76a599e7698358d" member_type: VOTER }
I20260709 13:11:35.220088 29330 raft_consensus.cc:399] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:35.220276 29330 raft_consensus.cc:493] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:35.220489 29330 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:35.225586 29330 raft_consensus.cc:515] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41140e47adf040c7a76a599e7698358d" member_type: VOTER }
I20260709 13:11:35.226083 29330 leader_election.cc:304] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41140e47adf040c7a76a599e7698358d; no voters: 
I20260709 13:11:35.227317 29330 leader_election.cc:290] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:35.227702 29333 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:35.229187 29333 raft_consensus.cc:697] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 1 LEADER]: Becoming Leader. State: Replica: 41140e47adf040c7a76a599e7698358d, State: Running, Role: LEADER
I20260709 13:11:35.229980 29333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41140e47adf040c7a76a599e7698358d" member_type: VOTER }
I20260709 13:11:35.230768 29330 sys_catalog.cc:565] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:35.235041 29334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41140e47adf040c7a76a599e7698358d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41140e47adf040c7a76a599e7698358d" member_type: VOTER } }
I20260709 13:11:35.235302 29335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41140e47adf040c7a76a599e7698358d. Latest consensus state: current_term: 1 leader_uuid: "41140e47adf040c7a76a599e7698358d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41140e47adf040c7a76a599e7698358d" member_type: VOTER } }
I20260709 13:11:35.235966 29335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:35.235937 29334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:35.242389 29341 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:35.251286 29341 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:35.252568 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:35.261550 29341 catalog_manager.cc:1383] Generated new cluster ID: 014f2311b83247b8816276ea0b3843e4
I20260709 13:11:35.261925 29341 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:35.279428 29341 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:35.281044 29341 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:35.298945 29341 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Generated new TSK 0
I20260709 13:11:35.299783 29341 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:35.319563 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:35.326573 29351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.327831 29352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.329900 29354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.330149 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:35.331278 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:35.331471 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:35.331604 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602695331592 us; error 0 us; skew 500 ppm
I20260709 13:11:35.332105 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:35.335094 28250 webserver.cc:533] Webserver started at http://127.27.150.129:44557/ using document root <none> and password file <none>
I20260709 13:11:35.335848 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:35.336074 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:35.336369 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:35.337620 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "88760af579b54a6393c6251aa3c6b870"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.342727 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:11:35.346336 29359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.347225 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:35.347550 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "88760af579b54a6393c6251aa3c6b870"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.347891 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:35.380857 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:35.382548 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:35.384402 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:35.387249 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:35.387511 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.387804 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:35.388015 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.438050 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:42027
I20260709 13:11:35.438213 29421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:42027 every 8 connection(s)
I20260709 13:11:35.444540 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:35.452618 29426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.453117 29427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.456256 28250 server_base.cc:1061] running on GCE node
W20260709 13:11:35.456686 29430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.457676 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:35.457921 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:35.458200 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602695458173 us; error 0 us; skew 500 ppm
I20260709 13:11:35.458871 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:35.461921 28250 webserver.cc:533] Webserver started at http://127.27.150.130:39423/ using document root <none> and password file <none>
I20260709 13:11:35.462391 29422 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35447
I20260709 13:11:35.462541 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:35.462875 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:35.462893 29422 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:35.463310 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:35.463917 29422 heartbeater.cc:507] Master 127.27.150.190:35447 requested a full tablet report, sending...
I20260709 13:11:35.464731 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.466511 29295 ts_manager.cc:194] Registered new tserver with Master: 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:11:35.469257 29295 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33534
I20260709 13:11:35.471335 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:11:35.475239 29434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.476104 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:11:35.476444 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.476779 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:35.494474 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:35.496299 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:35.498246 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:35.501246 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:35.501493 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.501827 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:35.502017 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.558509 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:39713
I20260709 13:11:35.558650 29496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:39713 every 8 connection(s)
I20260709 13:11:35.564150 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:35.573184 29500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:35.573532 29501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.578783 28250 server_base.cc:1061] running on GCE node
W20260709 13:11:35.579799 29503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:35.579964 29497 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35447
I20260709 13:11:35.580432 29497 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:35.581003 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:35.581261 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:35.581465 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602695581428 us; error 0 us; skew 500 ppm
I20260709 13:11:35.581419 29497 heartbeater.cc:507] Master 127.27.150.190:35447 requested a full tablet report, sending...
I20260709 13:11:35.582243 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:35.584316 29295 ts_manager.cc:194] Registered new tserver with Master: 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:35.585505 28250 webserver.cc:533] Webserver started at http://127.27.150.131:32791/ using document root <none> and password file <none>
I20260709 13:11:35.586227 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:35.586526 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:35.586472 29295 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33542
I20260709 13:11:35.587023 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:35.588835 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.594359 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:11:35.598421 29508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.599385 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:35.599737 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
format_stamp: "Formatted at 2026-07-09 13:11:35 on dist-test-slave-nvvq"
I20260709 13:11:35.600076 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:35.613831 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:35.615418 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:35.617063 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:35.619366 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:35.619599 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.619848 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:35.620026 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:35.669023 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:42971
I20260709 13:11:35.669145 29570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:42971 every 8 connection(s)
I20260709 13:11:35.685966 29571 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35447
I20260709 13:11:35.686483 29571 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:35.687326 29571 heartbeater.cc:507] Master 127.27.150.190:35447 requested a full tablet report, sending...
I20260709 13:11:35.689567 29295 ts_manager.cc:194] Registered new tserver with Master: 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:35.690657 28250 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018111456s
I20260709 13:11:35.691371 29295 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33552
I20260709 13:11:35.721499 29295 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33556:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:35.728665 29295 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:35.940621 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1f2ca19fef40e2aa07c8513a7bffbd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:35.943720 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9e543a8422407185dcc0cc54131e92 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:35.945431 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1f2ca19fef40e2aa07c8513a7bffbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.946427 29385 tablet_service.cc:1511] Processing CreateTablet for tablet 225e23ac0b4c490cb213c4d4945ec334 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:35.951339 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9e543a8422407185dcc0cc54131e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.952710 29382 tablet_service.cc:1511] Processing CreateTablet for tablet 6c21d46fd7a440b09555995fc5c75ad3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:35.954174 29382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c21d46fd7a440b09555995fc5c75ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.949146 29383 tablet_service.cc:1511] Processing CreateTablet for tablet 6a79c5f3852446bd956bcf002f2bd78c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:35.955983 29383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a79c5f3852446bd956bcf002f2bd78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.947851 29384 tablet_service.cc:1511] Processing CreateTablet for tablet 2068d180d9904ad9abf956769d9a2f1d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:35.959730 29384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2068d180d9904ad9abf956769d9a2f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.962926 29385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225e23ac0b4c490cb213c4d4945ec334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.975123 29381 tablet_service.cc:1511] Processing CreateTablet for tablet 930d24af7f0e45c19e80e2efaab717d7 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:35.976707 29381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930d24af7f0e45c19e80e2efaab717d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.989114 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1f2ca19fef40e2aa07c8513a7bffbd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:35.990869 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1f2ca19fef40e2aa07c8513a7bffbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.990777 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 2068d180d9904ad9abf956769d9a2f1d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:35.992395 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2068d180d9904ad9abf956769d9a2f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.993120 29535 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9e543a8422407185dcc0cc54131e92 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:35.994606 29535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9e543a8422407185dcc0cc54131e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.994771 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 36373f233812459591c31993a4959894 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:35.996416 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36373f233812459591c31993a4959894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.996658 29534 tablet_service.cc:1511] Processing CreateTablet for tablet 225e23ac0b4c490cb213c4d4945ec334 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:35.998049 29534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225e23ac0b4c490cb213c4d4945ec334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.003598 29532 tablet_service.cc:1511] Processing CreateTablet for tablet 6a79c5f3852446bd956bcf002f2bd78c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:36.005110 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a79c5f3852446bd956bcf002f2bd78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.009897 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 5afd3c3bb2df4807a6bdcea59110dee6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:36.011478 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5afd3c3bb2df4807a6bdcea59110dee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.016511 29531 tablet_service.cc:1511] Processing CreateTablet for tablet 6c21d46fd7a440b09555995fc5c75ad3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:36.018108 29531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c21d46fd7a440b09555995fc5c75ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.029858 29382 tablet_service.cc:1511] Processing CreateTablet for tablet cf141daac9d14f459ccbaeee8764a9e6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:36.031519 29382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf141daac9d14f459ccbaeee8764a9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.032527 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1f2ca19fef40e2aa07c8513a7bffbd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:36.034407 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1f2ca19fef40e2aa07c8513a7bffbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.044546 29461 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9e543a8422407185dcc0cc54131e92 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:36.045868 29586 tablet_bootstrap.cc:492] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:36.046187 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9e543a8422407185dcc0cc54131e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.052183 29460 tablet_service.cc:1511] Processing CreateTablet for tablet 225e23ac0b4c490cb213c4d4945ec334 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:36.053757 29460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225e23ac0b4c490cb213c4d4945ec334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.055739 29459 tablet_service.cc:1511] Processing CreateTablet for tablet 2068d180d9904ad9abf956769d9a2f1d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:36.057225 29459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2068d180d9904ad9abf956769d9a2f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.060053 29458 tablet_service.cc:1511] Processing CreateTablet for tablet 6a79c5f3852446bd956bcf002f2bd78c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:36.062006 29458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a79c5f3852446bd956bcf002f2bd78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.062907 29586 tablet_bootstrap.cc:654] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.063958 29457 tablet_service.cc:1511] Processing CreateTablet for tablet 6c21d46fd7a440b09555995fc5c75ad3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:36.067407 29456 tablet_service.cc:1511] Processing CreateTablet for tablet 930d24af7f0e45c19e80e2efaab717d7 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:36.070204 29383 tablet_service.cc:1511] Processing CreateTablet for tablet d01483a998944f4386fc5dfa1f0fd51a (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:36.071693 29455 tablet_service.cc:1511] Processing CreateTablet for tablet 36373f233812459591c31993a4959894 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:36.075831 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 5afd3c3bb2df4807a6bdcea59110dee6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:36.080096 29453 tablet_service.cc:1511] Processing CreateTablet for tablet cf141daac9d14f459ccbaeee8764a9e6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:36.084977 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 930d24af7f0e45c19e80e2efaab717d7 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:36.085847 29530 tablet_service.cc:1511] Processing CreateTablet for tablet 5afd3c3bb2df4807a6bdcea59110dee6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:36.086581 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930d24af7f0e45c19e80e2efaab717d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.087298 29530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5afd3c3bb2df4807a6bdcea59110dee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.087854 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 02ea2318003a42fea9088b490db583f1 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:36.091621 29534 tablet_service.cc:1511] Processing CreateTablet for tablet 36373f233812459591c31993a4959894 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:36.092175 29531 tablet_service.cc:1511] Processing CreateTablet for tablet cf141daac9d14f459ccbaeee8764a9e6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:36.092700 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5afd3c3bb2df4807a6bdcea59110dee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.093062 29534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36373f233812459591c31993a4959894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.093466 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930d24af7f0e45c19e80e2efaab717d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.093679 29531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf141daac9d14f459ccbaeee8764a9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.094146 29455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36373f233812459591c31993a4959894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.095331 29457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c21d46fd7a440b09555995fc5c75ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.096957 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf141daac9d14f459ccbaeee8764a9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.071689 29383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01483a998944f4386fc5dfa1f0fd51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.118688 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea2318003a42fea9088b490db583f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.127717 29532 tablet_service.cc:1511] Processing CreateTablet for tablet d01483a998944f4386fc5dfa1f0fd51a (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:36.129442 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01483a998944f4386fc5dfa1f0fd51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.140489 29589 tablet_bootstrap.cc:492] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:36.127725 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 2992ae50b9804afb8a7cfe63feb5bf34 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:36.143041 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2992ae50b9804afb8a7cfe63feb5bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.152098 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 02ea2318003a42fea9088b490db583f1 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:36.153885 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea2318003a42fea9088b490db583f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.152060 29462 tablet_service.cc:1511] Processing CreateTablet for tablet d01483a998944f4386fc5dfa1f0fd51a (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:36.156335 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01483a998944f4386fc5dfa1f0fd51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.190344 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 1f99e4a3e3c44d748842c65d1be7d08e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:36.193557 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f99e4a3e3c44d748842c65d1be7d08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.207523 29587 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:36.213236 29586 tablet_bootstrap.cc:492] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:36.216881 29586 ts_tablet_manager.cc:1403] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.171s	user 0.026s	sys 0.014s
I20260709 13:11:36.220335 29586 raft_consensus.cc:359] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.221122 29586 raft_consensus.cc:385] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.221422 29586 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.222298 29586 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.226402 29461 tablet_service.cc:1511] Processing CreateTablet for tablet 02ea2318003a42fea9088b490db583f1 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:36.228454 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea2318003a42fea9088b490db583f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.229171 29535 tablet_service.cc:1511] Processing CreateTablet for tablet 2992ae50b9804afb8a7cfe63feb5bf34 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:36.230594 29535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2992ae50b9804afb8a7cfe63feb5bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.231931 29529 tablet_service.cc:1511] Processing CreateTablet for tablet 1f99e4a3e3c44d748842c65d1be7d08e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:36.233883 29456 tablet_service.cc:1511] Processing CreateTablet for tablet 2992ae50b9804afb8a7cfe63feb5bf34 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:36.235250 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2992ae50b9804afb8a7cfe63feb5bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.238715 29528 tablet_service.cc:1511] Processing CreateTablet for tablet 3890858f888845ec958c83aa9b1ccf5d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:36.233752 29529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f99e4a3e3c44d748842c65d1be7d08e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:36.242898 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:36.243235 29528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3890858f888845ec958c83aa9b1ccf5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.244041 29589 tablet_bootstrap.cc:654] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.248452 29587 tablet_bootstrap.cc:654] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.254029 29382 tablet_service.cc:1511] Processing CreateTablet for tablet 59bfc5123acd4083b0f36af624300133 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:36.256052 29382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bfc5123acd4083b0f36af624300133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.256878 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 3890858f888845ec958c83aa9b1ccf5d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:36.258666 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3890858f888845ec958c83aa9b1ccf5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.269461 29422 heartbeater.cc:499] Master 127.27.150.190:35447 was elected leader, sending a full tablet report...
I20260709 13:11:36.272040 29457 tablet_service.cc:1511] Processing CreateTablet for tablet 1f99e4a3e3c44d748842c65d1be7d08e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:36.273633 29457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f99e4a3e3c44d748842c65d1be7d08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.276433 29381 tablet_service.cc:1511] Processing CreateTablet for tablet 5bfd9651b2124a8580054a3a43fff99d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:36.280407 29453 tablet_service.cc:1511] Processing CreateTablet for tablet 3890858f888845ec958c83aa9b1ccf5d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:36.281877 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3890858f888845ec958c83aa9b1ccf5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.293412 29384 tablet_service.cc:1511] Processing CreateTablet for tablet d03f148e37fd4109805d1d7b3b02b2fd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:36.294967 29384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03f148e37fd4109805d1d7b3b02b2fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.298161 29534 tablet_service.cc:1511] Processing CreateTablet for tablet 5bfd9651b2124a8580054a3a43fff99d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:36.311414 29534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfd9651b2124a8580054a3a43fff99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.304750 29381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfd9651b2124a8580054a3a43fff99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.304420 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 59bfc5123acd4083b0f36af624300133 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:36.316948 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bfc5123acd4083b0f36af624300133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.331409 29458 tablet_service.cc:1511] Processing CreateTablet for tablet d03f148e37fd4109805d1d7b3b02b2fd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:36.331518 29533 tablet_service.cc:1511] Processing CreateTablet for tablet d03f148e37fd4109805d1d7b3b02b2fd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:36.333282 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03f148e37fd4109805d1d7b3b02b2fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.335369 29458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03f148e37fd4109805d1d7b3b02b2fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.303015 29586 ts_tablet_manager.cc:1434] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.086s	user 0.022s	sys 0.026s
I20260709 13:11:36.339432 29586 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:36.309930 29460 tablet_service.cc:1511] Processing CreateTablet for tablet 59bfc5123acd4083b0f36af624300133 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:36.311220 29459 tablet_service.cc:1511] Processing CreateTablet for tablet 5bfd9651b2124a8580054a3a43fff99d (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:36.342358 29460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bfc5123acd4083b0f36af624300133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.343238 29459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfd9651b2124a8580054a3a43fff99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.372380 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6c0a7893ec49c19f3e702094ed4941 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:36.374157 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6c0a7893ec49c19f3e702094ed4941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.374744 29587 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:36.379026 29587 ts_tablet_manager.cc:1403] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.172s	user 0.020s	sys 0.006s
I20260709 13:11:36.382905 29587 raft_consensus.cc:359] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.388334 29589 tablet_bootstrap.cc:492] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:36.396112 29587 raft_consensus.cc:385] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.396656 29587 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.399222 29587 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.396293 29589 ts_tablet_manager.cc:1403] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.257s	user 0.014s	sys 0.007s
I20260709 13:11:36.421815 29455 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6c0a7893ec49c19f3e702094ed4941 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:36.423650 29383 tablet_service.cc:1511] Processing CreateTablet for tablet 0648129226444c81aef501f2bf17e434 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:36.424953 29383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0648129226444c81aef501f2bf17e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.430904 29571 heartbeater.cc:499] Master 127.27.150.190:35447 was elected leader, sending a full tablet report...
I20260709 13:11:36.433470 29589 raft_consensus.cc:359] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.436782 29531 tablet_service.cc:1511] Processing CreateTablet for tablet 0648129226444c81aef501f2bf17e434 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:36.437343 29457 tablet_service.cc:1511] Processing CreateTablet for tablet 0648129226444c81aef501f2bf17e434 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:36.439620 29589 raft_consensus.cc:385] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.448135 29587 ts_tablet_manager.cc:1434] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.069s	user 0.018s	sys 0.001s
I20260709 13:11:36.448380 29531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0648129226444c81aef501f2bf17e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.449361 29587 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:36.445057 29457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0648129226444c81aef501f2bf17e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.455498 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 04f141f7950d4a72a8aac7ed37a423fd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:36.455615 29380 tablet_service.cc:1511] Processing CreateTablet for tablet ef663d2174234a11995ce0c886e35150 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:36.456243 29587 tablet_bootstrap.cc:654] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.457114 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f141f7950d4a72a8aac7ed37a423fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.430817 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6c0a7893ec49c19f3e702094ed4941 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:36.459635 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6c0a7893ec49c19f3e702094ed4941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.447491 29589 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.462172 29586 tablet_bootstrap.cc:654] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.466861 29455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6c0a7893ec49c19f3e702094ed4941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.489886 29384 tablet_service.cc:1511] Processing CreateTablet for tablet 91c368d56c234a6ea4e13263c724dbda (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:36.464795 29382 tablet_service.cc:1511] Processing CreateTablet for tablet 57af445de910412cb7903ef2bf682013 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:36.491106 29589 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.483187 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef663d2174234a11995ce0c886e35150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.495229 29382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57af445de910412cb7903ef2bf682013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.499008 29384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c368d56c234a6ea4e13263c724dbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.499861 29462 tablet_service.cc:1511] Processing CreateTablet for tablet ef663d2174234a11995ce0c886e35150 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:36.501361 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef663d2174234a11995ce0c886e35150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.502828 29535 tablet_service.cc:1511] Processing CreateTablet for tablet ef663d2174234a11995ce0c886e35150 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:36.503065 29534 tablet_service.cc:1511] Processing CreateTablet for tablet 04f141f7950d4a72a8aac7ed37a423fd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:36.503535 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 04f141f7950d4a72a8aac7ed37a423fd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:36.504305 29535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef663d2174234a11995ce0c886e35150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.505759 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 57af445de910412cb7903ef2bf682013 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:36.507125 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57af445de910412cb7903ef2bf682013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.510970 29534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f141f7950d4a72a8aac7ed37a423fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.518882 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f141f7950d4a72a8aac7ed37a423fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.540472 29497 heartbeater.cc:499] Master 127.27.150.190:35447 was elected leader, sending a full tablet report...
I20260709 13:11:36.549865 29589 ts_tablet_manager.cc:1434] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.008s
I20260709 13:11:36.551254 29589 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:36.556353 29456 tablet_service.cc:1511] Processing CreateTablet for tablet 57af445de910412cb7903ef2bf682013 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:36.558061 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57af445de910412cb7903ef2bf682013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.576064 29589 tablet_bootstrap.cc:654] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.588260 29586 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:36.588929 29586 ts_tablet_manager.cc:1403] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.250s	user 0.035s	sys 0.050s
I20260709 13:11:36.591143 29587 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:36.604863 29587 ts_tablet_manager.cc:1403] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.156s	user 0.006s	sys 0.013s
I20260709 13:11:36.592507 29586 raft_consensus.cc:359] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.611135 29586 raft_consensus.cc:385] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.611698 29586 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.613015 29586 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.618850 29535 tablet_service.cc:1511] Processing CreateTablet for tablet 91c368d56c234a6ea4e13263c724dbda (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:36.620311 29535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c368d56c234a6ea4e13263c724dbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.621817 29586 ts_tablet_manager.cc:1434] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.003s
I20260709 13:11:36.630276 29586 tablet_bootstrap.cc:492] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:36.625950 29529 tablet_service.cc:1511] Processing CreateTablet for tablet 22f2621d025741fcb1f7e73ad1af2f4f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:36.635277 29529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f2621d025741fcb1f7e73ad1af2f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.618175 29587 raft_consensus.cc:359] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.618630 29458 tablet_service.cc:1511] Processing CreateTablet for tablet 91c368d56c234a6ea4e13263c724dbda (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:36.627612 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 1016126be7f841c4acc0cd897e5df0c3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:36.643168 29587 raft_consensus.cc:385] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.643563 29587 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.644331 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1016126be7f841c4acc0cd897e5df0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.644428 29587 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.622941 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 22f2621d025741fcb1f7e73ad1af2f4f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:36.651454 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f2621d025741fcb1f7e73ad1af2f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.633441 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 1016126be7f841c4acc0cd897e5df0c3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:36.654475 29589 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:36.628362 29455 tablet_service.cc:1511] Processing CreateTablet for tablet 22f2621d025741fcb1f7e73ad1af2f4f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:36.655056 29589 ts_tablet_manager.cc:1403] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.104s	user 0.026s	sys 0.017s
I20260709 13:11:36.658643 29589 raft_consensus.cc:359] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.659473 29589 raft_consensus.cc:385] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.659792 29589 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.651650 29531 tablet_service.cc:1511] Processing CreateTablet for tablet 1016126be7f841c4acc0cd897e5df0c3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:36.652380 29587 ts_tablet_manager.cc:1434] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.004s
I20260709 13:11:36.652604 29458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c368d56c234a6ea4e13263c724dbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.667482 29587 tablet_bootstrap.cc:492] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:36.668152 29531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1016126be7f841c4acc0cd897e5df0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.675534 29587 tablet_bootstrap.cc:654] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.679158 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 1a6fe7feab0c45ddb9198327b19a5bc5 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:36.680338 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1016126be7f841c4acc0cd897e5df0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.680714 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6fe7feab0c45ddb9198327b19a5bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.681164 29455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f2621d025741fcb1f7e73ad1af2f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.682816 29589 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.687198 29586 tablet_bootstrap.cc:654] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.687484 29589 ts_tablet_manager.cc:1434] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:11:36.714596 29533 tablet_service.cc:1511] Processing CreateTablet for tablet bd61183c8c5845d289dedeb85f533fa0 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:36.715706 29589 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:36.716068 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd61183c8c5845d289dedeb85f533fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.690351 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 1a6fe7feab0c45ddb9198327b19a5bc5 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:36.698693 29456 tablet_service.cc:1511] Processing CreateTablet for tablet 1a6fe7feab0c45ddb9198327b19a5bc5 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:36.720942 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6fe7feab0c45ddb9198327b19a5bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.703388 29590 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.722812 29590 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.706625 29383 tablet_service.cc:1511] Processing CreateTablet for tablet bd61183c8c5845d289dedeb85f533fa0 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:36.724956 29383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd61183c8c5845d289dedeb85f533fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.709067 29453 tablet_service.cc:1511] Processing CreateTablet for tablet bd61183c8c5845d289dedeb85f533fa0 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:36.728693 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd61183c8c5845d289dedeb85f533fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.733721 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6fe7feab0c45ddb9198327b19a5bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.750348 29587 tablet_bootstrap.cc:492] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:36.751051 29587 ts_tablet_manager.cc:1403] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.025s
I20260709 13:11:36.754598 29587 raft_consensus.cc:359] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.755576 29587 raft_consensus.cc:385] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:36.755942 29587 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:36.772346 29587 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.785712 29384 tablet_service.cc:1511] Processing CreateTablet for tablet 0585fb6756aa496392b1ee0371aa9804 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:36.790364 29384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0585fb6756aa496392b1ee0371aa9804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.808576 29593 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.817662 29529 tablet_service.cc:1511] Processing CreateTablet for tablet 0585fb6756aa496392b1ee0371aa9804 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:36.819396 29529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0585fb6756aa496392b1ee0371aa9804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.826037 29587 ts_tablet_manager.cc:1434] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.014s
I20260709 13:11:36.811815 29593 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.827663 29587 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:36.829066 29593 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:36.813112 29590 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:36.839995 29595 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.840605 29595 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.841876 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3e26705f6f42428e0c9830d7dbedb6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:36.847940 29593 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.848536 29593 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.850811 29593 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:36.868028 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3e26705f6f42428e0c9830d7dbedb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.875257 29589 tablet_bootstrap.cc:654] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:36.887964 29458 tablet_service.cc:1511] Processing CreateTablet for tablet 0585fb6756aa496392b1ee0371aa9804 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:36.889580 29458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0585fb6756aa496392b1ee0371aa9804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.894176 29384 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3e26705f6f42428e0c9830d7dbedb6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:36.895704 29384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3e26705f6f42428e0c9830d7dbedb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.896338 29586 tablet_bootstrap.cc:492] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:36.896893 29586 ts_tablet_manager.cc:1403] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.267s	user 0.016s	sys 0.024s
I20260709 13:11:36.914915 29529 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3e26705f6f42428e0c9830d7dbedb6 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:36.916415 29529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3e26705f6f42428e0c9830d7dbedb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.916275 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 184cb00180cf42c7b6803577c868b1dd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:36.917711 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184cb00180cf42c7b6803577c868b1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.920948 29595 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:36.921561 29595 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.929250 29455 tablet_service.cc:1511] Processing CreateTablet for tablet 184cb00180cf42c7b6803577c868b1dd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:36.929621 29461 tablet_service.cc:1511] Processing CreateTablet for tablet 8b624c2ca9f340c787fc611feea71f37 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:36.954859 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 184cb00180cf42c7b6803577c868b1dd (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:36.956538 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184cb00180cf42c7b6803577c868b1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.924450 29595 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:36.962411 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b624c2ca9f340c787fc611feea71f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.932889 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0e544e6ea1421bb32b24408af01b22 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:37.001039 29586 raft_consensus.cc:359] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.001946 29586 raft_consensus.cc:385] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.002060 29534 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0e544e6ea1421bb32b24408af01b22 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:37.003561 29534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0e544e6ea1421bb32b24408af01b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.008275 29459 tablet_service.cc:1511] Processing CreateTablet for tablet 1820d3fb534c4bbeb79d583637982dfb (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:36.983386 29457 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa3c8fa6cf741bdafed124439764c9c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:37.015944 29531 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa3c8fa6cf741bdafed124439764c9c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:37.016388 29532 tablet_service.cc:1511] Processing CreateTablet for tablet 1820d3fb534c4bbeb79d583637982dfb (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:37.017449 29531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa3c8fa6cf741bdafed124439764c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.018759 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 8b624c2ca9f340c787fc611feea71f37 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:37.020110 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b624c2ca9f340c787fc611feea71f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.022547 29528 tablet_service.cc:1511] Processing CreateTablet for tablet 495c8d0b86f84e95b022820009da4795 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:37.023921 29528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495c8d0b86f84e95b022820009da4795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.023790 29527 tablet_service.cc:1511] Processing CreateTablet for tablet 71fb5043e48f4e1a86ec8d962d18b0b4 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:37.017073 29530 tablet_service.cc:1511] Processing CreateTablet for tablet 29e2fd913c0b414a81386c129004967f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:37.027752 29527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fb5043e48f4e1a86ec8d962d18b0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.036299 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 0d0e544e6ea1421bb32b24408af01b22 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:37.036525 29382 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa3c8fa6cf741bdafed124439764c9c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:37.037542 29385 tablet_service.cc:1511] Processing CreateTablet for tablet 29e2fd913c0b414a81386c129004967f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:37.038498 29381 tablet_service.cc:1511] Processing CreateTablet for tablet 495c8d0b86f84e95b022820009da4795 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:37.039533 29378 tablet_service.cc:1511] Processing CreateTablet for tablet 71fb5043e48f4e1a86ec8d962d18b0b4 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:37.039757 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 1820d3fb534c4bbeb79d583637982dfb (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:37.042665 29589 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:37.043187 29587 tablet_bootstrap.cc:654] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.002321 29586 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.056366 29455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184cb00180cf42c7b6803577c868b1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.075354 29460 tablet_service.cc:1511] Processing CreateTablet for tablet 495c8d0b86f84e95b022820009da4795 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:37.075791 29456 tablet_service.cc:1511] Processing CreateTablet for tablet 29e2fd913c0b414a81386c129004967f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:37.079449 29593 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.080090 29593 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.081254 29586 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.083261 29595 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:37.086938 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1820d3fb534c4bbeb79d583637982dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.069710 29589 ts_tablet_manager.cc:1403] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.354s	user 0.018s	sys 0.024s
I20260709 13:11:37.082916 29535 tablet_service.cc:1511] Processing CreateTablet for tablet 8b624c2ca9f340c787fc611feea71f37 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:37.093768 29589 raft_consensus.cc:359] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.108341 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e2fd913c0b414a81386c129004967f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.109473 29457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa3c8fa6cf741bdafed124439764c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.109947 29530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e2fd913c0b414a81386c129004967f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.113421 29535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b624c2ca9f340c787fc611feea71f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.114794 29383 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8fc42a067a41aa89e5d120919426e3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:37.119822 29459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1820d3fb534c4bbeb79d583637982dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.122114 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:37.123208 29472 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:37.124969 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:37.125981 29590 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.126415 29590 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.126792 29590 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.104418 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0e544e6ea1421bb32b24408af01b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.131162 29382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa3c8fa6cf741bdafed124439764c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.082345 29593 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:37.148180 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d0e544e6ea1421bb32b24408af01b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.125918 29586 ts_tablet_manager.cc:1434] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.229s	user 0.010s	sys 0.001s
I20260709 13:11:37.185308 29384 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6296aca66540dc81b696ae74a6fd42 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:37.100957 29589 raft_consensus.cc:385] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.140285 29381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495c8d0b86f84e95b022820009da4795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.192431 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:37.193210 29544 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:37.194583 29460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495c8d0b86f84e95b022820009da4795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.118274 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:37.153493 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:37.197438 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.197326 29546 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:37.143354 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:37.199106 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:37.142652 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:37.199272 29590 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.199992 29471 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:37.154152 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:37.201444 29545 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:37.201589 29512 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:37.148190 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:37.203264 29438 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:37.199322 29470 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:37.204388 29606 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.204799 29606 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.205140 29606 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.205295 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:37.206055 29471 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.206559 29590 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:37.207213 29590 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.207710 29590 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:37.214844 29512 leader_election.cc:343] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.219679 29512 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:37.219843 29590 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:37.190999 29589 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.233265 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fb5043e48f4e1a86ec8d962d18b0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.208957 29531 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8fc42a067a41aa89e5d120919426e3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:37.239724 29531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8fc42a067a41aa89e5d120919426e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.217747 29593 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.242669 29593 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.242822 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:37.247118 29363 leader_election.cc:343] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.242821 29385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e2fd913c0b414a81386c129004967f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:37.247534 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:37.250295 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1820d3fb534c4bbeb79d583637982dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.252292 29593 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.258765 29529 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6296aca66540dc81b696ae74a6fd42 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:37.260334 29529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6296aca66540dc81b696ae74a6fd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.260850 29587 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:37.261437 29587 ts_tablet_manager.cc:1403] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.434s	user 0.037s	sys 0.054s
I20260709 13:11:37.275413 29587 raft_consensus.cc:359] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.275970 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:37.276362 29587 raft_consensus.cc:385] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.276626 29545 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.276827 29587 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.278504 29383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8fc42a067a41aa89e5d120919426e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.279371 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:37.280843 29363 leader_election.cc:343] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.281337 29363 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:37.282335 29615 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.283393 29378 tablet_service.cc:1511] Processing CreateTablet for tablet cbc3743d348b41f48617d0cb35c85353 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:37.284799 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc3743d348b41f48617d0cb35c85353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.288951 29545 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:37.290288 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:37.291159 29615 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:37.291500 29384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6296aca66540dc81b696ae74a6fd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.291673 29615 raft_consensus.cc:697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:37.292647 29615 consensus_queue.cc:237] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.139523 29453 tablet_service.cc:1511] Processing CreateTablet for tablet 71fb5043e48f4e1a86ec8d962d18b0b4 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:37.294564 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fb5043e48f4e1a86ec8d962d18b0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.304347 29528 tablet_service.cc:1511] Processing CreateTablet for tablet bc1ed542cbc3498ba13b3fe1f50b5d22 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:37.305570 29587 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.312362 29586 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:37.307655 29593 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.320086 29535 tablet_service.cc:1511] Processing CreateTablet for tablet cbc3743d348b41f48617d0cb35c85353 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:37.325997 29593 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:37.325874 29589 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.306365 29528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc1ed542cbc3498ba13b3fe1f50b5d22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:37.323249 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 103675us
I20260709 13:11:37.323614 29606 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.330372 29527 tablet_service.cc:1511] Processing CreateTablet for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:37.338064 29606 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:37.339900 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:37.362850 29470 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:37.366137 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8fc42a067a41aa89e5d120919426e3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:37.367683 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8fc42a067a41aa89e5d120919426e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.342916 29378 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:37.359687 29386 tablet_service.cc:1511] Processing CreateTablet for tablet bc1ed542cbc3498ba13b3fe1f50b5d22 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:37.361469 29586 tablet_bootstrap.cc:654] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.369925 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.379845 29459 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6296aca66540dc81b696ae74a6fd42 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:37.381319 29459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6296aca66540dc81b696ae74a6fd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.380956 29461 tablet_service.cc:1511] Processing CreateTablet for tablet bc1ed542cbc3498ba13b3fe1f50b5d22 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:37.386886 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc1ed542cbc3498ba13b3fe1f50b5d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.397500 29457 tablet_service.cc:1511] Processing CreateTablet for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:37.399050 29457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.407501 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.409922 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:37.370901 29593 raft_consensus.cc:2764] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:11:37.418347 29435 leader_election.cc:343] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.420987 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:37.430815 29530 tablet_service.cc:1511] Processing CreateTablet for tablet 133108182cae493ab908290bfa9179d1 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:37.434832 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 48cbba4289f149fa85b4f656897b6390 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:37.436972 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.426218 29535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc3743d348b41f48617d0cb35c85353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.424544 29545 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:37.411499 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:37.444342 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc1ed542cbc3498ba13b3fe1f50b5d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.446709 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.448318 29532 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6fccf47ee14532860e20ec4b983155 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:37.442817 29295 catalog_manager.cc:5697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.450690 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.457707 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.463044 29530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133108182cae493ab908290bfa9179d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.463749 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cbba4289f149fa85b4f656897b6390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.463872 29587 ts_tablet_manager.cc:1434] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.202s	user 0.013s	sys 0.025s
I20260709 13:11:37.463660 29382 tablet_service.cc:1511] Processing CreateTablet for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:37.464555 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6fccf47ee14532860e20ec4b983155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.465107 29587 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:37.467567 29527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.467989 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 48cbba4289f149fa85b4f656897b6390 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:37.469306 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cbba4289f149fa85b4f656897b6390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.471138 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 268b94ce95ed4e5abc8be97084461e57 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:37.473591 29619 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.474270 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268b94ce95ed4e5abc8be97084461e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.474169 29619 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:37.476423 29509 leader_election.cc:343] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.476930 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:37.481611 29615 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.482103 29615 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:37.486070 29509 leader_election.cc:343] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.480011 29593 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:37.474983 29435 leader_election.cc:343] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:37.495791 29509 leader_election.cc:343] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.496294 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:37.490187 29438 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:37.497372 29606 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.497800 29593 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.497885 29606 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.498157 29534 tablet_service.cc:1511] Processing CreateTablet for tablet 61f7f02fdc8243cd8806a09e7908831e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:37.486316 29615 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:37.477774 29385 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6fccf47ee14532860e20ec4b983155 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:37.494374 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:37.494901 29382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.499945 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:37.501149 29363 leader_election.cc:343] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.495028 29589 ts_tablet_manager.cc:1434] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.404s	user 0.017s	sys 0.024s
W20260709 13:11:37.501979 29363 leader_election.cc:343] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.502408 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:37.504142 29606 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:37.504683 29606 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.505523 29589 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:37.466158 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 133108182cae493ab908290bfa9179d1 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:37.499632 29534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f7f02fdc8243cd8806a09e7908831e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.518805 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:37.519811 29619 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:37.520448 29438 leader_election.cc:343] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.521574 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:37.521672 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 133108182cae493ab908290bfa9179d1 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:11:37.523320 29512 leader_election.cc:343] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.526571 29455 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:37.511564 29615 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.509897 29587 tablet_bootstrap.cc:654] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.534273 29529 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7e9523dd804c659b1f0d34ac3eefb3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:37.535784 29529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7e9523dd804c659b1f0d34ac3eefb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.535576 29456 tablet_service.cc:1511] Processing CreateTablet for tablet cbc3743d348b41f48617d0cb35c85353 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:37.513756 29471 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:37.542969 29595 raft_consensus.cc:2764] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:37.551275 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.551936 29385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6fccf47ee14532860e20ec4b983155. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:37.553272 29435 leader_election.cc:343] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.552750 29528 tablet_service.cc:1511] Processing CreateTablet for tablet 29153e3fc529491aa91c830a4456d35a (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:37.553821 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133108182cae493ab908290bfa9179d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.553793 29435 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:37.555307 29528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29153e3fc529491aa91c830a4456d35a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.555308 29595 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.557493 29458 tablet_service.cc:1511] Processing CreateTablet for tablet 48cbba4289f149fa85b4f656897b6390 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:37.579398 29455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.591652 29453 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6fccf47ee14532860e20ec4b983155 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:37.593600 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.599169 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133108182cae493ab908290bfa9179d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.612733 29586 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:37.587188 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1e2c054c694186bc648342e40f4d3b (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:37.613334 29586 ts_tablet_manager.cc:1403] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.369s	user 0.012s	sys 0.007s
I20260709 13:11:37.619174 29460 tablet_service.cc:1511] Processing CreateTablet for tablet 268b94ce95ed4e5abc8be97084461e57 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:11:37.605409 29509 leader_election.cc:343] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:37.622455 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:37.614029 29589 tablet_bootstrap.cc:654] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.622622 29586 raft_consensus.cc:359] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.623651 29586 raft_consensus.cc:385] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.624042 29586 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.625048 29586 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.626405 29619 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:37.628029 29381 tablet_service.cc:1511] Processing CreateTablet for tablet 61f7f02fdc8243cd8806a09e7908831e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:37.626794 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e2c054c694186bc648342e40f4d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.629429 29381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f7f02fdc8243cd8806a09e7908831e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.630424 29586 ts_tablet_manager.cc:1434] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:11:37.638065 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 268b94ce95ed4e5abc8be97084461e57 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:37.635285 29379 tablet_service.cc:1511] Processing CreateTablet for tablet a6194a4e996b4050bfb519664b72df1c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:37.639686 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268b94ce95ed4e5abc8be97084461e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.640662 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6194a4e996b4050bfb519664b72df1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.642387 29587 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:37.646256 29587 ts_tablet_manager.cc:1403] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.002s
I20260709 13:11:37.646672 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc3743d348b41f48617d0cb35c85353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.642731 29528 tablet_service.cc:1511] Processing CreateTablet for tablet 38fdcb033993416ca10b3d79544c9d59 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:37.639710 29586 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:37.661692 29382 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7e9523dd804c659b1f0d34ac3eefb3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:37.667147 29528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38fdcb033993416ca10b3d79544c9d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.667049 29587 raft_consensus.cc:359] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.600178 29530 tablet_service.cc:1511] Processing CreateTablet for tablet a6194a4e996b4050bfb519664b72df1c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:11:37.681803 29282 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47194.3us
I20260709 13:11:37.683660 29459 tablet_service.cc:1511] Processing CreateTablet for tablet 61f7f02fdc8243cd8806a09e7908831e (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:37.678853 29587 raft_consensus.cc:385] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.686417 29587 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.676962 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6fccf47ee14532860e20ec4b983155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.690421 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 4a320582e5c548dd888eb981df817079 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:37.679910 29382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7e9523dd804c659b1f0d34ac3eefb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.702615 29530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6194a4e996b4050bfb519664b72df1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:37.702991 29279 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52961.3us
I20260709 13:11:37.704836 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a320582e5c548dd888eb981df817079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.713826 29589 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:37.718866 29380 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1e2c054c694186bc648342e40f4d3b (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:37.720985 29380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e2c054c694186bc648342e40f4d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.721890 29589 ts_tablet_manager.cc:1403] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.217s	user 0.018s	sys 0.009s
I20260709 13:11:37.727932 29527 tablet_service.cc:1511] Processing CreateTablet for tablet cb7c51305cb0421f843fcf7f543b7163 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:37.729643 29527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7c51305cb0421f843fcf7f543b7163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.733445 29457 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1e2c054c694186bc648342e40f4d3b (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:37.751227 29589 raft_consensus.cc:359] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.752146 29589 raft_consensus.cc:385] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.752485 29589 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.753319 29384 tablet_service.cc:1511] Processing CreateTablet for tablet 29153e3fc529491aa91c830a4456d35a (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:37.753491 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 77e08f37d90645918ef0bee732dd4b98 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:37.771963 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 38fdcb033993416ca10b3d79544c9d59 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:37.774130 29586 tablet_bootstrap.cc:654] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.774652 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e08f37d90645918ef0bee732dd4b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.774812 29589 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.775861 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38fdcb033993416ca10b3d79544c9d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.768326 29587 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.783984 29589 ts_tablet_manager.cc:1434] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 13:11:37.785418 29587 ts_tablet_manager.cc:1434] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.139s	user 0.003s	sys 0.004s
I20260709 13:11:37.789198 29378 tablet_service.cc:1511] Processing CreateTablet for tablet cb7c51305cb0421f843fcf7f543b7163 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:37.790656 29589 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:37.768976 29458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cbba4289f149fa85b4f656897b6390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.799000 29615 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.805384 29619 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.812700 29460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268b94ce95ed4e5abc8be97084461e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.811308 29619 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.815726 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.816475 29393 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:37.818152 29619 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:37.818933 29459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f7f02fdc8243cd8806a09e7908831e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.819125 29509 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:37.820158 29619 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.820576 29619 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.820935 29619 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.821846 29587 tablet_bootstrap.cc:492] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:37.823336 29533 tablet_service.cc:1511] Processing CreateTablet for tablet 1aeb2ba78c7749cb983fda41498f1bea (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:37.824283 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:37.825752 29595 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.834913 29595 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.837313 29595 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:37.838486 29470 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:37.838768 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:37.838951 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:37.839596 29393 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:37.827250 29457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e2c054c694186bc648342e40f4d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.811049 29384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29153e3fc529491aa91c830a4456d35a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.833391 29385 tablet_service.cc:1511] Processing CreateTablet for tablet c40cc430e0bf4a5f946bc53291d0b771 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:37.841653 29533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aeb2ba78c7749cb983fda41498f1bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.841969 29379 tablet_service.cc:1511] Processing CreateTablet for tablet 77e08f37d90645918ef0bee732dd4b98 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:37.873677 29379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e08f37d90645918ef0bee732dd4b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.848465 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 1aeb2ba78c7749cb983fda41498f1bea (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:37.851981 29383 tablet_service.cc:1511] Processing CreateTablet for tablet 4a320582e5c548dd888eb981df817079 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:37.852910 29615 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:37.846772 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:37.854247 29461 tablet_service.cc:1511] Processing CreateTablet for tablet a6194a4e996b4050bfb519664b72df1c (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:37.855417 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7e9523dd804c659b1f0d34ac3eefb3 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:37.858475 29619 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.870033 29587 tablet_bootstrap.cc:654] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:37.887377 29378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7c51305cb0421f843fcf7f543b7163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.887643 29619 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:37.895689 29545 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:37.892163 29595 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:37.900317 29595 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.900815 29595 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.902688 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7e9523dd804c659b1f0d34ac3eefb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.904773 29586 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:37.905308 29586 ts_tablet_manager.cc:1403] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.266s	user 0.013s	sys 0.006s
I20260709 13:11:37.905507 29589 tablet_bootstrap.cc:654] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:37.890615 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 43959.3us
I20260709 13:11:37.906672 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:37.908463 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6194a4e996b4050bfb519664b72df1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.912016 29455 tablet_service.cc:1511] Processing CreateTablet for tablet 29153e3fc529491aa91c830a4456d35a (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:37.914042 29455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29153e3fc529491aa91c830a4456d35a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.918893 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:37.919613 29393 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:37.927474 29385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40cc430e0bf4a5f946bc53291d0b771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.928167 29532 tablet_service.cc:1511] Processing CreateTablet for tablet c40cc430e0bf4a5f946bc53291d0b771 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:37.929649 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40cc430e0bf4a5f946bc53291d0b771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.932386 29383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a320582e5c548dd888eb981df817079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.940083 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 38fdcb033993416ca10b3d79544c9d59 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:37.943873 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aeb2ba78c7749cb983fda41498f1bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.970155 29586 raft_consensus.cc:359] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.971464 29586 raft_consensus.cc:385] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:37.971937 29586 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:37.973317 29586 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:37.983489 29460 tablet_service.cc:1511] Processing CreateTablet for tablet 77e08f37d90645918ef0bee732dd4b98 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:37.993813 29453 tablet_service.cc:1511] Processing CreateTablet for tablet cb7c51305cb0421f843fcf7f543b7163 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:37.994093 29456 tablet_service.cc:1511] Processing CreateTablet for tablet 4a320582e5c548dd888eb981df817079 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:37.998692 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38fdcb033993416ca10b3d79544c9d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.008924 29459 tablet_service.cc:1511] Processing CreateTablet for tablet c40cc430e0bf4a5f946bc53291d0b771 (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:38.012225 29595 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.041561 29393 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:38.043351 29509 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:38.044391 29619 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.046913 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7c51305cb0421f843fcf7f543b7163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.048377 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a320582e5c548dd888eb981df817079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.049841 29454 tablet_service.cc:1511] Processing CreateTablet for tablet 1aeb2ba78c7749cb983fda41498f1bea (DEFAULT_TABLE table=test-workload [id=5433e180200445a58200b950e8ca4a4b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:38.051308 29460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e08f37d90645918ef0bee732dd4b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.073418 29619 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:38.075114 29470 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:38.080929 29595 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.088196 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:38.088622 29459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40cc430e0bf4a5f946bc53291d0b771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.093554 29454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aeb2ba78c7749cb983fda41498f1bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.101866 29587 tablet_bootstrap.cc:492] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:38.102764 29587 ts_tablet_manager.cc:1403] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.281s	user 0.050s	sys 0.063s
I20260709 13:11:38.130539 29631 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.131315 29631 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.107502 29619 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.139823 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:38.140602 29393 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:38.141695 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:38.144851 29595 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.147198 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.148604 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.149344 29546 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
W20260709 13:11:38.150027 29628 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:11:38.150811 29363 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:38.151880 29615 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.152300 29615 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.152679 29615 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.155704 29631 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.156401 29589 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.156946 29589 ts_tablet_manager.cc:1403] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.368s	user 0.009s	sys 0.013s
I20260709 13:11:38.160401 29589 raft_consensus.cc:359] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.161371 29589 raft_consensus.cc:385] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.161727 29589 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.183406 29294 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.194327 29586 ts_tablet_manager.cc:1434] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.289s	user 0.036s	sys 0.016s
I20260709 13:11:38.196580 29586 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.187845 29589 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:38.187278 29363 leader_election.cc:343] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.206840 29595 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.180128 29615 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.221786 29615 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.217335 29595 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.174278 29587 raft_consensus.cc:359] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.230778 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:38.231982 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:38.232668 29546 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.234495 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.235653 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:38.236670 29363 leader_election.cc:343] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:38.237128 29435 leader_election.cc:343] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:38.238297 29438 leader_election.cc:343] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.238821 29589 ts_tablet_manager.cc:1434] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.082s	user 0.017s	sys 0.009s
I20260709 13:11:38.238786 29438 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:38.229199 29587 raft_consensus.cc:385] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.240322 29587 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.240751 29595 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.242252 29595 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.242935 29587 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.245227 29586 tablet_bootstrap.cc:654] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.251739 29546 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:38.252648 29587 ts_tablet_manager.cc:1434] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.145s	user 0.006s	sys 0.004s
W20260709 13:11:38.254526 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:38.255391 29589 tablet_bootstrap.cc:492] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:38.256780 29363 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:38.258294 29615 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.259342 29633 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.258852 29615 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:38.260027 29633 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.261224 29615 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.263072 29633 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.264281 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.265002 29471 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:38.268399 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:38.270084 29363 leader_election.cc:343] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.270979 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:38.271961 29633 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.272464 29633 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.272909 29633 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.275656 29587 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.271386 29589 tablet_bootstrap.cc:654] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.285476 29633 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.298163 29587 tablet_bootstrap.cc:654] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.300119 29295 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.301842 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:38.302726 29471 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.312608 29471 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:38.314154 29587 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:38.314833 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:38.315868 29615 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.316398 29615 raft_consensus.cc:697] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:38.317310 29615 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.318260 29633 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.319093 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:11:38.320777 29363 leader_election.cc:343] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:38.325996 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 87756.4us
I20260709 13:11:38.326418 29589 tablet_bootstrap.cc:492] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.327562 29589 ts_tablet_manager.cc:1403] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.000s
I20260709 13:11:38.332286 29589 raft_consensus.cc:359] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.333382 29589 raft_consensus.cc:385] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.333832 29589 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.334817 29589 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.314806 29587 ts_tablet_manager.cc:1403] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.003s
I20260709 13:11:38.339198 29586 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.339758 29586 ts_tablet_manager.cc:1403] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.143s	user 0.038s	sys 0.048s
I20260709 13:11:38.340965 29294 catalog_manager.cc:5697] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.341863 29587 raft_consensus.cc:359] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.342749 29587 raft_consensus.cc:385] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.343138 29587 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.343238 29586 raft_consensus.cc:359] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.344020 29586 raft_consensus.cc:385] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.344377 29586 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.344161 29587 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.345379 29586 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.347076 29587 ts_tablet_manager.cc:1434] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:38.347182 29589 ts_tablet_manager.cc:1434] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:11:38.348029 29586 ts_tablet_manager.cc:1434] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:38.348573 29587 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.349099 29586 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.356463 29587 tablet_bootstrap.cc:654] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.356475 29586 tablet_bootstrap.cc:654] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.356519 29589 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:38.367491 29589 tablet_bootstrap.cc:654] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.375996 29586 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.376683 29586 ts_tablet_manager.cc:1403] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
I20260709 13:11:38.377055 29641 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.377691 29641 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.380411 29586 raft_consensus.cc:359] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.381274 29586 raft_consensus.cc:385] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.381624 29586 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.382714 29586 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.383858 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.384155 29641 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.385792 29586 ts_tablet_manager.cc:1434] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:11:38.384591 29393 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:38.385733 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.387328 29546 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:38.387907 29586 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.388152 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:38.389521 29587 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:38.389477 29641 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.390126 29587 ts_tablet_manager.cc:1403] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.007s
I20260709 13:11:38.390815 29589 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.392189 29589 ts_tablet_manager.cc:1403] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.005s
I20260709 13:11:38.395098 29587 raft_consensus.cc:359] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.390072 29641 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.395880 29587 raft_consensus.cc:385] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.396337 29641 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.396485 29587 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.396613 29586 tablet_bootstrap.cc:654] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.397563 29587 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.399873 29587 ts_tablet_manager.cc:1434] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:11:38.400219 29589 raft_consensus.cc:359] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.401134 29589 raft_consensus.cc:385] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.401477 29589 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.402522 29589 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.404995 29589 ts_tablet_manager.cc:1434] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:38.406095 29589 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:38.407640 29641 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.409970 29586 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.410528 29586 ts_tablet_manager.cc:1403] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:11:38.410953 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:38.411377 29587 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.411643 29393 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.413779 29586 raft_consensus.cc:359] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.415179 29586 raft_consensus.cc:385] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.415452 29586 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.416487 29586 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.419207 29586 ts_tablet_manager.cc:1434] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:11:38.420064 29393 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:38.420310 29586 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.427088 29587 tablet_bootstrap.cc:654] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.427795 29586 tablet_bootstrap.cc:654] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.430058 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:38.430850 29546 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.434315 29589 tablet_bootstrap.cc:654] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.437282 29586 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.437870 29586 ts_tablet_manager.cc:1403] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 13:11:38.442768 29586 raft_consensus.cc:359] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.443579 29586 raft_consensus.cc:385] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.443866 29586 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.444578 29641 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.444600 29587 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:38.444849 29586 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.441074 29546 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:38.446285 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:38.447342 29587 ts_tablet_manager.cc:1403] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.010s
I20260709 13:11:38.448022 29586 ts_tablet_manager.cc:1434] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:38.448931 29589 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.449097 29586 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.449585 29589 ts_tablet_manager.cc:1403] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.009s
I20260709 13:11:38.450366 29587 raft_consensus.cc:359] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.451081 29587 raft_consensus.cc:385] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.451390 29587 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.452276 29587 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.454071 29641 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.454540 29587 ts_tablet_manager.cc:1434] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:38.455503 29641 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:38.458329 29587 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.456656 29589 raft_consensus.cc:359] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.458158 29586 tablet_bootstrap.cc:654] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.459079 29641 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.459113 29589 raft_consensus.cc:385] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.460839 29589 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.461740 29589 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.463737 29615 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.463930 29589 ts_tablet_manager.cc:1434] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:11:38.464242 29615 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.464881 29589 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:38.465101 29587 tablet_bootstrap.cc:654] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.466529 29615 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.468075 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:38.469623 29363 leader_election.cc:343] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.471089 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.471808 29546 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:38.473410 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:38.474886 29615 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.475250 29615 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.475581 29615 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.489996 29615 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.494673 29586 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.494608 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:38.495416 29586 ts_tablet_manager.cc:1403] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.014s
I20260709 13:11:38.496121 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:11:38.496582 29363 leader_election.cc:343] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.496733 29546 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.498028 29589 tablet_bootstrap.cc:654] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.498646 29586 raft_consensus.cc:359] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.499348 29586 raft_consensus.cc:385] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.499624 29586 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.500720 29586 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.503222 29295 catalog_manager.cc:5697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.507217 29586 ts_tablet_manager.cc:1434] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:11:38.508338 29586 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.525087 29586 tablet_bootstrap.cc:654] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.528961 29615 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.531386 29589 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.531993 29589 ts_tablet_manager.cc:1403] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.018s
I20260709 13:11:38.532181 29546 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:38.532696 29587 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:38.532934 29586 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.533288 29587 ts_tablet_manager.cc:1403] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.026s
I20260709 13:11:38.533368 29586 ts_tablet_manager.cc:1403] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:11:38.533874 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:38.535065 29589 raft_consensus.cc:359] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.535492 29615 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.535851 29589 raft_consensus.cc:385] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.536156 29589 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.536163 29586 raft_consensus.cc:359] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.536446 29587 raft_consensus.cc:359] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.536996 29586 raft_consensus.cc:385] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.537348 29587 raft_consensus.cc:385] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.537055 29615 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:38.537461 29586 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.537025 29589 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.537776 29587 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.538610 29586 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.538666 29587 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.540658 29589 ts_tablet_manager.cc:1434] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:38.540282 29615 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.540658 29586 ts_tablet_manager.cc:1434] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:38.543540 29586 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.550266 29586 tablet_bootstrap.cc:654] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.551162 29589 tablet_bootstrap.cc:492] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:38.553260 29587 ts_tablet_manager.cc:1434] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:11:38.554332 29587 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.560811 29587 tablet_bootstrap.cc:654] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.560348 29295 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.568150 29589 tablet_bootstrap.cc:654] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.570403 29586 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.571099 29586 ts_tablet_manager.cc:1403] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.000s
I20260709 13:11:38.575166 29586 raft_consensus.cc:359] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.576218 29586 raft_consensus.cc:385] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.576597 29586 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.577561 29586 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.580458 29619 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.580804 29586 ts_tablet_manager.cc:1434] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:38.581230 29619 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.582304 29586 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.585364 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.586627 29619 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:38.586884 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.587802 29470 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:38.591359 29586 tablet_bootstrap.cc:654] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.591358 29512 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:38.592327 29619 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.597186 29587 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:38.597745 29587 ts_tablet_manager.cc:1403] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.012s
I20260709 13:11:38.601027 29587 raft_consensus.cc:359] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.601833 29587 raft_consensus.cc:385] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.602102 29587 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.602572 29619 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.603029 29587 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.603514 29615 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.604194 29615 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.604949 29641 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.605424 29641 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.606273 29586 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.606348 29615 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.607024 29586 ts_tablet_manager.cc:1403] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.013s
I20260709 13:11:38.607674 29641 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.609195 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.609762 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.610029 29546 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:38.609973 29586 raft_consensus.cc:359] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.610869 29586 raft_consensus.cc:385] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.611158 29586 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.611572 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.611799 29586 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.612389 29470 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:38.613973 29586 ts_tablet_manager.cc:1434] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:38.614794 29589 tablet_bootstrap.cc:492] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.615152 29586 tablet_bootstrap.cc:492] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.615458 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:38.615882 29589 ts_tablet_manager.cc:1403] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.014s
I20260709 13:11:38.616770 29615 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.619381 29589 raft_consensus.cc:359] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.620201 29589 raft_consensus.cc:385] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.610414 29545 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:38.606267 29587 ts_tablet_manager.cc:1434] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:38.622032 29438 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:38.622591 29587 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.623327 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.624078 29586 tablet_bootstrap.cc:654] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.620528 29589 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.624977 29589 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.626951 29646 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.627343 29646 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.627664 29646 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.624051 29393 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:38.636992 29646 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.638967 29587 tablet_bootstrap.cc:654] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.642867 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:38.643577 29545 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.643668 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:38.644260 29393 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.639402 29589 ts_tablet_manager.cc:1434] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:11:38.625818 29619 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.659993 29589 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:38.665635 29646 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.671500 29586 tablet_bootstrap.cc:492] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.672371 29586 ts_tablet_manager.cc:1403] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.057s	user 0.034s	sys 0.020s
I20260709 13:11:38.675160 29545 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:38.677109 29393 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:38.679685 29615 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.680349 29438 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:38.684849 29586 raft_consensus.cc:359] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.685638 29586 raft_consensus.cc:385] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.685889 29586 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.687040 29589 tablet_bootstrap.cc:654] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.688167 29587 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:38.688735 29587 ts_tablet_manager.cc:1403] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.019s
I20260709 13:11:38.692243 29587 raft_consensus.cc:359] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.692957 29587 raft_consensus.cc:385] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.693207 29587 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.694150 29587 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.696214 29586 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.699132 29586 ts_tablet_manager.cc:1434] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 13:11:38.699541 29619 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.700138 29619 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.703037 29619 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:38.703544 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.682519 29646 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.704484 29393 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:38.704635 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.705358 29470 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:38.706305 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:38.707564 29665 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:38.710240 29665 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.710741 29665 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.704774 29646 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:38.729939 29646 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.711180 29665 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.700151 29586 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.734302 29619 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.735101 29619 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.739385 29615 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.740182 29615 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.743284 29615 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.746923 29615 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.746776 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.748347 29587 ts_tablet_manager.cc:1434] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.059s	user 0.021s	sys 0.033s
I20260709 13:11:38.748034 29615 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.751015 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:38.752731 29363 leader_election.cc:343] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.754755 29587 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.758531 29586 tablet_bootstrap.cc:654] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.762019 29665 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.765022 29589 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.746776 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.762320 29587 tablet_bootstrap.cc:654] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.765651 29589 ts_tablet_manager.cc:1403] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.000s
I20260709 13:11:38.766511 29665 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:38.767395 29363 leader_election.cc:343] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.770311 29589 raft_consensus.cc:359] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:38.773438 29363 leader_election.cc:343] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.773711 29589 raft_consensus.cc:385] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.774345 29589 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.771725 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:38.772552 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:38.775768 29470 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.775835 29392 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.771495 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.774129 29363 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:38.775182 29615 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.782853 29665 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.783600 29665 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.787768 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.788885 29589 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:38.789896 29512 leader_election.cc:343] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.792356 29619 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:38.790552 29665 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:38.794458 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.796267 29589 ts_tablet_manager.cc:1434] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
W20260709 13:11:38.796533 29512 leader_election.cc:343] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.798163 29392 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:38.803194 29586 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.802287 29295 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.807400 29586 ts_tablet_manager.cc:1403] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.107s	user 0.028s	sys 0.023s
I20260709 13:11:38.807574 29615 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.816540 29633 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:38.810696 29586 raft_consensus.cc:359] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.811542 29589 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:38.826545 29586 raft_consensus.cc:385] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.826923 29586 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.827833 29586 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.828912 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.813306 29470 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:38.829850 29545 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:38.830204 29586 ts_tablet_manager.cc:1434] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:11:38.830394 29512 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:38.831312 29665 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:38.831836 29665 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:11:38.831964 29509 leader_election.cc:343] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.832597 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:38.832789 29665 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.833606 29589 tablet_bootstrap.cc:654] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.833654 29670 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:38.839712 29470 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.831318 29586 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.846844 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.847631 29392 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:38.851722 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:38.853521 29633 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.853900 29633 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.854236 29633 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.858035 29586 tablet_bootstrap.cc:654] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.852596 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:38.865537 29670 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:38.866145 29670 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.866585 29670 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.874341 29586 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:38.875144 29586 ts_tablet_manager.cc:1403] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 13:11:38.885483 29586 raft_consensus.cc:359] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.886684 29586 raft_consensus.cc:385] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.887053 29586 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.891554 29586 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.894881 29586 ts_tablet_manager.cc:1434] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:11:38.905392 29641 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:38.905836 29295 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.911341 29680 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.911899 29680 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.916266 29670 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.919514 29680 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:38.940917 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.920151 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:38.943452 29587 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
W20260709 13:11:38.943635 29512 leader_election.cc:343] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.944024 29587 ts_tablet_manager.cc:1403] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.190s	user 0.047s	sys 0.080s
I20260709 13:11:38.950616 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:38.947202 29587 raft_consensus.cc:359] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.951983 29587 raft_consensus.cc:385] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.952281 29587 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
W20260709 13:11:38.952535 29512 leader_election.cc:343] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.953159 29587 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.953492 29641 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:38.955576 29587 ts_tablet_manager.cc:1434] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:11:38.958279 29670 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:38.930202 29633 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.932544 29586 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:38.960011 29615 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.960611 29615 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:38.961920 29509 leader_election.cc:343] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:38.962460 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:38.962817 29615 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.963348 29615 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:38.964004 29641 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.964407 29589 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:38.964954 29589 ts_tablet_manager.cc:1403] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.154s	user 0.060s	sys 0.052s
I20260709 13:11:38.964596 29641 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.966845 29646 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.967330 29646 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.968127 29587 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:38.969765 29646 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.968220 29589 raft_consensus.cc:359] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.970472 29589 raft_consensus.cc:385] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:38.970794 29589 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:38.971506 29589 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.972311 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.972411 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:38.973572 29471 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:38.973762 29393 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:38.974133 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:38.974989 29546 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:38.980724 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:38.982755 29615 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.983323 29615 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:38.969069 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.008550 29589 ts_tablet_manager.cc:1434] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.043s	user 0.014s	sys 0.027s
I20260709 13:11:38.986277 29438 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:39.009894 29589 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:39.011518 29586 tablet_bootstrap.cc:654] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:38.990842 29646 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.016841 29646 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.017278 29646 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.015919 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:39.021597 29393 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:39.022228 29683 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:38.990378 29633 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:38.968571 29670 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.022845 29683 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.968410 29641 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:11:39.018100 29438 leader_election.cc:343] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.024945 29615 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.034337 29683 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.063695 29682 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.067487 29682 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.065995 29683 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.084789 29686 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260709 13:11:39.096329 29587 tablet_bootstrap.cc:654] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.093161 29682 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.098802 29586 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:39.100068 29586 ts_tablet_manager.cc:1403] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.204s	user 0.023s	sys 0.024s
I20260709 13:11:39.100629 29683 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.101815 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.102501 29545 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.107142 29589 tablet_bootstrap.cc:654] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.104982 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:39.117569 29545 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:11:39.117619 29646 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.124037 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.124353 29438 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:39.125391 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:39.126046 29392 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.126832 29586 raft_consensus.cc:359] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.127619 29586 raft_consensus.cc:385] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.127947 29586 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.128443 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.128944 29545 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:39.129235 29586 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.130869 29687 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.131412 29687 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:39.131633 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.132349 29687 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.133158 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.133612 29363 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.134902 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.134552 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:39.135680 29472 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:39.136543 29587 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:39.136750 29670 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.137105 29587 ts_tablet_manager.cc:1403] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.006s
I20260709 13:11:39.139462 29586 ts_tablet_manager.cc:1434] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:11:39.140522 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.139238 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.138321 29682 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.143731 29682 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.144161 29682 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.143693 29586 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:39.142892 29543 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:11:39.145412 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.146077 29545 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
W20260709 13:11:39.148293 29438 leader_election.cc:343] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.139997 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.149891 29546 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:39.137918 29646 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.153288 29686 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.154899 29587 raft_consensus.cc:359] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.155646 29587 raft_consensus.cc:385] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.155913 29587 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.156657 29587 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.157289 29686 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.157790 29686 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.158978 29587 ts_tablet_manager.cc:1434] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:11:39.160208 29686 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.160871 29587 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:39.163780 29682 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.166683 29392 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:39.169098 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:39.170686 29687 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.171195 29687 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:39.172116 29687 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.172574 29586 tablet_bootstrap.cc:654] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.169320 29686 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:11:39.174610 29363 leader_election.cc:343] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.175623 29682 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.179370 29589 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:39.180040 29589 ts_tablet_manager.cc:1403] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.006s
I20260709 13:11:39.179297 29295 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.184258 29589 raft_consensus.cc:359] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.185250 29589 raft_consensus.cc:385] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.185600 29589 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
W20260709 13:11:39.180584 29363 leader_election.cc:343] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:39.189558 29363 leader_election.cc:343] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.190711 29363 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.191562 29682 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.191973 29682 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.192093 29586 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:39.192329 29682 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.192893 29586 ts_tablet_manager.cc:1403] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.009s
I20260709 13:11:39.196348 29586 raft_consensus.cc:359] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.197144 29586 raft_consensus.cc:385] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.197475 29586 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.198300 29586 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.201752 29589 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.204885 29586 ts_tablet_manager.cc:1434] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:39.206033 29586 tablet_bootstrap.cc:492] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:39.207780 29682 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.209656 29686 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.209992 29682 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.210209 29686 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.210179 29294 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.212428 29589 ts_tablet_manager.cc:1434] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:11:39.212726 29686 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.213466 29589 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:39.214468 29586 tablet_bootstrap.cc:654] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.219492 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.206043 29587 tablet_bootstrap.cc:654] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.225437 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.228176 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.228951 29543 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.226070 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.234529 29470 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:11:39.237185 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.238929 29670 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.239487 29670 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.241868 29670 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:39.244315 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.244792 29686 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.245235 29686 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.245291 29470 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:39.245671 29686 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.246723 29543 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:39.246822 29512 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:39.248271 29670 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:39.248651 29670 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.249033 29670 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.251420 29589 tablet_bootstrap.cc:654] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.255244 29670 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.257138 29586 tablet_bootstrap.cc:492] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:39.257833 29586 ts_tablet_manager.cc:1403] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.017s
W20260709 13:11:39.258358 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:39.259404 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.260048 29670 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:39.259554 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.260426 29682 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.260763 29470 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.262049 29682 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.263087 29615 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:39.263490 29615 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:11:39.263664 29363 leader_election.cc:343] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.264564 29615 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.266022 29615 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.266374 29682 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.267426 29587 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:39.268081 29587 ts_tablet_manager.cc:1403] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.006s
W20260709 13:11:39.268301 29363 leader_election.cc:343] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.269186 29363 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.261840 29586 raft_consensus.cc:359] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.254328 29686 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.271175 29586 raft_consensus.cc:385] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.271512 29586 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.271610 29587 raft_consensus.cc:359] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.272323 29587 raft_consensus.cc:385] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.272652 29587 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.272239 29586 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.273437 29686 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.273466 29587 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.274490 29686 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.275236 29687 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.276096 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.276721 29472 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.276249 29686 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:39.277828 29686 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.282711 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.284020 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.284307 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:39.284627 29363 leader_election.cc:343] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.284679 29544 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:39.285017 29393 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:39.285241 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.285841 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.286129 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:11:39.286535 29363 leader_election.cc:343] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.279099 29586 ts_tablet_manager.cc:1434] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:11:39.286907 29682 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.278105 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.287801 29543 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.279567 29587 ts_tablet_manager.cc:1434] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:39.281664 29589 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:39.286712 29394 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:39.288715 29472 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:39.289307 29587 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:39.281000 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.286499 29545 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.294809 29586 tablet_bootstrap.cc:492] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:39.295174 29589 ts_tablet_manager.cc:1403] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.012s
W20260709 13:11:39.299149 29363 leader_election.cc:343] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.299902 29363 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.300856 29394 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:11:39.301848 29363 leader_election.cc:343] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.302536 29686 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.303275 29686 raft_consensus.cc:697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:39.304329 29589 raft_consensus.cc:359] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.308315 29589 raft_consensus.cc:385] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.309343 29589 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.309958 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.308651 29586 tablet_bootstrap.cc:654] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.303221 29587 tablet_bootstrap.cc:654] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.313531 29665 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:39.304340 29686 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.310206 29589 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.314177 29665 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:39.315148 29665 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.316123 29589 ts_tablet_manager.cc:1434] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:11:39.317306 29589 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:39.318832 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.319703 29682 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.320238 29682 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.320649 29682 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.325873 29589 tablet_bootstrap.cc:654] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.331451 29680 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.332024 29680 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.332831 29687 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.333420 29687 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.336287 29680 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:39.337446 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.337757 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.338347 29544 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
W20260709 13:11:39.339627 29512 leader_election.cc:343] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.340595 29438 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:39.341857 29646 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.330049 29682 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.342345 29646 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.342872 29646 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.344111 29682 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.346872 29687 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.347705 29589 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:39.348233 29589 ts_tablet_manager.cc:1403] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:11:39.349404 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.351317 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.351677 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:39.351518 29687 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.352147 29544 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.352568 29394 raft_consensus.cc:2393] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:39.355857 29589 raft_consensus.cc:359] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.356588 29589 raft_consensus.cc:385] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.356887 29589 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.361743 29589 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.365211 29589 ts_tablet_manager.cc:1434] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:11:39.368098 29589 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:39.382589 29589 tablet_bootstrap.cc:654] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.388710 29586 tablet_bootstrap.cc:492] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:39.389321 29586 ts_tablet_manager.cc:1403] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.020s
I20260709 13:11:39.390163 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:39.391075 29633 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.391294 29394 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:39.391662 29633 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.392791 29586 raft_consensus.cc:359] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.393620 29586 raft_consensus.cc:385] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.393934 29586 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.394819 29586 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.394889 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.396742 29633 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.397064 29665 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.397370 29545 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:39.397640 29665 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.398185 29665 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.398505 29543 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:39.405745 29294 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.410995 29687 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.412371 29687 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.416085 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:39.416540 29470 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:11:39.416960 29392 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:39.418708 29586 ts_tablet_manager.cc:1434] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:11:39.420099 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.419886 29646 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.420926 29543 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:39.421141 29472 raft_consensus.cc:2393] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:39.421336 29687 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.425760 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.431941 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:39.432266 29646 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.433215 29394 raft_consensus.cc:2393] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:39.426301 29587 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:39.435433 29587 ts_tablet_manager.cc:1403] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.003s
I20260709 13:11:39.437703 29687 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.438239 29687 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.439939 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.426301 29589 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:39.426815 29438 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:39.441676 29683 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.442579 29438 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:39.427157 29686 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.428164 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.443979 29472 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:39.444299 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:39.444876 29670 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.444969 29686 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.446241 29641 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.447700 29687 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.451259 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.431427 29586 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:39.453688 29295 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.445022 29392 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:39.455542 29589 ts_tablet_manager.cc:1403] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.028s
I20260709 13:11:39.456804 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.457242 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.458120 29646 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.458771 29646 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.459230 29646 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.459841 29686 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.458210 29683 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.460770 29586 tablet_bootstrap.cc:654] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.465225 29589 raft_consensus.cc:359] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.465873 29589 raft_consensus.cc:385] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.466131 29589 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.429533 29665 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.466533 29295 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:39.467893 29438 leader_election.cc:343] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.438463 29544 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:39.470686 29615 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.471072 29615 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.471427 29615 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.479341 29589 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.479737 29615 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.481907 29615 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.482473 29589 ts_tablet_manager.cc:1434] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:11:39.483110 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.483572 29589 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:39.483971 29646 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.485244 29587 raft_consensus.cc:359] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.485925 29587 raft_consensus.cc:385] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.486207 29587 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.490072 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.491458 29587 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.494143 29615 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.496182 29615 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:11:39.497159 29512 leader_election.cc:343] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.497895 29587 ts_tablet_manager.cc:1434] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:11:39.498971 29587 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:39.498706 29615 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.493093 29665 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:39.504549 29363 leader_election.cc:343] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.505898 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:39.505959 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.506776 29392 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.507323 29686 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.507766 29686 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:39.509018 29686 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.509972 29665 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:39.510694 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.519328 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.519994 29646 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.520009 29544 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.524082 29392 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:39.525521 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.527796 29683 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.527657 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.528079 29544 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:39.528301 29683 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:39.531085 29683 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.535018 29586 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:39.535599 29586 ts_tablet_manager.cc:1403] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.021s
I20260709 13:11:39.536259 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:39.539942 29589 tablet_bootstrap.cc:654] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.540227 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:39.539997 29586 raft_consensus.cc:359] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.544454 29586 raft_consensus.cc:385] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.544970 29586 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.546015 29586 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.548215 29587 tablet_bootstrap.cc:654] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.544442 29472 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.594195 29586 ts_tablet_manager.cc:1434] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:11:39.597276 29586 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:39.609218 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:39.611034 29392 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.617430 29294 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:39.622779 29363 leader_election.cc:343] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:39.624140 29363 leader_election.cc:343] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:39.625186 29363 leader_election.cc:343] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.625705 29544 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:39.625643 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.621088 29294 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.631292 29686 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.642936 29683 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.649648 29295 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.666358 29472 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:39.674328 29393 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:11:39.675107 29393 pending_rounds.cc:85] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 0
I20260709 13:11:39.675534 29393 pending_rounds.cc:107] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:11:39.676036 29393 raft_consensus.cc:2889] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:39.689002 29438 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:39.689884 29646 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.691162 29587 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:39.692806 29587 ts_tablet_manager.cc:1403] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.194s	user 0.037s	sys 0.013s
I20260709 13:11:39.690349 29392 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:39.703173 29587 raft_consensus.cc:359] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.704155 29587 raft_consensus.cc:385] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.704495 29587 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.705418 29587 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.708370 29587 ts_tablet_manager.cc:1434] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:39.709869 29646 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:39.713711 29589 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:39.715380 29589 ts_tablet_manager.cc:1403] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.232s	user 0.014s	sys 0.013s
I20260709 13:11:39.715766 29586 tablet_bootstrap.cc:654] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.719871 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:39.721050 29686 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.721653 29686 raft_consensus.cc:697] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:39.722914 29589 raft_consensus.cc:359] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.723714 29589 raft_consensus.cc:385] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.724032 29589 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.723490 29686 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.724807 29589 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.732079 29587 tablet_bootstrap.cc:492] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:39.732388 29589 ts_tablet_manager.cc:1434] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:11:39.734238 29589 tablet_bootstrap.cc:492] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
W20260709 13:11:39.765539 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 64373.6us
I20260709 13:11:39.778800 29586 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:39.779434 29586 ts_tablet_manager.cc:1403] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.011s
I20260709 13:11:39.770418 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:11:39.786046 29363 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:39.786621 29392 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:39.791013 29665 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:39.791661 29665 raft_consensus.cc:697] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:39.792783 29665 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.794315 29586 raft_consensus.cc:359] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.795174 29586 raft_consensus.cc:385] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.795466 29586 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.796180 29586 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.799268 29586 ts_tablet_manager.cc:1434] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:11:39.800504 29586 tablet_bootstrap.cc:492] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:39.803931 29587 tablet_bootstrap.cc:654] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.805051 29589 tablet_bootstrap.cc:654] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.809037 29472 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:39.810722 29670 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.811986 29680 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.821398 29294 catalog_manager.cc:5697] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.828135 29295 catalog_manager.cc:5697] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.830902 29615 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.841405 29586 tablet_bootstrap.cc:654] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.848389 29589 tablet_bootstrap.cc:492] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:39.849874 29589 ts_tablet_manager.cc:1403] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.013s
I20260709 13:11:39.851413 29686 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.852203 29686 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.857313 29587 tablet_bootstrap.cc:492] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:39.857982 29587 ts_tablet_manager.cc:1403] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.002s
I20260709 13:11:39.856442 29682 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.860385 29682 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.859336 29589 raft_consensus.cc:359] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.869771 29589 raft_consensus.cc:385] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.870229 29589 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.873391 29686 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.875890 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.876502 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.877075 29682 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:39.877377 29665 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.878139 29665 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.878137 29589 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.879480 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:39.880664 29665 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:39.881093 29363 leader_election.cc:343] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.881970 29587 raft_consensus.cc:359] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.882483 29589 ts_tablet_manager.cc:1434] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:11:39.882812 29587 raft_consensus.cc:385] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.883208 29587 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.883220 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.884656 29589 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:39.885492 29469 raft_consensus.cc:2393] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:39.885169 29470 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:39.885847 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:39.887364 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:39.887639 29363 leader_election.cc:343] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.892844 29587 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.895771 29587 ts_tablet_manager.cc:1434] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:11:39.897411 29587 tablet_bootstrap.cc:492] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:39.900498 29586 tablet_bootstrap.cc:492] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:39.901067 29586 ts_tablet_manager.cc:1403] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.011s
I20260709 13:11:39.902181 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:39.912748 29665 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.935763 29646 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.952335 29363 leader_election.cc:343] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.953241 29363 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:39.936738 29646 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.960291 29682 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:39.968185 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:39.969028 29393 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
W20260709 13:11:39.972419 29728 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:11:39.973543 29586 raft_consensus.cc:359] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.974352 29586 raft_consensus.cc:385] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:39.974684 29586 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:39.975546 29586 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:39.976713 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:39.977921 29641 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:39.978120 29587 tablet_bootstrap.cc:654] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.978201 29586 ts_tablet_manager.cc:1434] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.077s	user 0.034s	sys 0.026s
I20260709 13:11:39.978307 29641 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.979663 29641 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:39.986852 29589 tablet_bootstrap.cc:654] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:39.990221 29586 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:39.994436 29683 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:39.994937 29646 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:40.000347 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:40.001029 29665 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:40.001950 29438 leader_election.cc:343] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:39.985446 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:40.020323 29682 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:40.020814 29682 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.021180 29682 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.023656 29646 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.029110 29586 tablet_bootstrap.cc:654] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:40.010782 29641 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:40.032764 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 47450us
I20260709 13:11:40.033411 29641 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:40.033649 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:40.035193 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:40.046291 29393 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:40.047366 29438 leader_election.cc:343] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:40.051700 29686 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.034195 29682 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.055837 29393 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:40.056129 29682 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:40.064596 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:40.065508 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:40.068078 29586 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:40.068693 29586 ts_tablet_manager.cc:1403] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.003s
I20260709 13:11:40.069003 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:40.069707 29472 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.068104 29587 tablet_bootstrap.cc:492] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:40.070780 29587 ts_tablet_manager.cc:1403] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.174s	user 0.025s	sys 0.014s
I20260709 13:11:40.072613 29586 raft_consensus.cc:359] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.073359 29586 raft_consensus.cc:385] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.073612 29586 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.073716 29587 raft_consensus.cc:359] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.074539 29587 raft_consensus.cc:385] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.074887 29587 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.074965 29646 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:40.075663 29589 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:40.075964 29646 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:40.076159 29589 ts_tablet_manager.cc:1403] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.193s	user 0.040s	sys 0.029s
I20260709 13:11:40.076258 29587 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.079458 29587 ts_tablet_manager.cc:1434] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:40.079208 29589 raft_consensus.cc:359] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.080890 29589 raft_consensus.cc:385] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.077137 29646 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.081215 29589 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.081416 29587 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:40.082082 29589 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.084381 29586 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.086716 29586 ts_tablet_manager.cc:1434] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:11:40.088003 29586 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:40.089881 29589 ts_tablet_manager.cc:1434] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:40.091210 29587 tablet_bootstrap.cc:654] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:40.093412 29363 leader_election.cc:343] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:40.093273 29682 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.094648 29615 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:40.091185 29589 tablet_bootstrap.cc:492] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:40.103931 29469 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.105880 29472 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:40.122758 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:40.123816 29615 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.127007 29686 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:40.141541 29589 tablet_bootstrap.cc:654] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:40.145887 29615 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.137996 29686 raft_consensus.cc:697] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:40.169601 29586 tablet_bootstrap.cc:654] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:40.168777 29680 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.176762 29680 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.169049 29615 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:11:40.182825 29545 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.201190 29680 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:40.207490 29646 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.208482 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:40.208791 29646 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.209326 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:40.211398 29512 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:40.216360 29646 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:40.217052 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:40.218051 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:40.241405 29512 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.253221 29438 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:40.254599 29646 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:40.207095 29686 consensus_queue.cc:237] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.273689 29615 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.274303 29615 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.274978 29589 tablet_bootstrap.cc:492] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:40.275507 29589 ts_tablet_manager.cc:1403] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.185s	user 0.034s	sys 0.026s
I20260709 13:11:40.277398 29587 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:40.279353 29615 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:40.280385 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:40.280901 29738 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:11:40.281159 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:40.278107 29587 ts_tablet_manager.cc:1403] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.197s	user 0.019s	sys 0.009s
W20260709 13:11:40.286510 29363 leader_election.cc:343] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:40.291752 29587 raft_consensus.cc:359] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.292672 29587 raft_consensus.cc:385] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.292980 29587 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
W20260709 13:11:40.294751 29363 leader_election.cc:343] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:40.295321 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:40.296365 29615 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:40.293836 29587 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:40.530747 29743 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 13:11:40.572492 29587 ts_tablet_manager.cc:1434] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.288s	user 0.038s	sys 0.040s
I20260709 13:11:40.575420 29670 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.577967 29670 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.580087 29589 raft_consensus.cc:359] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.580909 29589 raft_consensus.cc:385] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.581219 29589 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.589947 29589 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.591012 29670 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:40.593829 29589 ts_tablet_manager.cc:1434] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.318s	user 0.048s	sys 0.042s
I20260709 13:11:40.595577 29586 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:40.596096 29586 ts_tablet_manager.cc:1403] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.508s	user 0.015s	sys 0.019s
I20260709 13:11:40.600061 29589 tablet_bootstrap.cc:492] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:40.600960 29686 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.602759 29686 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.603193 29586 raft_consensus.cc:359] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.603883 29586 raft_consensus.cc:385] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.604146 29586 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.604696 29686 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:40.605248 29586 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.613749 29586 ts_tablet_manager.cc:1434] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
W20260709 13:11:40.612730 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:40.621239 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:40.628881 29753 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.629439 29587 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:40.629737 29589 tablet_bootstrap.cc:654] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:40.629523 29753 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.636149 29680 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:40.636623 29586 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:40.635371 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:40.640791 29469 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:40.642580 29512 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:40.634334 29293 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:40.643898 29737 log.cc:927] Time spent T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.383s	user 0.006s	sys 0.000s
I20260709 13:11:40.646919 29586 tablet_bootstrap.cc:654] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:40.633296 29753 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:40.647605 29754 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:40.648217 29754 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.648648 29754 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.652562 29646 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.669397 29680 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.679062 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:40.680019 29471 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:40.679064 29470 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.692809 29754 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.693608 29586 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:40.694170 29586 ts_tablet_manager.cc:1403] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.019s
I20260709 13:11:40.696873 29589 tablet_bootstrap.cc:492] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:40.699040 29589 ts_tablet_manager.cc:1403] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.008s
I20260709 13:11:40.702847 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:40.705073 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:40.705960 29544 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:40.706149 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:40.706815 29392 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:40.707603 29587 tablet_bootstrap.cc:654] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:40.710419 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:40.712179 29542 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.711432 29396 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.742480 29754 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:40.750295 29739 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:40.750620 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:40.757355 29469 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:40.788292 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:40.790573 29586 raft_consensus.cc:359] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.791472 29586 raft_consensus.cc:385] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.791836 29586 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.792716 29749 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:40.799098 29589 raft_consensus.cc:359] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.800004 29589 raft_consensus.cc:385] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.800335 29589 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.799778 29586 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.802594 29589 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.805011 29295 catalog_manager.cc:5697] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.813396 29509 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:40.823460 29586 ts_tablet_manager.cc:1434] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.001s
I20260709 13:11:40.824842 29587 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:40.825356 29587 ts_tablet_manager.cc:1403] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.196s	user 0.027s	sys 0.018s
I20260709 13:11:40.827558 29589 ts_tablet_manager.cc:1434] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.000s
I20260709 13:11:40.843111 29589 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:40.883140 29586 tablet_bootstrap.cc:492] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:40.885818 29587 raft_consensus.cc:359] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.887588 29587 raft_consensus.cc:385] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:40.887933 29587 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:40.898907 29587 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.904011 29686 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:11:40.930478 29665 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.944644 29587 ts_tablet_manager.cc:1434] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.119s	user 0.014s	sys 0.000s
I20260709 13:11:40.946007 29587 tablet_bootstrap.cc:492] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:40.976550 29748 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.977480 29748 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.931183 29665 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:40.932767 29469 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:40.990969 29396 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:40.991772 29615 raft_consensus.cc:2764] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:40.993886 29665 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:40.991220 29748 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:11:40.996415 29766 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:40.999045 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:41.001279 29512 leader_election.cc:343] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.002498 29739 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.003178 29739 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.004645 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:41.005721 29739 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.005879 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.007314 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.008054 29393 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:41.009557 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.012111 29680 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:41.012833 29680 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:41.014586 29670 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:41.014052 29680 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.027341 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.066030 29768 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:11:41.066836 29753 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.067711 29753 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.099084 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:41.100984 29670 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:41.101431 29670 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.101876 29670 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.101266 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:41.092103 29363 leader_election.cc:343] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.111595 29753 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.122274 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.123090 29471 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
W20260709 13:11:41.119967 29363 leader_election.cc:343] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.125378 29512 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:41.133965 29753 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.134408 29753 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.134799 29753 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.139183 29587 tablet_bootstrap.cc:654] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.141588 29589 tablet_bootstrap.cc:654] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.130146 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:41.144054 29748 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:41.140082 29670 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.157219 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:11:41.159243 29512 leader_election.cc:343] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.159945 29670 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.165707 29586 tablet_bootstrap.cc:654] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:41.153465 29363 leader_election.cc:343] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.185894 29589 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:41.186551 29589 ts_tablet_manager.cc:1403] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.346s	user 0.011s	sys 0.009s
I20260709 13:11:41.194049 29739 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.197211 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.197082 29739 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.203266 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:41.204039 29394 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.209440 29589 raft_consensus.cc:359] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.182634 29753 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.218652 29753 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:41.220180 29363 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.220662 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:41.222556 29472 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.224295 29396 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:41.222009 29587 tablet_bootstrap.cc:492] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:41.233850 29295 catalog_manager.cc:5697] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.231628 29587 ts_tablet_manager.cc:1403] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.286s	user 0.019s	sys 0.026s
I20260709 13:11:41.239236 29589 raft_consensus.cc:385] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:41.241725 29363 leader_election.cc:343] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.244117 29589 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.242918 29739 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.244666 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:41.246042 29739 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:41.247310 29589 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.243517 29472 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:11:41.249856 29512 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:41.250263 29589 ts_tablet_manager.cc:1434] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.004s
I20260709 13:11:41.252580 29586 tablet_bootstrap.cc:492] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:41.254042 29772 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.255164 29586 ts_tablet_manager.cc:1403] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.422s	user 0.046s	sys 0.048s
I20260709 13:11:41.254617 29772 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.257144 29753 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.257999 29753 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:41.259761 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.259682 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.260556 29772 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.261019 29396 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
W20260709 13:11:41.261530 29438 leader_election.cc:343] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.262283 29753 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.262601 29435 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:41.264202 29772 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:41.263983 29586 raft_consensus.cc:359] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.264618 29772 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.264731 29586 raft_consensus.cc:385] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.265084 29586 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.265038 29772 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.269152 29586 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.273397 29589 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:41.276386 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.276692 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.277531 29471 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:41.278844 29586 ts_tablet_manager.cc:1434] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:11:41.285585 29586 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:41.283902 29772 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.288106 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:41.288829 29392 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.307991 29587 raft_consensus.cc:359] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.309098 29587 raft_consensus.cc:385] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.309464 29587 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.305688 29615 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.313747 29615 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.318415 29615 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.318652 29392 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:11:41.310384 29587 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.323997 29768 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.324772 29768 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.327196 29589 tablet_bootstrap.cc:654] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.331314 29394 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:41.335451 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:41.337087 29686 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.340204 29768 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.341468 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.341675 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.343394 29772 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.344683 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:11:41.346221 29438 leader_election.cc:343] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.347502 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.348138 29586 tablet_bootstrap.cc:654] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.347627 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:41.349315 29392 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:41.355777 29363 leader_election.cc:343] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.356594 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:41.361815 29680 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:41.362422 29680 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:41.363870 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.363907 29680 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.365835 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:41.370167 29768 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:41.371019 29587 ts_tablet_manager.cc:1434] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.000s
I20260709 13:11:41.352674 29589 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:41.372367 29587 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:41.372507 29589 ts_tablet_manager.cc:1403] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.006s
I20260709 13:11:41.376824 29589 raft_consensus.cc:359] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.377846 29589 raft_consensus.cc:385] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.378258 29589 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
W20260709 13:11:41.379171 29363 leader_election.cc:343] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.379812 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:41.382792 29749 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:41.382517 29589 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.390429 29392 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:41.391927 29435 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:41.393141 29772 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:41.395328 29772 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:41.396551 29772 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.404608 29587 tablet_bootstrap.cc:654] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.405560 29294 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.407459 29589 ts_tablet_manager.cc:1434] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.003s
I20260709 13:11:41.410543 29589 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:41.419611 29589 tablet_bootstrap.cc:654] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.421120 29586 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:41.421747 29586 ts_tablet_manager.cc:1403] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.136s	user 0.029s	sys 0.035s
I20260709 13:11:41.426187 29587 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:41.426848 29587 ts_tablet_manager.cc:1403] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.009s
I20260709 13:11:41.428891 29294 catalog_manager.cc:5697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:41.430179 29587 raft_consensus.cc:359] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.431137 29587 raft_consensus.cc:385] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.431478 29587 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.432271 29587 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.435165 29587 ts_tablet_manager.cc:1434] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:11:41.436342 29587 tablet_bootstrap.cc:492] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:41.425796 29586 raft_consensus.cc:359] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.443267 29586 raft_consensus.cc:385] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.443418 29587 tablet_bootstrap.cc:654] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.443718 29586 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.448897 29586 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.452286 29586 ts_tablet_manager.cc:1434] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.005s
I20260709 13:11:41.449805 29295 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.453634 29586 tablet_bootstrap.cc:492] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:41.464996 29753 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:41.479413 29586 tablet_bootstrap.cc:654] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.481626 29589 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:41.482262 29589 ts_tablet_manager.cc:1403] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.028s
I20260709 13:11:41.495909 29587 tablet_bootstrap.cc:492] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:41.496531 29587 ts_tablet_manager.cc:1403] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.008s
I20260709 13:11:41.496174 29589 raft_consensus.cc:359] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.496994 29589 raft_consensus.cc:385] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.497295 29589 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.498023 29589 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.499913 29753 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.499987 29587 raft_consensus.cc:359] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.500587 29589 ts_tablet_manager.cc:1434] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:11:41.500728 29587 raft_consensus.cc:385] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.500515 29753 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.501051 29587 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.501691 29589 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:41.501775 29587 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.505064 29587 ts_tablet_manager.cc:1434] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:41.506085 29587 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:41.509424 29589 tablet_bootstrap.cc:654] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.511163 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.512880 29587 tablet_bootstrap.cc:654] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.515339 29680 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:41.518323 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.519987 29512 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:41.515017 29753 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.520915 29680 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:41.527462 29472 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.528605 29586 tablet_bootstrap.cc:492] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:41.529105 29586 ts_tablet_manager.cc:1403] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.001s
I20260709 13:11:41.532521 29586 raft_consensus.cc:359] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.533305 29586 raft_consensus.cc:385] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.533666 29586 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.534675 29586 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.540910 29545 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.544322 29586 ts_tablet_manager.cc:1434] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:41.546696 29586 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:41.584331 29587 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:41.584906 29587 ts_tablet_manager.cc:1403] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.017s
I20260709 13:11:41.590294 29587 raft_consensus.cc:359] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.595640 29587 raft_consensus.cc:385] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.596143 29587 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.597613 29589 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:41.598196 29589 ts_tablet_manager.cc:1403] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.027s
I20260709 13:11:41.598886 29586 tablet_bootstrap.cc:654] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.597078 29587 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.601222 29589 raft_consensus.cc:359] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.602058 29589 raft_consensus.cc:385] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.603971 29587 ts_tablet_manager.cc:1434] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:11:41.608973 29587 tablet_bootstrap.cc:492] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:41.602351 29589 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.612372 29589 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.617614 29587 tablet_bootstrap.cc:654] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.621973 29589 ts_tablet_manager.cc:1434] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:11:41.626855 29589 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:41.642282 29589 tablet_bootstrap.cc:654] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.646207 29586 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:41.648077 29586 ts_tablet_manager.cc:1403] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.009s
I20260709 13:11:41.651223 29586 raft_consensus.cc:359] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.655686 29586 raft_consensus.cc:385] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.656111 29586 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.656868 29586 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.661782 29589 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:41.662374 29589 ts_tablet_manager.cc:1403] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.003s
I20260709 13:11:41.663218 29586 ts_tablet_manager.cc:1434] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:41.664446 29586 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:41.665578 29589 raft_consensus.cc:359] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.666353 29589 raft_consensus.cc:385] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.666664 29589 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.667332 29589 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.669610 29589 ts_tablet_manager.cc:1434] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:41.670776 29589 tablet_bootstrap.cc:492] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:41.676594 29586 tablet_bootstrap.cc:654] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.689189 29589 tablet_bootstrap.cc:654] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.695806 29587 tablet_bootstrap.cc:492] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:41.696451 29587 ts_tablet_manager.cc:1403] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.004s
W20260709 13:11:41.699020 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:41.699572 29587 raft_consensus.cc:359] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.700350 29587 raft_consensus.cc:385] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.700646 29587 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.701391 29587 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.703774 29587 ts_tablet_manager.cc:1434] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:41.706574 29586 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:41.707094 29586 ts_tablet_manager.cc:1403] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.007s
I20260709 13:11:41.709684 29589 tablet_bootstrap.cc:492] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:41.710319 29589 ts_tablet_manager.cc:1403] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.006s
I20260709 13:11:41.710727 29680 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.711232 29680 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.713522 29680 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.713644 29589 raft_consensus.cc:359] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.714600 29589 raft_consensus.cc:385] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.714936 29589 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.716141 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.716320 29589 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.716871 29472 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:41.717998 29587 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:41.718461 29512 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:41.719497 29680 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:41.719879 29680 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.720207 29680 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.724197 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.724948 29392 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:41.731393 29589 ts_tablet_manager.cc:1434] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:11:41.732609 29589 tablet_bootstrap.cc:492] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:41.738932 29586 raft_consensus.cc:359] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.740458 29586 raft_consensus.cc:385] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.745550 29392 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:41.745814 29589 tablet_bootstrap.cc:654] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.747952 29753 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:41.748584 29680 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.749995 29753 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.750548 29753 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.751214 29680 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.754603 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.755383 29471 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:41.756808 29512 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:41.757704 29680 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:41.758090 29680 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.758327 29753 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.758558 29680 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.758033 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:41.759373 29472 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.764196 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:41.764890 29396 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.766297 29680 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.766901 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.767547 29393 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:41.768853 29472 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:41.769727 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:41.769886 29680 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.770344 29468 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.740993 29772 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.772632 29772 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.779353 29512 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:41.780416 29680 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:41.780966 29680 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:41.781946 29680 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.787045 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:41.788002 29397 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.778296 29468 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:41.790002 29512 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:41.791025 29753 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:41.791803 29753 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:41.792783 29753 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.804152 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.805538 29392 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:41.809103 29641 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:41.832492 29754 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.833069 29754 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.834149 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:41.835390 29754 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.836709 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.837446 29545 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:41.837599 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.822247 29774 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.838594 29774 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.839823 29772 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.829784 29739 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.837782 29765 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:41.851153 29765 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.851697 29765 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.856959 29739 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.810911 29471 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:41.840996 29774 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:41.828903 29768 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.842737 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:41.866541 29768 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.869161 29768 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.873857 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.875885 29774 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:41.877910 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.879087 29395 raft_consensus.cc:2393] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:41.862143 29739 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.896901 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:41.922960 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.927415 29391 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:41.742157 29586 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.931113 29586 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.932113 29768 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.933135 29586 ts_tablet_manager.cc:1434] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.226s	user 0.005s	sys 0.002s
I20260709 13:11:41.741433 29587 tablet_bootstrap.cc:654] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.938810 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:41.947544 29586 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:41.952726 29587 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:41.978981 29587 ts_tablet_manager.cc:1403] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.261s	user 0.013s	sys 0.000s
I20260709 13:11:41.955930 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:41.957199 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:41.988051 29363 leader_election.cc:343] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.963271 29294 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.965435 29772 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.971868 29754 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:41.993999 29772 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.982132 29765 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.997720 29772 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:41.982319 29587 raft_consensus.cc:359] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:41.999094 29587 raft_consensus.cc:385] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.999416 29587 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.999502 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:42.000173 29587 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:42.001549 29438 leader_election.cc:343] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:41.960085 29396 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:41.990116 29397 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
W20260709 13:11:41.995752 29363 leader_election.cc:343] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.006096 29587 ts_tablet_manager.cc:1434] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:11:42.013447 29363 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:42.014135 29587 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:42.014294 29749 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:41.988165 29586 tablet_bootstrap.cc:654] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.003166 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:42.011227 29468 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:42.019438 29393 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:42.027132 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:42.031100 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:42.032846 29545 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.033613 29812 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.034219 29812 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.034662 29812 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.040164 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:42.041184 29393 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:42.041471 29809 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:11:42.129844 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 134114us
I20260709 13:11:42.131171 29589 tablet_bootstrap.cc:492] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:42.131892 29589 ts_tablet_manager.cc:1403] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.400s	user 0.063s	sys 0.099s
W20260709 13:11:42.137949 29810 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.105s	user 0.010s	sys 0.013s
I20260709 13:11:42.142221 29509 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:42.144021 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:42.145979 29546 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.079998 29765 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.138764 29749 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.183856 29589 raft_consensus.cc:359] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.191787 29589 raft_consensus.cc:385] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.192698 29589 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.194986 29589 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.171505 29749 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.203265 29749 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.176400 29768 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.237051 29587 tablet_bootstrap.cc:654] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.229064 29680 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:11:42.210384 29545 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:42.248726 29670 raft_consensus.cc:2764] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:42.232908 29393 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:42.260991 29774 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.220372 29812 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.301431 29589 ts_tablet_manager.cc:1434] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.169s	user 0.008s	sys 0.020s
I20260709 13:11:42.301703 29817 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.302217 29817 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.302848 29589 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:42.304556 29817 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:42.267295 29754 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:11:42.307372 29586 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:42.308315 29586 ts_tablet_manager.cc:1403] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.361s	user 0.016s	sys 0.015s
I20260709 13:11:42.321640 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:42.305866 29812 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.328644 29772 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.329304 29772 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.330152 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:42.330652 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:42.334092 29472 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:42.336944 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:42.345166 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:42.345938 29397 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:42.358090 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:42.348932 29821 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.362591 29821 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:11:42.371230 29512 leader_election.cc:343] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.379387 29586 raft_consensus.cc:359] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.381173 29586 raft_consensus.cc:385] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.381686 29586 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.387018 29586 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.372602 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:42.402122 29586 ts_tablet_manager.cc:1434] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.004s
I20260709 13:11:42.389336 29749 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.366302 29821 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:42.408365 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 50293us
I20260709 13:11:42.406605 29749 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.414335 29587 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
W20260709 13:11:42.418877 29363 leader_election.cc:343] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.404137 29396 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.419477 29587 ts_tablet_manager.cc:1403] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.406s	user 0.018s	sys 0.019s
I20260709 13:11:42.416911 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:42.421226 29749 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.408422 29812 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:11:42.426000 29772 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.458618 29833 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.481988 29833 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.511016 29589 tablet_bootstrap.cc:654] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.520509 29833 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.520635 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:42.527369 29587 raft_consensus.cc:359] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.528970 29587 raft_consensus.cc:385] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.529291 29587 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.530056 29587 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.533103 29587 ts_tablet_manager.cc:1434] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.001s
W20260709 13:11:42.533805 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 109130us
I20260709 13:11:42.538597 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:42.542104 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:42.544360 29438 leader_election.cc:343] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:42.552129 29363 leader_election.cc:343] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.554864 29587 tablet_bootstrap.cc:492] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:42.537549 29686 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.567673 29586 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:42.563025 29686 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.576547 29542 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.582042 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:42.585417 29363 leader_election.cc:343] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.596329 29686 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.617726 29396 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:42.608244 29749 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.622999 29391 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:42.626669 29435 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:42.632467 29821 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.633107 29542 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:42.634919 29438 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:42.636199 29812 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.636804 29812 raft_consensus.cc:697] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:42.637712 29812 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:42.645237 29498 tablet.cc:2406] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:42.668931 29293 catalog_manager.cc:5697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.674873 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:42.678031 29294 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.680752 29589 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:42.688212 29589 ts_tablet_manager.cc:1403] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.386s	user 0.015s	sys 0.039s
I20260709 13:11:42.681093 29749 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.681286 29586 tablet_bootstrap.cc:654] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.684816 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:42.691524 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:42.700709 29587 tablet_bootstrap.cc:654] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.737757 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:42.736104 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:42.739670 29589 raft_consensus.cc:359] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.740535 29589 raft_consensus.cc:385] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.740991 29589 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.742799 29754 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.743261 29754 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.743604 29754 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.752825 29587 tablet_bootstrap.cc:492] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:42.753475 29587 ts_tablet_manager.cc:1403] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.199s	user 0.023s	sys 0.020s
I20260709 13:11:42.753206 29754 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.755681 29754 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:42.770809 29821 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.763660 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:42.768078 29826 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:42.788127 29512 leader_election.cc:343] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:42.791301 29363 leader_election.cc:343] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.791879 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:42.756618 29587 raft_consensus.cc:359] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.793398 29587 raft_consensus.cc:385] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.793809 29587 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.796342 29587 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.741911 29589 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.794169 29472 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:42.801128 29587 ts_tablet_manager.cc:1434] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.002s
I20260709 13:11:42.802733 29587 tablet_bootstrap.cc:492] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:42.808139 29680 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:42.810098 29587 tablet_bootstrap.cc:654] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.810334 29586 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:42.810901 29586 ts_tablet_manager.cc:1403] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.244s	user 0.018s	sys 0.003s
I20260709 13:11:42.813894 29586 raft_consensus.cc:359] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.823493 29586 raft_consensus.cc:385] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.823885 29586 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.824646 29586 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.783334 29292 catalog_manager.cc:5697] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.827756 29586 ts_tablet_manager.cc:1434] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 13:11:42.829269 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:42.831218 29586 tablet_bootstrap.cc:492] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:42.794520 29840 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.835281 29587 tablet_bootstrap.cc:492] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:42.835909 29587 ts_tablet_manager.cc:1403] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 13:11:42.819074 29589 ts_tablet_manager.cc:1434] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.004s
W20260709 13:11:42.795404 29363 leader_election.cc:343] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.843441 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:11:42.844547 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49182.1us
I20260709 13:11:42.846243 29833 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:42.846313 29363 leader_election.cc:343] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.853219 29586 tablet_bootstrap.cc:654] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.853826 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:42.854554 29397 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.844159 29589 tablet_bootstrap.cc:492] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:42.861532 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:42.864451 29833 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.864984 29833 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:42.865906 29833 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.867789 29589 tablet_bootstrap.cc:654] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.879607 29826 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:42.882586 29589 tablet_bootstrap.cc:492] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:42.883157 29589 ts_tablet_manager.cc:1403] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.001s
I20260709 13:11:42.886080 29589 raft_consensus.cc:359] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.886826 29589 raft_consensus.cc:385] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.887224 29589 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.888038 29589 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.892421 29589 ts_tablet_manager.cc:1434] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:42.893934 29589 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:42.898380 29397 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:42.903703 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:42.905372 29680 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.906054 29680 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:42.888218 29587 raft_consensus.cc:359] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.906917 29587 raft_consensus.cc:385] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.900692 29589 tablet_bootstrap.cc:654] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.908913 29680 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.910759 29587 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.930593 29587 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.941952 29821 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:42.944896 29295 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.949421 29587 ts_tablet_manager.cc:1434] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 13:11:42.950719 29587 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:42.965469 29822 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.966305 29822 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.969146 29822 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:42.970353 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:42.971364 29391 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:42.972119 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:42.973007 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:11:42.974745 29438 leader_election.cc:343] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.976627 29822 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.977155 29822 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.977672 29822 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.981017 29589 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:42.981639 29589 ts_tablet_manager.cc:1403] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.041s
I20260709 13:11:42.984859 29821 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:42.977273 29587 tablet_bootstrap.cc:654] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.988952 29586 tablet_bootstrap.cc:492] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:42.989596 29586 ts_tablet_manager.cc:1403] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.159s	user 0.051s	sys 0.031s
I20260709 13:11:42.981582 29294 catalog_manager.cc:5697] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.998656 29586 raft_consensus.cc:359] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:42.999370 29586 raft_consensus.cc:385] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.999670 29586 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.002345 29586 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.004192 29822 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.014760 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:43.015540 29391 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.019414 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:11:43.020799 29438 leader_election.cc:343] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.022607 29586 ts_tablet_manager.cc:1434] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:11:43.024852 29586 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:43.022064 29822 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.031767 29589 raft_consensus.cc:359] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.032675 29589 raft_consensus.cc:385] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.033021 29589 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.034955 29840 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.035490 29840 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.036676 29391 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:43.038568 29589 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.039079 29587 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:43.039654 29587 ts_tablet_manager.cc:1403] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.002s
I20260709 13:11:43.040979 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.043140 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:43.045105 29363 leader_election.cc:343] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:43.045819 29363 leader_election.cc:343] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.047277 29589 ts_tablet_manager.cc:1434] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 13:11:43.038987 29840 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.046205 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:43.048446 29589 tablet_bootstrap.cc:492] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.048913 29840 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.053274 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:43.055151 29812 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.055727 29812 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:43.056813 29812 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.065403 29587 raft_consensus.cc:359] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.066336 29587 raft_consensus.cc:385] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.066743 29587 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.067687 29587 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.069561 29587 ts_tablet_manager.cc:1434] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:11:43.074384 29589 tablet_bootstrap.cc:654] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.081284 29586 tablet_bootstrap.cc:654] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.084292 29822 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.085215 29587 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.091912 29586 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:43.090966 29293 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.092600 29586 ts_tablet_manager.cc:1403] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 13:11:43.096768 29822 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.097292 29589 tablet_bootstrap.cc:492] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.097870 29589 ts_tablet_manager.cc:1403] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 13:11:43.097425 29822 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.100046 29822 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.096275 29586 raft_consensus.cc:359] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.101933 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:43.103722 29438 leader_election.cc:343] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.092047 29587 tablet_bootstrap.cc:654] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.103857 29589 raft_consensus.cc:359] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.104625 29589 raft_consensus.cc:385] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.104921 29589 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.106216 29589 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.100752 29586 raft_consensus.cc:385] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.108733 29586 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.109486 29586 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.112380 29589 ts_tablet_manager.cc:1434] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:11:43.113552 29589 tablet_bootstrap.cc:492] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.113351 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:43.117581 29435 leader_election.cc:343] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.118527 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:43.123659 29812 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.128139 29815 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.167922 29589 tablet_bootstrap.cc:654] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.137612 29586 ts_tablet_manager.cc:1434] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.003s
I20260709 13:11:43.171375 29586 tablet_bootstrap.cc:492] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:43.172349 29587 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:43.172858 29587 ts_tablet_manager.cc:1403] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.088s	user 0.024s	sys 0.039s
I20260709 13:11:43.176961 29587 raft_consensus.cc:359] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.177690 29587 raft_consensus.cc:385] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.177956 29587 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.178725 29587 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.181134 29587 ts_tablet_manager.cc:1434] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:43.182261 29587 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.186151 29589 tablet_bootstrap.cc:492] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.187304 29589 ts_tablet_manager.cc:1403] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.015s
I20260709 13:11:43.188862 29587 tablet_bootstrap.cc:654] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.190316 29589 raft_consensus.cc:359] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.191195 29589 raft_consensus.cc:385] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.191572 29589 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.192448 29589 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.197999 29589 ts_tablet_manager.cc:1434] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:11:43.200037 29589 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.206128 29589 tablet_bootstrap.cc:654] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.209671 29587 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:43.209985 29815 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.210408 29587 ts_tablet_manager.cc:1403] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 13:11:43.210534 29815 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.213773 29587 raft_consensus.cc:359] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.214665 29587 raft_consensus.cc:385] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.215040 29587 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.215536 29586 tablet_bootstrap.cc:654] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.215457 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.215903 29587 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.217474 29546 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:43.218891 29587 ts_tablet_manager.cc:1434] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:11:43.219564 29438 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:43.220607 29822 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.220538 29680 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.221110 29822 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.221490 29822 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.221324 29680 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.225428 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.226387 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.230836 29391 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:43.227144 29812 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.232842 29812 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.233595 29680 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.220130 29587 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.234051 29822 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.235368 29812 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.226605 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:43.236287 29822 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.236617 29470 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:43.239423 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.240111 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:43.240180 29546 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:43.240815 29542 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.242019 29512 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:43.242488 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:43.243095 29397 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.243345 29680 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.246857 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.247579 29391 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:43.249097 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.251991 29397 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:43.232103 29815 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.253525 29815 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.253791 29435 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.255039 29542 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:43.255221 29812 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.256214 29812 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:43.257380 29812 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.258651 29587 tablet_bootstrap.cc:654] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.253042 29680 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.253980 29815 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.272235 29589 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.272889 29589 ts_tablet_manager.cc:1403] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.002s
I20260709 13:11:43.269310 29815 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.284987 29589 raft_consensus.cc:359] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.285787 29589 raft_consensus.cc:385] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.286077 29589 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.286322 29840 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.288751 29589 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.292109 29589 ts_tablet_manager.cc:1434] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:11:43.300874 29589 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.314577 29586 tablet_bootstrap.cc:492] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:43.315368 29586 ts_tablet_manager.cc:1403] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.010s
I20260709 13:11:43.318673 29586 raft_consensus.cc:359] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.319108 29817 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.320420 29586 raft_consensus.cc:385] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.320856 29586 raft_consensus.cc:740] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.320663 29817 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.321831 29586 consensus_queue.cc:260] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.323892 29817 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.324559 29586 ts_tablet_manager.cc:1434] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:11:43.325791 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:43.326570 29586 tablet_bootstrap.cc:492] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:43.326798 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.327731 29397 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:43.329119 29509 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:43.329456 29589 tablet_bootstrap.cc:654] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.330102 29817 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.338286 29295 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.349344 29833 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.364737 29587 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:43.365411 29587 ts_tablet_manager.cc:1403] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.025s
I20260709 13:11:43.368388 29815 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.365835 29817 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.371802 29587 raft_consensus.cc:359] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.372608 29587 raft_consensus.cc:385] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.372614 29586 tablet_bootstrap.cc:654] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.372933 29587 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.373832 29587 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.386991 29587 ts_tablet_manager.cc:1434] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:11:43.391215 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:43.391897 29397 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.393716 29589 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.393908 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:43.394299 29589 ts_tablet_manager.cc:1403] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.000s
I20260709 13:11:43.394663 29542 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.399260 29587 tablet_bootstrap.cc:492] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.404440 29589 raft_consensus.cc:359] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.405730 29397 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:43.407586 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.408601 29821 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.409140 29821 raft_consensus.cc:697] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:43.410493 29589 raft_consensus.cc:385] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.410904 29589 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.399029 29815 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.418967 29589 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.410101 29821 consensus_queue.cc:237] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.421684 29589 ts_tablet_manager.cc:1434] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:11:43.424081 29586 tablet_bootstrap.cc:492] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:43.426261 29586 ts_tablet_manager.cc:1403] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.011s
I20260709 13:11:43.425235 29589 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.439532 29542 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:43.431350 29586 raft_consensus.cc:359] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.440343 29586 raft_consensus.cc:385] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.440913 29586 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.441331 29815 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.441954 29815 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.444434 29815 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.445223 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.445565 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:43.446897 29435 leader_election.cc:343] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.447172 29586 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:43.448818 29438 leader_election.cc:343] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.449829 29589 tablet_bootstrap.cc:654] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.452282 29438 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:43.453239 29815 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.461532 29586 ts_tablet_manager.cc:1434] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:11:43.463874 29821 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:11:43.469498 29586 tablet_bootstrap.cc:492] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:43.475306 29817 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.476796 29587 tablet_bootstrap.cc:654] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.486894 29586 tablet_bootstrap.cc:654] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.506867 29587 tablet_bootstrap.cc:492] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
W20260709 13:11:43.515452 29512 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:43.519959 29586 tablet_bootstrap.cc:492] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:43.520526 29586 ts_tablet_manager.cc:1403] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.006s
I20260709 13:11:43.507586 29587 ts_tablet_manager.cc:1403] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.006s
I20260709 13:11:43.523684 29586 raft_consensus.cc:359] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.524482 29586 raft_consensus.cc:385] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.527580 29586 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.524338 29587 raft_consensus.cc:359] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.528571 29587 raft_consensus.cc:385] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.529295 29587 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.528684 29586 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.531040 29587 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.537726 29295 catalog_manager.cc:5697] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.540596 29586 ts_tablet_manager.cc:1434] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:11:43.542014 29586 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:43.545210 29812 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:43.548293 29589 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.548861 29589 ts_tablet_manager.cc:1403] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.018s
I20260709 13:11:43.552037 29589 raft_consensus.cc:359] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.552798 29589 raft_consensus.cc:385] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.553097 29589 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.554876 29587 ts_tablet_manager.cc:1434] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:11:43.556318 29587 tablet_bootstrap.cc:492] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.565603 29586 tablet_bootstrap.cc:654] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.570788 29833 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.571403 29833 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.573757 29833 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.574599 29589 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.575999 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:43.576750 29589 ts_tablet_manager.cc:1434] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:11:43.576689 29472 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:43.578003 29587 tablet_bootstrap.cc:654] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.578239 29812 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.578418 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.578783 29812 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.581074 29812 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.583916 29589 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.583751 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:43.584182 29363 leader_election.cc:343] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.584903 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:43.587231 29749 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.587639 29749 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.587967 29749 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.587103 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:43.591719 29435 leader_election.cc:343] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:43.592335 29438 leader_election.cc:343] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.592732 29589 tablet_bootstrap.cc:654] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.592789 29438 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:43.593752 29815 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.596218 29587 tablet_bootstrap.cc:492] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:43.596707 29587 ts_tablet_manager.cc:1403] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.001s
I20260709 13:11:43.599884 29587 raft_consensus.cc:359] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.600615 29587 raft_consensus.cc:385] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.600885 29587 raft_consensus.cc:740] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.601578 29587 consensus_queue.cc:260] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.607242 29587 ts_tablet_manager.cc:1434] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:11:43.607851 29833 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.608520 29587 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.608425 29833 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.610193 29817 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.610718 29817 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.612287 29833 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.612910 29817 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.616022 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:43.616875 29470 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:43.618757 29512 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:43.620638 29754 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.621007 29754 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.621454 29754 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.621971 29589 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.623005 29589 ts_tablet_manager.cc:1403] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.005s
I20260709 13:11:43.622880 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.624648 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:43.633411 29472 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:43.634613 29833 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.635138 29833 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.637450 29833 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.635757 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.640372 29739 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.640782 29739 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.641142 29739 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.641328 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.645812 29586 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:43.646414 29586 ts_tablet_manager.cc:1403] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.007s
I20260709 13:11:43.649358 29815 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.630601 29749 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.649574 29586 raft_consensus.cc:359] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.632486 29587 tablet_bootstrap.cc:654] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.650257 29586 raft_consensus.cc:385] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.649950 29815 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.650625 29586 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.651427 29586 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.653859 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.654371 29749 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.654603 29393 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:43.656189 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.657243 29812 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.649096 29739 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.657661 29812 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.658280 29812 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.658324 29815 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.626293 29589 raft_consensus.cc:359] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.659010 29589 raft_consensus.cc:385] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.659333 29589 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.659685 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.666311 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:43.666983 29470 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.661145 29754 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.667398 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:43.668534 29544 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:43.669302 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.669909 29542 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
W20260709 13:11:43.661226 29438 leader_election.cc:343] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.661926 29397 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:43.660107 29589 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.662566 29817 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.674275 29817 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.674701 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:43.675426 29544 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:43.676540 29817 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.679322 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:43.680986 29512 leader_election.cc:343] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.683458 29470 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:43.684979 29754 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.686944 29586 ts_tablet_manager.cc:1434] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 13:11:43.663818 29739 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.664422 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:43.689395 29589 ts_tablet_manager.cc:1434] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:11:43.688725 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:43.664925 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:43.690696 29589 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.690786 29468 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.690814 29469 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:43.698680 29586 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:43.698261 29812 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.698678 29589 tablet_bootstrap.cc:654] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.702775 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:43.703487 29393 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.704337 29468 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:43.708271 29812 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.709874 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:43.714740 29586 tablet_bootstrap.cc:654] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.714944 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:11:43.715624 29438 leader_election.cc:343] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.715847 29739 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.716452 29739 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:43.717351 29739 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.720539 29589 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.721191 29589 ts_tablet_manager.cc:1403] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.002s
I20260709 13:11:43.722216 29587 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:43.722920 29587 ts_tablet_manager.cc:1403] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.006s
W20260709 13:11:43.722117 29363 leader_election.cc:343] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.723769 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.724516 29589 raft_consensus.cc:359] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.725387 29589 raft_consensus.cc:385] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.725186 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.725069 29749 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.725800 29589 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.726121 29397 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:43.726553 29749 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:43.726649 29589 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.727567 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:11:43.728384 29363 leader_election.cc:343] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.729512 29589 ts_tablet_manager.cc:1434] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:43.728030 29749 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.729781 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:43.730082 29587 raft_consensus.cc:359] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.730710 29840 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.730793 29587 raft_consensus.cc:385] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.731194 29840 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.731266 29587 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.731652 29840 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.732559 29587 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.736052 29589 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.739444 29817 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.740283 29817 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.743460 29587 ts_tablet_manager.cc:1434] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:11:43.747225 29589 tablet_bootstrap.cc:654] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.750648 29587 tablet_bootstrap.cc:492] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.758009 29587 tablet_bootstrap.cc:654] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.761222 29840 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.767354 29587 tablet_bootstrap.cc:492] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:43.767958 29817 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.769940 29587 ts_tablet_manager.cc:1403] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 13:11:43.775580 29294 catalog_manager.cc:5697] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.776216 29587 raft_consensus.cc:359] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.777004 29587 raft_consensus.cc:385] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.777364 29587 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.717418 29393 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:43.770159 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:43.771869 29589 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:43.779199 29589 ts_tablet_manager.cc:1403] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.007s
I20260709 13:11:43.779160 29468 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:43.779659 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:43.781147 29812 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.781167 29512 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:43.782012 29812 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:43.782771 29815 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.782653 29589 raft_consensus.cc:359] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.783870 29589 raft_consensus.cc:385] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.784236 29589 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.782582 29817 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.784734 29817 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.785156 29817 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.784822 29812 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.785526 29509 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:43.787135 29754 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.787647 29754 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.788093 29754 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.790723 29840 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.783473 29815 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.795634 29815 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.796715 29589 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.797175 29509 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:43.798405 29680 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.799269 29589 ts_tablet_manager.cc:1434] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:11:43.800557 29589 tablet_bootstrap.cc:492] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:43.801872 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.803804 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.804579 29393 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:43.805852 29435 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.805959 29817 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.808233 29817 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.778102 29587 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.809754 29815 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.810216 29815 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.810657 29815 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.810791 29587 ts_tablet_manager.cc:1434] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:11:43.811966 29587 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:43.821656 29821 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.825269 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:43.831579 29391 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:43.832086 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:43.826457 29587 tablet_bootstrap.cc:654] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:43.837653 29363 leader_election.cc:343] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:43.831622 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:43.851405 29542 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.850631 29821 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:43.853585 29754 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.854954 29544 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:43.856083 29754 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:43.831611 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:43.856812 29397 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.858604 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:43.858985 29589 tablet_bootstrap.cc:654] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:43.859318 29391 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.862773 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:43.862964 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:43.863794 29468 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.851282 29295 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.877763 29294 catalog_manager.cc:5697] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.890209 29586 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:43.891513 29586 ts_tablet_manager.cc:1403] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.193s	user 0.058s	sys 0.067s
I20260709 13:11:43.918159 29822 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.918900 29822 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.920778 29397 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:43.922479 29815 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.924708 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.921329 29822 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.927078 29817 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.927901 29817 raft_consensus.cc:697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:43.928916 29817 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.936580 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:43.938608 29815 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:43.925549 29586 raft_consensus.cc:359] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.940977 29469 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:43.943832 29468 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:43.941185 29586 raft_consensus.cc:385] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.944883 29586 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.945998 29586 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.948006 29391 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:43.949162 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:43.950073 29392 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:43.952284 29509 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:43.967015 29754 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.968006 29586 ts_tablet_manager.cc:1434] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.001s
I20260709 13:11:43.968657 29542 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:43.976480 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:43.978289 29749 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.970273 29754 raft_consensus.cc:697] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:43.979019 29749 raft_consensus.cc:697] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:43.979916 29754 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.980276 29749 consensus_queue.cc:237] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:43.999647 29587 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:44.000258 29587 ts_tablet_manager.cc:1403] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.189s	user 0.011s	sys 0.009s
I20260709 13:11:43.973932 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:44.012807 29589 tablet_bootstrap.cc:492] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:44.013361 29589 ts_tablet_manager.cc:1403] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.025s
I20260709 13:11:44.011281 29586 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:44.017218 29826 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.017779 29826 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.019227 29469 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:44.005600 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 77907.7us
I20260709 13:11:44.027895 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:44.028152 29589 raft_consensus.cc:359] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.028960 29589 raft_consensus.cc:385] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.029255 29589 raft_consensus.cc:740] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.030001 29589 consensus_queue.cc:260] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.022033 29826 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:44.034165 29396 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:44.039798 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.042048 29587 raft_consensus.cc:359] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.042970 29587 raft_consensus.cc:385] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.047484 29587 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.048264 29587 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.051110 29589 ts_tablet_manager.cc:1434] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:11:44.053653 29589 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:44.055848 29512 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:44.057340 29680 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.058244 29587 ts_tablet_manager.cc:1434] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.001s
I20260709 13:11:44.060130 29587 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:44.074908 29293 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.109750 29589 tablet_bootstrap.cc:654] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.108896 29680 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:44.117854 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:44.120409 29438 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:44.124125 29822 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:44.125612 29822 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.127666 29822 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.131398 29438 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:11:44.132162 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:44.132296 29822 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:44.136516 29294 catalog_manager.cc:5697] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.156047 29680 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.157234 29680 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.158871 29897 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.159477 29897 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.161806 29897 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.165535 29680 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:44.166278 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:44.168233 29438 leader_election.cc:343] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.171744 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.172708 29469 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:44.193012 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:44.198081 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:44.200922 29826 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.204617 29749 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.205266 29749 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.207623 29749 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.210934 29589 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:44.211694 29589 ts_tablet_manager.cc:1403] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.160s	user 0.045s	sys 0.024s
I20260709 13:11:44.214463 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:44.217092 29749 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:44.220952 29363 leader_election.cc:343] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.219221 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.225518 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:44.228907 29587 tablet_bootstrap.cc:654] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.229067 29826 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:44.236903 29363 leader_election.cc:343] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.239809 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:44.238600 29817 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.245568 29817 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.246287 29739 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:44.252815 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:44.252115 29293 catalog_manager.cc:5697] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:44.254748 29509 leader_election.cc:343] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.259019 29817 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:44.260819 29435 leader_election.cc:343] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.260689 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.261400 29435 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:11:44.262610 29512 leader_election.cc:343] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.263186 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:44.263640 29589 raft_consensus.cc:359] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.264407 29589 raft_consensus.cc:385] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.262662 29897 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:44.264869 29589 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.265508 29817 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:44.265619 29589 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.268862 29749 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.272847 29586 tablet_bootstrap.cc:654] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.288009 29897 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.298168 29749 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.303210 29589 ts_tablet_manager.cc:1434] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:11:44.305519 29589 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:44.306483 29739 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:44.303519 29897 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:11:44.367304 29471 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.369673 29680 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.379725 29754 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.391660 29586 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:44.392266 29586 ts_tablet_manager.cc:1403] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.381s	user 0.013s	sys 0.008s
I20260709 13:11:44.408062 29739 consensus_queue.cc:1048] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.411814 29589 tablet_bootstrap.cc:654] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.433954 29586 raft_consensus.cc:359] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.434808 29586 raft_consensus.cc:385] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.435129 29586 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.435765 29586 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.446826 29754 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.450228 29586 ts_tablet_manager.cc:1434] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:11:44.450529 29587 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:44.451265 29587 ts_tablet_manager.cc:1403] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.392s	user 0.010s	sys 0.013s
I20260709 13:11:44.467341 29586 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:44.480993 29587 raft_consensus.cc:359] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.490768 29587 raft_consensus.cc:385] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.491302 29587 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.503716 29754 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.532732 29749 consensus_queue.cc:1048] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:44.496390 29587 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.548607 29680 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.549355 29680 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.553097 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:44.555895 29509 leader_election.cc:343] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.560642 29587 ts_tablet_manager.cc:1434] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.003s
I20260709 13:11:44.563900 29587 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:44.576260 29680 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:44.577644 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.579222 29471 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:44.581143 29512 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:44.583362 29680 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:44.585083 29680 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.586611 29680 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.593189 29586 tablet_bootstrap.cc:654] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.607435 29680 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.609645 29680 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:44.618997 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:44.618041 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:44.621331 29472 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:44.625016 29509 leader_election.cc:343] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.629022 29589 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:44.629890 29589 ts_tablet_manager.cc:1403] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.325s	user 0.032s	sys 0.031s
I20260709 13:11:44.650662 29589 raft_consensus.cc:359] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.652065 29589 raft_consensus.cc:385] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.652498 29589 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.653255 29589 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.655865 29589 ts_tablet_manager.cc:1434] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:11:44.660961 29587 tablet_bootstrap.cc:654] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.661926 29589 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:44.672152 29472 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:44.673709 29512 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:44.675297 29826 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:44.675843 29826 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:44.677750 29826 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.684240 29586 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:44.684881 29586 ts_tablet_manager.cc:1403] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.222s	user 0.016s	sys 0.000s
I20260709 13:11:44.696517 29589 tablet_bootstrap.cc:654] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.709466 29586 raft_consensus.cc:359] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.710938 29586 raft_consensus.cc:385] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.711427 29586 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.712208 29586 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.717312 29586 ts_tablet_manager.cc:1434] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:11:44.726117 29586 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:44.728437 29587 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:44.729300 29587 ts_tablet_manager.cc:1403] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.166s	user 0.010s	sys 0.006s
I20260709 13:11:44.733106 29587 raft_consensus.cc:359] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.737689 29587 raft_consensus.cc:385] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.738669 29587 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.739673 29587 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.741333 29589 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:44.742120 29589 ts_tablet_manager.cc:1403] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.021s
I20260709 13:11:44.742373 29587 ts_tablet_manager.cc:1434] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:11:44.742241 29821 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.743021 29821 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.743674 29587 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:44.745659 29589 raft_consensus.cc:359] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.746486 29589 raft_consensus.cc:385] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.746821 29589 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.747762 29589 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.748219 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:44.750281 29589 ts_tablet_manager.cc:1434] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:11:44.751762 29589 tablet_bootstrap.cc:492] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
W20260709 13:11:44.753113 29438 leader_election.cc:343] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.746042 29821 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.755511 29586 tablet_bootstrap.cc:654] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.756090 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:44.756922 29396 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:44.758204 29589 tablet_bootstrap.cc:654] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.760224 29435 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:44.760950 29587 tablet_bootstrap.cc:654] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.761401 29821 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:44.770572 29587 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:44.770107 29293 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.773065 29821 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.773581 29821 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.774938 29589 tablet_bootstrap.cc:492] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:44.772442 29680 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.775480 29589 ts_tablet_manager.cc:1403] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:11:44.775441 29680 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.777684 29680 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:44.778578 29589 raft_consensus.cc:359] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.779289 29589 raft_consensus.cc:385] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.779562 29589 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.779695 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.780568 29472 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:44.780462 29589 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.782269 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:44.782835 29589 ts_tablet_manager.cc:1434] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:44.782837 29512 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:11:44.783766 29509 leader_election.cc:343] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.784005 29680 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:44.784171 29589 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:44.784400 29680 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.784759 29680 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.790789 29589 tablet_bootstrap.cc:654] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.795509 29680 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.801700 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:44.802198 29589 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:44.802349 29472 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.802711 29589 ts_tablet_manager.cc:1403] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.005s
I20260709 13:11:44.798094 29586 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:44.803752 29586 ts_tablet_manager.cc:1403] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.006s
I20260709 13:11:44.805470 29589 raft_consensus.cc:359] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.806136 29589 raft_consensus.cc:385] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.806391 29589 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.807240 29680 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:44.807237 29589 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.809311 29472 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:44.809908 29589 ts_tablet_manager.cc:1434] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:11:44.806396 29586 raft_consensus.cc:359] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.801908 29587 ts_tablet_manager.cc:1403] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.005s
I20260709 13:11:44.810344 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:44.810953 29586 raft_consensus.cc:385] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.811136 29589 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
W20260709 13:11:44.812201 29509 leader_election.cc:343] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.815784 29587 raft_consensus.cc:359] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.816640 29587 raft_consensus.cc:385] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.816957 29587 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.811280 29586 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.818780 29587 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.819722 29586 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.820485 29587 ts_tablet_manager.cc:1434] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:44.820983 29589 tablet_bootstrap.cc:654] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.821405 29586 ts_tablet_manager.cc:1434] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:11:44.821543 29587 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:44.824414 29512 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:44.835714 29754 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:44.836299 29754 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:44.837208 29754 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.849207 29821 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.855098 29587 tablet_bootstrap.cc:654] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.886055 29821 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.887040 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:44.887822 29396 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.873164 29586 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:44.883838 29589 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:44.895393 29589 ts_tablet_manager.cc:1403] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.084s	user 0.031s	sys 0.028s
I20260709 13:11:44.899473 29833 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.900810 29739 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.901229 29589 raft_consensus.cc:359] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.909703 29589 raft_consensus.cc:385] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.909288 29833 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.909969 29589 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.912000 29589 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.914960 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.915612 29472 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:44.915784 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:44.916009 29589 ts_tablet_manager.cc:1434] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:11:44.909377 29739 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.917415 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:44.917956 29589 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:44.918519 29739 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.919098 29739 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:44.900923 29293 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.919411 29833 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.919431 29739 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.922087 29739 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.923719 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:44.924435 29546 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:44.924858 29586 tablet_bootstrap.cc:654] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.927917 29587 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:44.928442 29587 ts_tablet_manager.cc:1403] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.011s
I20260709 13:11:44.931878 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.934159 29472 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:44.936276 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:44.939613 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:44.940493 29840 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.931625 29587 raft_consensus.cc:359] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.944670 29587 raft_consensus.cc:385] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.943867 29739 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.948029 29587 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.948964 29587 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:44.937944 29438 leader_election.cc:343] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:44.947378 29589 tablet_bootstrap.cc:654] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.937160 29396 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:44.952171 29587 ts_tablet_manager.cc:1434] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:11:44.952224 29833 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.965924 29586 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:44.973002 29586 ts_tablet_manager.cc:1403] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.017s
I20260709 13:11:44.972568 29833 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.972882 29435 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:44.973961 29821 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:44.974529 29821 raft_consensus.cc:697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:44.975121 29833 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.951056 29840 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:44.975482 29821 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.976938 29587 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:44.978127 29739 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:44.980159 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:44.982272 29586 raft_consensus.cc:359] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.982415 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:44.983114 29586 raft_consensus.cc:385] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:44.983397 29586 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:44.983379 29471 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:44.983958 29587 tablet_bootstrap.cc:654] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:44.984959 29472 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:44.985050 29586 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:44.996582 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:45.000180 29546 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.001703 29586 ts_tablet_manager.cc:1434] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:11:45.002828 29586 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:44.999048 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.021134 29586 tablet_bootstrap.cc:654] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.029680 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:45.032588 29586 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
W20260709 13:11:45.033283 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 46750.1us
W20260709 13:11:45.034523 29363 leader_election.cc:343] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.034808 29840 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.037180 29840 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.037729 29840 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.035441 29922 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.039698 29922 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.033315 29586 ts_tablet_manager.cc:1403] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 13:11:45.049914 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:45.052176 29435 leader_election.cc:343] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.061050 29922 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.063030 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.063869 29543 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:45.065892 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.067263 29921 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.067725 29921 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.067441 29840 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.070668 29840 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.068117 29921 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.080667 29921 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.080150 29293 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.087373 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:45.087527 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:45.088443 29471 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:45.089255 29435 leader_election.cc:343] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.090329 29921 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.095857 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:45.096791 29543 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.103974 29471 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:45.111063 29543 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:45.112778 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.112882 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:45.114195 29921 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.114711 29921 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:45.115787 29921 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.105893 29586 raft_consensus.cc:359] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.121999 29586 raft_consensus.cc:385] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.110255 29472 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:45.108520 29546 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:45.126484 29586 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.127758 29586 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.139012 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:45.139935 29739 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.140707 29739 raft_consensus.cc:697] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:45.141824 29739 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.147500 29586 ts_tablet_manager.cc:1434] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 13:11:45.147806 29589 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.150873 29589 ts_tablet_manager.cc:1403] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.233s	user 0.053s	sys 0.060s
I20260709 13:11:45.154224 29589 raft_consensus.cc:359] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.155313 29589 raft_consensus.cc:385] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.155625 29589 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.149931 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:45.156699 29840 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.157173 29840 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:45.158207 29589 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.158118 29840 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.160024 29589 ts_tablet_manager.cc:1434] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:45.161219 29589 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.155867 29586 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
W20260709 13:11:45.168138 29363 leader_election.cc:343] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.170843 29587 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.171423 29587 ts_tablet_manager.cc:1403] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.195s	user 0.061s	sys 0.058s
I20260709 13:11:45.180647 29589 tablet_bootstrap.cc:654] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.174314 29587 raft_consensus.cc:359] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.187752 29587 raft_consensus.cc:385] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.188064 29587 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.179140 29586 tablet_bootstrap.cc:654] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.175855 29754 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:11:45.189371 29587 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.191870 29587 ts_tablet_manager.cc:1434] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:11:45.200438 29921 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.201511 29587 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:45.201033 29921 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.203572 29921 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.205638 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:45.207358 29435 leader_election.cc:343] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.207655 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.210379 29587 tablet_bootstrap.cc:654] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:45.213111 29438 leader_election.cc:343] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.213553 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.214283 29921 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:45.230736 29680 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:45.238719 29586 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:45.239411 29586 ts_tablet_manager.cc:1403] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.015s
I20260709 13:11:45.240285 29840 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.241045 29840 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.242797 29586 raft_consensus.cc:359] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.243824 29586 raft_consensus.cc:385] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.244107 29589 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.244683 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.244728 29589 ts_tablet_manager.cc:1403] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.000s
W20260709 13:11:45.249768 29363 leader_election.cc:343] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.250880 29840 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.251508 29589 raft_consensus.cc:359] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.252514 29589 raft_consensus.cc:385] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.252871 29589 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.244135 29586 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
W20260709 13:11:45.254427 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:45.196216 29293 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.255535 29586 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.257642 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.259330 29586 ts_tablet_manager.cc:1434] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:11:45.260787 29586 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
W20260709 13:11:45.263006 29363 leader_election.cc:343] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.264125 29363 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:45.266031 29840 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:45.268222 29509 consensus_peers.cc:597] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.255543 29589 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.271936 29292 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.274202 29292 catalog_manager.cc:5697] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.276525 29680 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.277139 29680 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.277920 29589 ts_tablet_manager.cc:1434] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:11:45.279538 29589 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.281253 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:45.282780 29512 leader_election.cc:343] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.283679 29680 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:45.285777 29586 tablet_bootstrap.cc:654] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.297411 29587 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.298017 29587 ts_tablet_manager.cc:1403] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.038s
I20260709 13:11:45.302407 29587 raft_consensus.cc:359] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.303253 29587 raft_consensus.cc:385] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.303506 29587 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.304312 29587 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.305721 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:45.307896 29587 ts_tablet_manager.cc:1434] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:11:45.309099 29587 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:45.312788 29589 tablet_bootstrap.cc:654] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:45.315235 29509 leader_election.cc:343] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.315757 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.315943 29587 tablet_bootstrap.cc:654] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.316560 29826 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:45.336023 29680 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.336305 29589 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.336621 29680 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.338824 29680 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:45.339928 29586 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:45.340632 29586 ts_tablet_manager.cc:1403] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.002s
I20260709 13:11:45.343003 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.337071 29589 ts_tablet_manager.cc:1403] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.000s
I20260709 13:11:45.344375 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:45.345595 29392 raft_consensus.cc:2393] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:45.349325 29512 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.350353 29589 raft_consensus.cc:359] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.350901 29680 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.351236 29589 raft_consensus.cc:385] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.351558 29589 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.352614 29589 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.354027 29586 raft_consensus.cc:359] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.354969 29586 raft_consensus.cc:385] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.355307 29586 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.354969 29589 ts_tablet_manager.cc:1434] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:45.357744 29589 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.356642 29817 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.358378 29817 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.358914 29587 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.359961 29587 ts_tablet_manager.cc:1403] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.021s
I20260709 13:11:45.360958 29817 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:45.361127 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:45.362592 29509 leader_election.cc:343] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.362737 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.363394 29471 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:45.364308 29589 tablet_bootstrap.cc:654] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.364887 29587 raft_consensus.cc:359] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.365618 29587 raft_consensus.cc:385] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.365906 29587 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.366429 29512 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.367275 29826 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.366983 29587 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.367693 29826 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.367599 29586 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.368136 29826 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.369479 29587 ts_tablet_manager.cc:1434] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:45.370523 29587 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:45.370673 29680 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:45.379335 29587 tablet_bootstrap.cc:654] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.379518 29586 ts_tablet_manager.cc:1434] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:11:45.380777 29586 tablet_bootstrap.cc:492] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:45.383399 29826 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.386718 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:45.387245 29826 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:45.388425 29509 leader_election.cc:343] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.389827 29821 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:45.393743 29586 tablet_bootstrap.cc:654] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.394259 29817 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:45.397114 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:45.397776 29471 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.399585 29840 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.400168 29840 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.402549 29840 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.403398 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.404026 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.404119 29468 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:45.404788 29543 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:45.402216 29589 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.405488 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:45.405951 29589 ts_tablet_manager.cc:1403] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.002s
I20260709 13:11:45.406900 29739 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.407325 29739 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.407670 29739 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.411337 29471 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:45.416839 29512 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.417829 29817 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.418324 29817 raft_consensus.cc:697] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:45.419269 29817 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.425417 29739 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.410034 29589 raft_consensus.cc:359] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.429113 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:45.429617 29739 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.430047 29471 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.429349 29589 raft_consensus.cc:385] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.430626 29589 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.432327 29586 tablet_bootstrap.cc:492] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:45.433301 29586 ts_tablet_manager.cc:1403] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.005s
I20260709 13:11:45.438416 29587 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.434514 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:45.457993 29587 ts_tablet_manager.cc:1403] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.004s
I20260709 13:11:45.458170 29543 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.461274 29586 raft_consensus.cc:359] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.462038 29586 raft_consensus.cc:385] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.438602 29471 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:45.463559 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:45.466548 29840 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.433805 29589 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.453262 29294 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:45.467433 29840 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:45.455389 29922 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:45.468335 29840 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.470983 29543 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:45.471586 29589 ts_tablet_manager.cc:1434] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 13:11:45.474342 29589 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.475641 29739 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.476157 29739 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.462332 29586 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.478407 29739 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.479161 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.480006 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.481228 29586 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.483223 29586 ts_tablet_manager.cc:1434] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:11:45.471606 29587 raft_consensus.cc:359] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.481228 29543 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:45.486829 29363 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:45.485222 29587 raft_consensus.cc:385] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.487954 29739 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.487934 29587 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.488785 29586 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:45.489449 29587 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.492142 29587 ts_tablet_manager.cc:1434] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:11:45.493405 29587 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:45.501942 29589 tablet_bootstrap.cc:654] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.513942 29294 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.525876 29739 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:45.541203 29749 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.541793 29749 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.542901 29587 tablet_bootstrap.cc:654] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.547482 29749 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.550235 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.550694 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:45.552359 29363 leader_election.cc:343] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:45.553072 29363 leader_election.cc:343] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.553083 29589 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.553484 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:45.554282 29589 ts_tablet_manager.cc:1403] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.007s
I20260709 13:11:45.557822 29749 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:45.559449 29589 raft_consensus.cc:359] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.559515 29749 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:45.560489 29589 raft_consensus.cc:385] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.560832 29589 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.561563 29589 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.564033 29589 ts_tablet_manager.cc:1434] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:45.567018 29586 tablet_bootstrap.cc:654] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.571260 29589 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.574376 29749 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:45.579658 29587 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.580272 29587 ts_tablet_manager.cc:1403] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.018s
I20260709 13:11:45.582824 29586 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:45.583381 29586 ts_tablet_manager.cc:1403] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.002s
I20260709 13:11:45.583768 29587 raft_consensus.cc:359] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.584553 29587 raft_consensus.cc:385] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.584836 29587 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.585158 29921 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:45.585567 29587 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.586563 29586 raft_consensus.cc:359] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.587280 29586 raft_consensus.cc:385] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.587548 29586 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.588260 29586 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.589406 29587 ts_tablet_manager.cc:1434] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:45.600556 29921 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:45.600471 29587 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:45.606421 29833 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:45.615268 29586 ts_tablet_manager.cc:1434] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:11:45.616675 29586 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:45.618345 29589 tablet_bootstrap.cc:654] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.621657 29587 tablet_bootstrap.cc:654] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:45.633656 29363 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.642040 29586 tablet_bootstrap.cc:654] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.647738 29921 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.648412 29921 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.651856 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:45.652913 29396 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:45.654359 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:45.655264 29812 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.655738 29812 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.656080 29812 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.658737 29922 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.659246 29922 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.660211 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.661485 29922 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:11:45.661710 29438 leader_election.cc:343] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.663828 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:45.665392 29438 leader_election.cc:343] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.655001 29587 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.666337 29587 ts_tablet_manager.cc:1403] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.001s
I20260709 13:11:45.668934 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:45.669705 29921 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.674974 29586 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:45.675554 29586 ts_tablet_manager.cc:1403] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.005s
W20260709 13:11:45.677505 29435 leader_election.cc:343] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.678740 29840 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.679207 29812 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.687085 29586 raft_consensus.cc:359] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.688580 29589 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.692377 29586 raft_consensus.cc:385] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.690418 29435 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:45.690915 29840 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.693105 29589 ts_tablet_manager.cc:1403] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.007s
I20260709 13:11:45.694763 29921 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:45.696091 29840 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.693171 29826 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.695792 29812 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.697017 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:45.696883 29826 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:45.698602 29438 leader_election.cc:343] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.694084 29586 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.700496 29586 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.677618 29587 raft_consensus.cc:359] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.702208 29587 raft_consensus.cc:385] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.701593 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:45.702601 29587 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.703155 29397 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.702592 29826 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:45.703837 29587 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.704737 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.705368 29471 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:45.703353 29586 ts_tablet_manager.cc:1434] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:11:45.706889 29587 ts_tablet_manager.cc:1434] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:11:45.706724 29512 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:45.707650 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.708653 29586 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:45.709893 29587 tablet_bootstrap.cc:492] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:45.707559 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.711861 29471 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:45.707481 29589 raft_consensus.cc:359] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.716482 29589 raft_consensus.cc:385] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.717227 29589 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.718297 29589 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.729784 29589 ts_tablet_manager.cc:1434] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:11:45.730971 29589 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.733798 29397 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:45.725749 29587 tablet_bootstrap.cc:654] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.738996 29589 tablet_bootstrap.cc:654] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.745529 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:45.746714 29897 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.747385 29897 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:11:45.748276 29363 leader_election.cc:343] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.750011 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:45.752677 29589 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.748365 29897 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.771067 29589 ts_tablet_manager.cc:1403] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.000s
I20260709 13:11:45.757177 29587 tablet_bootstrap.cc:492] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.761225 29826 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.774175 29587 ts_tablet_manager.cc:1403] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.007s
I20260709 13:11:45.774477 29826 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.762880 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:45.778882 29826 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.779315 29397 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:45.778206 29587 raft_consensus.cc:359] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.780898 29587 raft_consensus.cc:385] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.781196 29587 raft_consensus.cc:740] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.782128 29397 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.774389 29589 raft_consensus.cc:359] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.782805 29589 raft_consensus.cc:385] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.783159 29589 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.774922 29840 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.783766 29840 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.784179 29840 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.784045 29589 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.785893 29589 ts_tablet_manager.cc:1434] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:45.787091 29589 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.781996 29587 consensus_queue.cc:260] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.794435 29586 tablet_bootstrap.cc:654] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.792276 29812 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.795450 29812 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.798164 29589 tablet_bootstrap.cc:654] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.801040 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:45.800163 29812 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.801785 29587 ts_tablet_manager.cc:1434] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:11:45.802994 29587 tablet_bootstrap.cc:492] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:45.804666 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.801800 29392 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
W20260709 13:11:45.806469 29438 leader_election.cc:343] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.807868 29435 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:45.808717 29812 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:45.809113 29812 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.809448 29812 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.810137 29840 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.812476 29840 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.816031 29826 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.817021 29812 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.818584 29826 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:45.820325 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:45.820802 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:45.821044 29471 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:45.822350 29438 leader_election.cc:343] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.822866 29587 tablet_bootstrap.cc:654] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.823030 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:45.823643 29392 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.825461 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:45.826179 29468 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.827700 29812 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.838371 29471 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:45.839951 29512 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:45.841467 29468 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:45.842417 29680 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.843677 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:45.844115 29292 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.845681 29680 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:45.850574 29680 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.866755 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:45.869673 29833 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.870399 29833 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:45.871524 29833 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.878921 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:45.879931 29396 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:45.883570 29586 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:45.884135 29586 ts_tablet_manager.cc:1403] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.005s
I20260709 13:11:45.887060 29586 raft_consensus.cc:359] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.887760 29586 raft_consensus.cc:385] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.888033 29586 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.890494 29589 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:45.891021 29589 ts_tablet_manager.cc:1403] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.003s
I20260709 13:11:45.898103 29754 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:45.904168 29589 raft_consensus.cc:359] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.905035 29589 raft_consensus.cc:385] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.905310 29589 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.906718 29586 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.906016 29589 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.911665 29586 ts_tablet_manager.cc:1434] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:11:45.923856 29589 ts_tablet_manager.cc:1434] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:11:45.925112 29589 tablet_bootstrap.cc:492] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:45.926324 29586 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
W20260709 13:11:45.930033 29363 leader_election.cc:343] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.937005 29294 catalog_manager.cc:5697] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:45.962124 29509 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.962970 29392 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:45.964399 29435 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:45.964562 29586 tablet_bootstrap.cc:654] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.965138 29922 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:45.965929 29922 raft_consensus.cc:697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:45.966965 29922 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.962285 29589 tablet_bootstrap.cc:654] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:45.939718 29396 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:45.974736 29833 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.975351 29833 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.977610 29833 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:45.980144 29826 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.982298 29587 tablet_bootstrap.cc:492] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:45.982883 29587 ts_tablet_manager.cc:1403] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.180s	user 0.029s	sys 0.060s
I20260709 13:11:45.984205 29754 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.987206 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:45.991673 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:45.992496 29587 raft_consensus.cc:359] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.993312 29587 raft_consensus.cc:385] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:45.993649 29587 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:45.984709 29754 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.997572 29754 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:45.980815 29826 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:45.999372 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:46.000916 29512 leader_election.cc:343] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:45.994575 29587 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.001325 29826 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:46.002712 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:46.003409 29469 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:46.004537 29587 ts_tablet_manager.cc:1434] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:11:46.004660 29512 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:46.005555 29754 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.005924 29587 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:46.006640 29826 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:46.007580 29826 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.008011 29826 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.008674 29812 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.006081 29754 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.009994 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:46.009158 29812 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.013954 29812 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.014148 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.014586 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:46.015829 29435 leader_election.cc:343] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.013559 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:11:46.016393 29438 leader_election.cc:343] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.016903 29438 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:46.018589 29833 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:46.020592 29754 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:46.015370 29293 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.023526 29897 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:46.035085 29739 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:46.039386 29754 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.040603 29754 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.048086 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:46.049023 29469 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:11:46.050395 29754 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:46.032305 29826 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.053362 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.054065 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.055334 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.055904 29587 tablet_bootstrap.cc:654] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.057928 29589 tablet_bootstrap.cc:492] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:46.057932 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:46.058655 29589 ts_tablet_manager.cc:1403] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.000s
I20260709 13:11:46.058701 29472 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.062000 29589 raft_consensus.cc:359] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.062979 29589 raft_consensus.cc:385] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.063280 29589 raft_consensus.cc:740] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.065979 29589 consensus_queue.cc:260] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.070609 29586 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:46.058059 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.071254 29586 ts_tablet_manager.cc:1403] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.159s	user 0.038s	sys 0.026s
I20260709 13:11:46.071422 29587 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:46.073397 29587 ts_tablet_manager.cc:1403] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.004s
I20260709 13:11:46.073486 29472 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:46.074779 29512 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:46.076651 29586 raft_consensus.cc:359] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.077394 29586 raft_consensus.cc:385] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.077675 29586 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.077988 29817 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:46.078565 29817 raft_consensus.cc:697] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:46.079110 29589 ts_tablet_manager.cc:1434] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:11:46.079442 29817 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.080294 29589 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:46.083504 29586 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.092237 29826 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:11:46.100248 29509 leader_election.cc:343] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.101779 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:46.102108 29586 ts_tablet_manager.cc:1434] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:11:46.103149 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:46.103559 29586 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:46.114547 29587 raft_consensus.cc:359] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.125466 29587 raft_consensus.cc:385] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.125779 29587 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.103937 29826 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:46.121685 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:46.126776 29587 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.105504 29817 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.127466 29546 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.115846 29293 catalog_manager.cc:5697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.133574 29589 tablet_bootstrap.cc:654] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.134217 29586 tablet_bootstrap.cc:654] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.137821 29587 ts_tablet_manager.cc:1434] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:11:46.139050 29587 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
W20260709 13:11:46.152686 29509 leader_election.cc:343] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.153281 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:46.156311 29840 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:46.170778 29826 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:46.172029 29509 leader_election.cc:343] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:46.197856 29438 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:46.186791 29817 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:46.215550 29589 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:46.216256 29589 ts_tablet_manager.cc:1403] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.025s
I20260709 13:11:46.220249 29589 raft_consensus.cc:359] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.223253 29589 raft_consensus.cc:385] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.223819 29589 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.220544 29292 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.224629 29589 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.226261 29587 tablet_bootstrap.cc:654] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.235781 29586 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:46.236472 29586 ts_tablet_manager.cc:1403] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.133s	user 0.037s	sys 0.033s
I20260709 13:11:46.235993 29589 ts_tablet_manager.cc:1434] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
W20260709 13:11:46.239220 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 62895.2us
I20260709 13:11:46.266630 29589 tablet_bootstrap.cc:492] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:46.238368 29922 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:11:46.293159 29586 raft_consensus.cc:359] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.294055 29586 raft_consensus.cc:385] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.294366 29586 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.295269 29586 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.280474 29921 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.310694 29586 ts_tablet_manager.cc:1434] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.002s
I20260709 13:11:46.315281 29589 tablet_bootstrap.cc:654] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.308745 29754 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:11:46.308969 29921 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.334074 29586 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:46.349036 29921 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.349491 29587 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:46.350065 29587 ts_tablet_manager.cc:1403] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.211s	user 0.015s	sys 0.016s
I20260709 13:11:46.350371 29840 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.351099 29840 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:46.352337 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:46.352691 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.353374 29392 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:46.355173 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:46.354771 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:46.371840 29471 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:11:46.378031 29922 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:46.378756 29922 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.379233 29922 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.361770 30000 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:11:46.388733 29840 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.391458 29921 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.392234 29921 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.394817 29921 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.398180 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:11:46.400272 29435 leader_election.cc:343] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.403375 29587 raft_consensus.cc:359] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.409190 29587 raft_consensus.cc:385] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.409559 29587 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.410327 29587 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.412184 29587 ts_tablet_manager.cc:1434] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:11:46.412918 29739 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.413282 29587 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:46.405076 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:46.413627 29739 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.416620 29739 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.423303 29589 tablet_bootstrap.cc:492] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:46.424031 29589 ts_tablet_manager.cc:1403] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.177s	user 0.024s	sys 0.030s
I20260709 13:11:46.436501 29922 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.459961 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:46.444893 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:46.460713 29546 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:46.461000 29468 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:46.451798 29997 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:11:46.462643 29922 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.463863 29587 tablet_bootstrap.cc:654] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.439149 29586 tablet_bootstrap.cc:654] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.455034 29589 raft_consensus.cc:359] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.476320 29589 raft_consensus.cc:385] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.476596 29589 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.477316 29589 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.479750 29589 ts_tablet_manager.cc:1434] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:11:46.480796 29589 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
I20260709 13:11:46.455991 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:46.453521 29363 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:46.491110 29739 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.501591 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:46.502462 29396 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.502627 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:46.503350 29544 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:46.507051 29589 tablet_bootstrap.cc:654] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:46.516855 29997 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:46.518543 29922 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.519228 29586 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:46.519178 29922 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.519848 29586 ts_tablet_manager.cc:1403] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.005s
I20260709 13:11:46.527078 29739 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:46.527320 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:46.529724 29739 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:46.530133 29739 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.530516 29739 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.534819 29586 raft_consensus.cc:359] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.535691 29586 raft_consensus.cc:385] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.536000 29586 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.544875 29586 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:46.546929 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 87517.9us
I20260709 13:11:46.547439 29922 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.553356 29438 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:11:46.565744 29438 leader_election.cc:343] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.574657 29739 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.577674 29587 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:46.581746 29587 ts_tablet_manager.cc:1403] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.169s	user 0.035s	sys 0.041s
I20260709 13:11:46.575729 29921 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:46.603842 29391 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.602754 29812 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.603264 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.604058 29921 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.620527 29739 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.625566 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:46.617302 29812 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.629441 29817 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.629942 29812 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:46.630307 29921 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.599949 29396 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:46.649672 29680 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:46.651974 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:46.652601 29546 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:46.654654 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 75319.9us
I20260709 13:11:46.657158 29586 ts_tablet_manager.cc:1434] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.137s	user 0.044s	sys 0.026s
I20260709 13:11:46.636610 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:46.630055 29817 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.682209 29586 tablet_bootstrap.cc:492] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:46.674204 29470 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.709510 29546 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:46.724341 29587 raft_consensus.cc:359] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:46.731269 29587 raft_consensus.cc:385] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:46.731727 29587 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:46.732674 29587 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:46.734349 29435 leader_election.cc:343] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.741323 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:46.744678 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:46.746606 29587 ts_tablet_manager.cc:1434] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.164s	user 0.007s	sys 0.004s
I20260709 13:11:46.748968 29546 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:46.718413 29812 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:11:46.784396 29587 tablet_bootstrap.cc:492] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:46.759138 29543 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:46.794461 29589 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:46.807330 29812 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:46.870165 29589 ts_tablet_manager.cc:1403] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.390s	user 0.018s	sys 0.022s
W20260709 13:11:46.796404 30014 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:11:46.828477 30015 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:11:46.807593 29817 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:46.876181 29812 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:11:46.917811 29438 leader_election.cc:343] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:46.935878 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:46.796377 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:46.952003 29438 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:46.943681 29470 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:47.025090 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:47.002137 30021 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:46.955179 29812 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.053946 30021 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.079218 29586 tablet_bootstrap.cc:654] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:47.074868 30021 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:47.098488 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:47.112310 29589 raft_consensus.cc:359] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.113508 29589 raft_consensus.cc:385] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:47.113864 29589 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:47.114840 29589 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.137042 29589 ts_tablet_manager.cc:1434] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.261s	user 0.009s	sys 0.000s
I20260709 13:11:47.120222 29833 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:47.138371 29589 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Bootstrap starting.
W20260709 13:11:47.160037 29921 consensus_meta.cc:287] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.001s
I20260709 13:11:47.160766 29921 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.180341 30012 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:47.186666 29391 consensus_meta.cc:287] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.582s	user 0.002s	sys 0.012s
I20260709 13:11:47.193601 29587 tablet_bootstrap.cc:654] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:47.181195 30012 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:47.200691 29438 leader_election.cc:343] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:47.222368 29897 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:11:47.220147 29826 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.232393 29812 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.232185 29826 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.232923 29812 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.233299 29921 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:47.237035 29812 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:47.255407 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:47.255771 30012 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:47.256320 29469 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:47.242981 29826 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:47.229796 29833 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:47.197628 30021 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.269279 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:47.270314 29390 raft_consensus.cc:2393] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:47.282135 29826 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:47.284247 30029 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.086s	user 0.004s	sys 0.000s
I20260709 13:11:47.303171 29586 tablet_bootstrap.cc:492] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:47.304172 29586 ts_tablet_manager.cc:1403] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.629s	user 0.018s	sys 0.030s
I20260709 13:11:47.325157 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:47.330960 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:47.334364 30021 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:47.334659 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:47.350418 29589 tablet_bootstrap.cc:654] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:47.305377 29833 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.340546 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:47.354975 30036 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:47.356835 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.010s	sys 0.013s
W20260709 13:11:47.357208 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.010s	sys 0.013s
W20260709 13:11:47.357825 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 616616us
W20260709 13:11:47.360247 29509 leader_election.cc:343] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:47.365069 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:47.366400 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:47.366575 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:47.370833 29294 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.372570 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:11:47.378410 29435 leader_election.cc:343] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:47.379997 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:47.384140 29587 tablet_bootstrap.cc:492] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:47.384956 29587 ts_tablet_manager.cc:1403] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.607s	user 0.015s	sys 0.010s
I20260709 13:11:47.386355 30026 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:47.388971 29363 leader_election.cc:343] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:47.391320 29435 leader_election.cc:343] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:47.396921 29587 raft_consensus.cc:359] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.401348 29587 raft_consensus.cc:385] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:47.401757 29587 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:47.404767 29587 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:47.407559 29363 leader_election.cc:343] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:47.401842 29435 leader_election.cc:343] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:47.408591 29363 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:11:47.408978 29435 leader_election.cc:343] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:47.416232 30040 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:47.419561 29587 ts_tablet_manager.cc:1434] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.003s
I20260709 13:11:47.423463 29586 raft_consensus.cc:359] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.425508 29586 raft_consensus.cc:385] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:47.425843 29586 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:47.426623 29586 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.432121 29587 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:47.436920 29586 ts_tablet_manager.cc:1434] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.132s	user 0.006s	sys 0.003s
I20260709 13:11:47.438159 29586 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:47.453143 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:47.465667 30022 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:47.466256 30022 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.466704 30022 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:47.467262 29438 leader_election.cc:343] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:47.468638 29438 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:47.467912 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:47.475673 29537 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:47.504558 29589 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: No bootstrap required, opened a new log
I20260709 13:11:47.508257 29589 ts_tablet_manager.cc:1403] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent bootstrapping tablet: real 0.370s	user 0.023s	sys 0.010s
I20260709 13:11:47.479550 29921 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:47.516745 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:47.519690 29539 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:47.520478 29587 tablet_bootstrap.cc:654] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:47.542361 29826 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.552713 29826 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.540999 30022 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:47.580864 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:47.585147 29589 raft_consensus.cc:359] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.586061 29589 raft_consensus.cc:385] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:47.586885 30022 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:47.586346 29589 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:47.596187 29826 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:47.615267 29586 tablet_bootstrap.cc:654] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:47.617878 29589 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.663806 29589 ts_tablet_manager.cc:1434] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent starting tablet: real 0.155s	user 0.007s	sys 0.001s
I20260709 13:11:47.663201 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:47.659835 29537 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:47.682142 29587 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:47.682778 29587 ts_tablet_manager.cc:1403] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.256s	user 0.026s	sys 0.009s
I20260709 13:11:47.670452 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:47.678510 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:47.685781 29468 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:47.686061 29469 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:47.679997 29396 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 0.
I20260709 13:11:47.689227 29539 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:47.703214 29468 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:47.725598 29512 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:47.726879 29438 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:47.730906 29438 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:47.732426 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:11:47.737850 29812 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:47.738363 29812 raft_consensus.cc:697] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:47.750448 30030 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:47.751269 30030 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:47.752477 30030 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.739182 29812 consensus_queue.cc:237] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.768915 29587 raft_consensus.cc:359] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.769747 29587 raft_consensus.cc:385] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:47.770035 29587 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:47.772396 29587 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.747670 29817 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:47.767197 30042 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:47.787585 30026 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:47.793035 30042 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.793562 30042 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:47.798430 29586 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:47.799057 29586 ts_tablet_manager.cc:1403] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.361s	user 0.038s	sys 0.007s
W20260709 13:11:47.800220 29438 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:47.839869 29586 raft_consensus.cc:359] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.841446 29586 raft_consensus.cc:385] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:47.841712 29586 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:47.842300 29586 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:11:47.862982 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 121688us
I20260709 13:11:47.866199 29749 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:47.832862 30042 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.867328 29587 ts_tablet_manager.cc:1434] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.184s	user 0.008s	sys 0.000s
I20260709 13:11:47.868649 29587 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:47.870004 29586 ts_tablet_manager.cc:1434] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:11:47.872454 30042 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:47.872670 29586 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:47.879614 29817 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:47.894130 29817 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:47.897881 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:47.898674 29392 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:47.950414 29586 tablet_bootstrap.cc:654] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:47.954280 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 51768.7us
I20260709 13:11:47.963613 29392 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:47.975878 29587 tablet_bootstrap.cc:654] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:47.970140 30030 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.011790 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:47.983405 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:11:48.017231 30065 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:48.035061 29509 leader_election.cc:343] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:48.009635 30030 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.031610 30024 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:48.070034 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 95396.3us
I20260709 13:11:48.067876 30024 raft_consensus.cc:697] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:11:48.086023 30024 consensus_queue.cc:237] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.096062 30030 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:48.082114 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:48.100570 29464 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:48.122793 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:48.124011 29390 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 0.
I20260709 13:11:48.131570 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:48.141315 29680 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.142000 29680 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.145648 29680 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:48.156239 29922 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:48.156829 29922 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.173373 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:48.176496 29739 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.177104 29739 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.158741 29922 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:48.185343 29587 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:48.185976 29587 ts_tablet_manager.cc:1403] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.318s	user 0.013s	sys 0.014s
I20260709 13:11:48.186568 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:48.191030 29292 catalog_manager.cc:5697] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:48.197672 29438 leader_election.cc:343] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:48.179603 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:48.204926 29739 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:48.189075 30012 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:48.224614 29435 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.247417 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 58811.4us
I20260709 13:11:48.225941 29587 raft_consensus.cc:359] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.255544 29587 raft_consensus.cc:385] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:48.255941 29587 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:48.258291 29587 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.218353 29464 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:11:48.269598 29586 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:48.278906 29586 ts_tablet_manager.cc:1403] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.406s	user 0.028s	sys 0.009s
I20260709 13:11:48.278077 29587 ts_tablet_manager.cc:1434] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.092s	user 0.018s	sys 0.003s
I20260709 13:11:48.283293 29587 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:48.293143 29922 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.312304 29922 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:48.313093 29391 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:48.315025 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:11:48.321952 29390 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:48.324941 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:48.325788 29546 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:48.331660 29509 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:48.327920 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:48.351513 29586 raft_consensus.cc:359] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.352573 29586 raft_consensus.cc:385] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:48.352936 29586 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
W20260709 13:11:48.351542 29438 leader_election.cc:343] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:48.366530 30025 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:48.374058 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54078.7us
I20260709 13:11:48.364027 29586 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.399490 29586 ts_tablet_manager.cc:1434] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.003s
I20260709 13:11:48.410331 29587 tablet_bootstrap.cc:654] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:48.414354 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:48.416990 29586 tablet_bootstrap.cc:492] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:48.456583 29539 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:48.456827 30000 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:48.460065 29897 consensus_queue.cc:1048] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:48.460465 30017 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:48.473352 30021 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:48.482064 29390 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:11:48.511220 29586 tablet_bootstrap.cc:654] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:48.515033 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:48.516410 30071 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:48.517062 30071 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:11:48.517970 30071 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.565023 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:11:48.565814 29739 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:48.586288 29754 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:48.592691 29587 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:48.593693 29587 ts_tablet_manager.cc:1403] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.311s	user 0.018s	sys 0.014s
W20260709 13:11:48.602681 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.620193 29293 catalog_manager.cc:5697] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.622161 29293 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:48.626734 30084 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:11:48.664110 29540 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:48.741812 29587 raft_consensus.cc:359] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.742625 29587 raft_consensus.cc:385] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:48.742901 29587 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:48.752314 29754 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:48.764688 29343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:48.769904 29586 tablet_bootstrap.cc:492] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:48.770551 29586 ts_tablet_manager.cc:1403] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.359s	user 0.048s	sys 0.060s
I20260709 13:11:48.799525 29587 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.802238 29587 ts_tablet_manager.cc:1434] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.208s	user 0.009s	sys 0.000s
I20260709 13:11:48.803457 29587 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: Bootstrap starting.
I20260709 13:11:48.808666 30024 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.809304 30024 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.812795 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:48.815989 30028 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.816586 30028 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.829445 30028 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:48.850572 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:11:48.830789 30024 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:48.861972 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:11:48.862993 29389 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 1: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:11:48.867300 29587 tablet_bootstrap.cc:654] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:48.870977 29586 raft_consensus.cc:359] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.871804 29586 raft_consensus.cc:385] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:48.872098 29586 raft_consensus.cc:740] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:48.872857 29586 consensus_queue.cc:260] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:48.879040 29586 ts_tablet_manager.cc:1434] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.002s
W20260709 13:11:48.882342 29363 leader_election.cc:343] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:48.886201 29293 catalog_manager.cc:5697] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.888672 29293 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.892392 29586 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Bootstrap starting.
I20260709 13:11:48.897322 29509 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:11:48.905894 30002 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:48.982956 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:11:48.983711 29466 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 0.
I20260709 13:11:48.989703 29586 tablet_bootstrap.cc:654] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:49.005302 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:11:49.006412 30063 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:49.006891 30063 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.007230 30063 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:49.014125 30017 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:49.024801 30002 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:49.030860 29292 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.070602 30063 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:49.072207 29587 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: No bootstrap required, opened a new log
I20260709 13:11:49.072877 29587 ts_tablet_manager.cc:1403] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent bootstrapping tablet: real 0.270s	user 0.012s	sys 0.005s
I20260709 13:11:49.075279 30063 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:49.075129 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:11:49.076179 29470 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:49.081947 29470 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:49.083920 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:11:49.084618 30063 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:49.087960 30063 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:11:49.088917 30063 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:49.092932 29587 raft_consensus.cc:359] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:49.093861 29587 raft_consensus.cc:385] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:49.094146 29587 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.100466 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:11:49.100422 29587 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:49.105836 29537 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:49.106890 29587 ts_tablet_manager.cc:1434] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 13:11:49.113937 29586 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: No bootstrap required, opened a new log
I20260709 13:11:49.114596 29586 ts_tablet_manager.cc:1403] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Time spent bootstrapping tablet: real 0.222s	user 0.021s	sys 0.008s
I20260709 13:11:49.114993 30017 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:49.117843 29586 raft_consensus.cc:359] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:49.118609 29586 raft_consensus.cc:385] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:49.118873 29586 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.119547 29586 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:11:49.122622 29586 ts_tablet_manager.cc:1434] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:49.128746 29537 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:11:49.162843 29295 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.292114 29390 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:49.468969 29392 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:49.598788 30063 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:49.619752 30076 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:50.588342 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:50.629133 30115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.629056 30114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.631899 30117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:50.633543 28250 server_base.cc:1061] running on GCE node
I20260709 13:11:50.636161 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:50.636431 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:50.636653 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602710636628 us; error 0 us; skew 500 ppm
I20260709 13:11:50.637432 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:50.641754 28250 webserver.cc:533] Webserver started at http://127.27.150.132:40965/ using document root <none> and password file <none>
I20260709 13:11:50.642378 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:50.642665 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:50.643059 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:50.645259 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-3-root/instance:
uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-nvvq"
I20260709 13:11:50.653139 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:50.657644 30122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:50.659212 28250 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:11:50.659629 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-3-root
uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-nvvq"
I20260709 13:11:50.659978 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:50.685418 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:50.689831 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:50.695480 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:50.698817 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:50.699203 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:50.699558 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:50.699851 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:50.773288 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.132:38609
I20260709 13:11:50.773646 30184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.132:38609 every 8 connection(s)
I20260709 13:11:50.778201 28250 auto_leader_rebalancer-test.cc:384] add a tserver: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:50.795791 30185 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35447
I20260709 13:11:50.796969 30185 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:50.798127 30185 heartbeater.cc:507] Master 127.27.150.190:35447 requested a full tablet report, sending...
I20260709 13:11:50.801172 29295 ts_manager.cc:194] Registered new tserver with Master: c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:11:50.803109 29295 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60116
I20260709 13:11:51.023886 29537 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.033245 29470 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:51.035501 30002 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.037431 29392 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:51.043030 30002 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:51.056931 29509 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c1e2c054c694186bc648342e40f4d3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:51.059079 30000 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.061398 29470 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.061044 29392 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.107499 29295 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.145419 29470 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.155987 29541 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:51.160660 30017 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.161286 29392 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:51.167770 30017 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:51.182202 29435 consensus_peers.cc:597] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d3e26705f6f42428e0c9830d7dbedb6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:51.196095 30017 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.199453 29390 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.206512 29541 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.229221 29463 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.284823 29390 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:51.286278 29546 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:51.286636 29435 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6194a4e996b4050bfb519664b72df1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:51.292606 29292 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.308414 30017 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.311740 30017 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:11:51.331003 30017 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.353914 29390 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.371755 29546 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.388990 29292 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.418942 29390 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.429317 29463 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:51.429786 29546 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:51.431782 30063 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.432905 30214 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.450860 30063 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:11:51.453933 29360 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bfd9651b2124a8580054a3a43fff99d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:51.453488 29463 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.457122 29546 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.480080 29292 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:51.616999 30221 ts_tablet_manager.cc:933] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:51.626148 30221 tablet_copy_client.cc:323] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:11:51.659435 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 5c1e2c054c694186bc648342e40f4d3b from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:11:51.660066 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 5c1e2c054c694186bc648342e40f4d3b from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-5c1e2c054c694186bc648342e40f4d3b
I20260709 13:11:51.667668 29556 tablet_copy_source_session.cc:215] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:51.671639 30221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e2c054c694186bc648342e40f4d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.690670 30221 tablet_copy_client.cc:806] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:51.691440 30221 tablet_copy_client.cc:670] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:51.695853 30221 tablet_copy_client.cc:538] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:51.704782 30221 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:51.738560 30221 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:51.739781 30221 tablet_bootstrap.cc:492] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:51.740597 30221 ts_tablet_manager.cc:1403] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.018s
I20260709 13:11:51.748353 30221 raft_consensus.cc:359] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.749320 30221 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:51.749974 30221 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.753329 30185 heartbeater.cc:499] Master 127.27.150.190:35447 was elected leader, sending a full tablet report...
I20260709 13:11:51.754096 30221 ts_tablet_manager.cc:1434] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:11:51.756186 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5c1e2c054c694186bc648342e40f4d3b received from {username='slave'} at 127.0.0.1:51828
I20260709 13:11:51.756708 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5c1e2c054c694186bc648342e40f4d3b on tablet 5c1e2c054c694186bc648342e40f4d3b with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:51.761605 30221 ts_tablet_manager.cc:933] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:51.786099 30221 tablet_copy_client.cc:323] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:11:51.788414 30227 ts_tablet_manager.cc:933] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:51.796005 30227 tablet_copy_client.cc:323] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:11:51.808310 29482 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet a6194a4e996b4050bfb519664b72df1c from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:11:51.808590 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 5d3e26705f6f42428e0c9830d7dbedb6 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:11:51.809075 29482 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet a6194a4e996b4050bfb519664b72df1c from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-a6194a4e996b4050bfb519664b72df1c
I20260709 13:11:51.811055 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 5d3e26705f6f42428e0c9830d7dbedb6 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-5d3e26705f6f42428e0c9830d7dbedb6
I20260709 13:11:51.817991 29482 tablet_copy_source_session.cc:215] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:51.821908 30221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6194a4e996b4050bfb519664b72df1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.825101 29481 tablet_copy_source_session.cc:215] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:51.829372 30227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3e26705f6f42428e0c9830d7dbedb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.839648 30221 tablet_copy_client.cc:806] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:51.840412 30221 tablet_copy_client.cc:670] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:51.844525 30221 tablet_copy_client.cc:538] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:51.854367 30221 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:51.885843 30227 tablet_copy_client.cc:806] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:51.886595 30227 tablet_copy_client.cc:670] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:51.890973 30227 tablet_copy_client.cc:538] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:51.892697 30221 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:51.897202 30221 tablet_bootstrap.cc:492] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:51.898016 30221 ts_tablet_manager.cc:1403] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.015s
I20260709 13:11:51.901309 30221 raft_consensus.cc:359] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.904431 30221 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:51.905138 30221 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.907233 30227 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:51.924968 30221 ts_tablet_manager.cc:1434] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:11:51.929144 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-a6194a4e996b4050bfb519664b72df1c received from {username='slave'} at 127.0.0.1:39036
I20260709 13:11:51.929697 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-a6194a4e996b4050bfb519664b72df1c on tablet a6194a4e996b4050bfb519664b72df1c with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:51.945268 30227 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:51.946425 30227 tablet_bootstrap.cc:492] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:51.947253 30227 ts_tablet_manager.cc:1403] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.014s
I20260709 13:11:51.953264 30227 raft_consensus.cc:359] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.954424 30227 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:51.955343 30227 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:51.958101 30227 ts_tablet_manager.cc:1434] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:11:51.961498 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5d3e26705f6f42428e0c9830d7dbedb6 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:11:51.962026 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5d3e26705f6f42428e0c9830d7dbedb6 on tablet 5d3e26705f6f42428e0c9830d7dbedb6 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:52.005056 30227 ts_tablet_manager.cc:933] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:11:52.010526 30227 tablet_copy_client.cc:323] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:11:52.021621 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet 5bfd9651b2124a8580054a3a43fff99d from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:11:52.022297 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet 5bfd9651b2124a8580054a3a43fff99d from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-5bfd9651b2124a8580054a3a43fff99d
I20260709 13:11:52.030038 29407 tablet_copy_source_session.cc:215] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:52.033387 30227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfd9651b2124a8580054a3a43fff99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:52.050362 30227 tablet_copy_client.cc:806] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:52.051077 30227 tablet_copy_client.cc:670] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:52.055104 30227 tablet_copy_client.cc:538] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:52.067447 30227 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:52.089402 30227 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:52.090590 30227 tablet_bootstrap.cc:492] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:52.091342 30227 ts_tablet_manager.cc:1403] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 13:11:52.094712 30227 raft_consensus.cc:359] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:52.095779 30227 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:52.096458 30227 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:52.099071 30227 ts_tablet_manager.cc:1434] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:11:52.104744 30160 raft_consensus.cc:1217] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:52.115870 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5bfd9651b2124a8580054a3a43fff99d received from {username='slave'} at 127.0.0.1:47726
I20260709 13:11:52.116496 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5bfd9651b2124a8580054a3a43fff99d on tablet 5bfd9651b2124a8580054a3a43fff99d with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:52.365576 30160 raft_consensus.cc:1217] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:52.365985 30159 raft_consensus.cc:1217] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:52.599205 30159 raft_consensus.cc:1217] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:52.670154 30113 raft_consensus.cc:1064] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:52.673573 30113 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:52.683054 30159 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:52.683594 29470 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:52.684749 29395 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:52.684782 30113 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.686151 30002 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.687094 30000 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.723800 30002 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.725966 30160 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.743268 29467 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.759786 29390 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.763805 29294 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.786789 30211 raft_consensus.cc:1064] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:52.789951 30211 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:52.818650 30160 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:52.845772 29546 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:52.853133 30209 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.871709 30160 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:52.877341 30000 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:52.887281 29541 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:52.891980 30002 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.896394 30209 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.898394 30160 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.874289 29392 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:52.904275 30000 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:52.908689 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c1e2c054c694186bc648342e40f4d3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:52.911772 29392 raft_consensus.cc:2955] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.924139 29292 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:52.959537 29295 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 5c1e2c054c694186bc648342e40f4d3b with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
W20260709 13:11:52.982801 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 127675us
I20260709 13:11:52.987219 29390 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:52.987365 30249 raft_consensus.cc:1064] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:52.991922 30249 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:53.014515 29537 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:53.017232 30209 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:53.065464 30159 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:53.066102 29390 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:53.111536 30211 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:53.112901 30247 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:53.129194 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 55930.5us
I20260709 13:11:53.129822 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c1e2c054c694186bc648342e40f4d3b with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:11:53.141525 30189 raft_consensus.cc:1064] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:53.145102 30189 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:53.159358 30160 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:53.161026 30063 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:53.169486 29546 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:53.180233 30258 tablet_replica.cc:333] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:11:53.181691 30258 raft_consensus.cc:2243] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.182550 30258 raft_consensus.cc:2272] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.189427 30063 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:53.193266 30258 ts_tablet_manager.cc:1916] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:53.200660 30247 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:53.203022 30247 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.207787 30158 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.225454 29537 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.239034 30258 ts_tablet_manager.cc:1929] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:53.239809 30258 log.cc:1199] T 5c1e2c054c694186bc648342e40f4d3b P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/5c1e2c054c694186bc648342e40f4d3b
I20260709 13:11:53.241816 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 5c1e2c054c694186bc648342e40f4d3b (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:53.239383 29292 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:53.264322 29470 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:53.305011 30211 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.321897 29470 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:53.338008 29546 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:53.339643 30250 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:53.339892 30159 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.342561 30160 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:53.352478 29540 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.348723 29537 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.371902 30250 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:53.338055 29390 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.350222 30209 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:11:53.417246 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 125216us
I20260709 13:11:53.418938 30189 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:53.418704 30160 raft_consensus.cc:2955] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.434403 29292 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.440243 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d3e26705f6f42428e0c9830d7dbedb6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:53.452473 29294 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.454901 30189 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.473948 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d3e26705f6f42428e0c9830d7dbedb6 with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:11:53.492039 29470 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:53.504865 30267 tablet_replica.cc:333] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:11:53.507162 30159 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.517635 30267 raft_consensus.cc:2243] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.518612 30160 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:53.521282 29392 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:53.521842 30267 pending_rounds.cc:70] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Trying to abort 1 pending ops.
I20260709 13:11:53.522275 30267 pending_rounds.cc:77] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636711580614656 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } } }
I20260709 13:11:53.524338 30267 raft_consensus.cc:2917] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:11:53.525144 30267 raft_consensus.cc:2889] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:11:53.525636 30267 raft_consensus.cc:2272] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.526353 30250 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:53.528463 30250 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:53.530652 30267 ts_tablet_manager.cc:1916] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:53.535856 29463 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.553063 30249 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.556567 29295 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:53.564546 30160 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.563761 29392 raft_consensus.cc:2955] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:11:53.628600 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 43539.8us
I20260709 13:11:53.675751 30267 ts_tablet_manager.cc:1929] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:53.676553 30267 log.cc:1199] T 5d3e26705f6f42428e0c9830d7dbedb6 P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/5d3e26705f6f42428e0c9830d7dbedb6
I20260709 13:11:53.696619 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 5d3e26705f6f42428e0c9830d7dbedb6 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:53.720731 29389 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:11:53.737898 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 193685us
I20260709 13:11:53.769701 29540 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.772071 30160 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:53.785252 29292 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.786031 30063 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:53.789921 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6194a4e996b4050bfb519664b72df1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:53.817863 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet a6194a4e996b4050bfb519664b72df1c with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
W20260709 13:11:53.819252 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 56218.3us
I20260709 13:11:53.824330 30265 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.841566 30160 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.874106 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5bfd9651b2124a8580054a3a43fff99d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:53.884298 30275 tablet_replica.cc:333] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:11:53.885663 30275 raft_consensus.cc:2243] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:53.887071 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 44726.5us
I20260709 13:11:53.890806 29537 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:53.896761 29295 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:53.912354 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bfd9651b2124a8580054a3a43fff99d with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:11:53.886392 30275 raft_consensus.cc:2272] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.937517 30112 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:53.953187 30275 ts_tablet_manager.cc:1916] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:53.964584 29537 raft_consensus.cc:2955] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:53.967391 30276 tablet_replica.cc:333] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:11:53.968559 30276 raft_consensus.cc:2243] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.969321 30276 raft_consensus.cc:2272] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.992770 30275 ts_tablet_manager.cc:1929] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:53.993456 30275 log.cc:1199] T a6194a4e996b4050bfb519664b72df1c P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/a6194a4e996b4050bfb519664b72df1c
I20260709 13:11:53.995698 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet a6194a4e996b4050bfb519664b72df1c (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:53.996584 30276 ts_tablet_manager.cc:1916] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:54.030815 30276 ts_tablet_manager.cc:1929] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:54.031348 30276 log.cc:1199] T 5bfd9651b2124a8580054a3a43fff99d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/5bfd9651b2124a8580054a3a43fff99d
I20260709 13:11:54.033325 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 5bfd9651b2124a8580054a3a43fff99d (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:54.984148 29537 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:54.990973 29464 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:54.991542 29509 consensus_peers.cc:597] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c21d46fd7a440b09555995fc5c75ad3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.991812 29388 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:54.992575 30278 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.993510 30268 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.003093 30268 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.006057 29388 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.007870 29464 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.023018 29295 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.029534 29392 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:55.049531 29540 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:55.052701 30112 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:55.095636 29360 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3890858f888845ec958c83aa9b1ccf5d. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:55.116416 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59324.9us
I20260709 13:11:55.122605 29464 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:55.125922 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 60973.1us
I20260709 13:11:55.136780 30189 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:55.139992 29537 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.140153 30284 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.158524 29392 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:55.161029 29292 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.184548 29464 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:11:55.207535 29360 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c40cc430e0bf4a5f946bc53291d0b771. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.212172 29467 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:55.214947 29537 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:55.215523 30189 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.219352 30189 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.228538 30189 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.230479 29467 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.232604 29537 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.250258 29294 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.251576 29537 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:11:55.275034 29509 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71fb5043e48f4e1a86ec8d962d18b0b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.280894 29392 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:55.282496 29467 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:55.283095 30278 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.284054 30268 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.294296 30283 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.296073 29470 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.298708 29388 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:55.314807 29294 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.520449 30306 ts_tablet_manager.cc:933] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:55.522817 30306 tablet_copy_client.cc:323] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:11:55.524560 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 6c21d46fd7a440b09555995fc5c75ad3 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:11:55.525064 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 6c21d46fd7a440b09555995fc5c75ad3 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-6c21d46fd7a440b09555995fc5c75ad3
I20260709 13:11:55.531073 29556 tablet_copy_source_session.cc:215] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:55.534615 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c21d46fd7a440b09555995fc5c75ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.552454 30306 tablet_copy_client.cc:806] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:55.553237 30306 tablet_copy_client.cc:670] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:55.557472 30308 ts_tablet_manager.cc:933] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:11:55.557483 30306 tablet_copy_client.cc:538] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:55.559691 30308 tablet_copy_client.cc:323] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:11:55.561228 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet 3890858f888845ec958c83aa9b1ccf5d from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:11:55.561712 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet 3890858f888845ec958c83aa9b1ccf5d from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-3890858f888845ec958c83aa9b1ccf5d
I20260709 13:11:55.567335 29407 tablet_copy_source_session.cc:215] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:55.567871 30306 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:55.570366 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3890858f888845ec958c83aa9b1ccf5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:55.712193 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52878.2us
I20260709 13:11:55.795888 30313 ts_tablet_manager.cc:933] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
W20260709 13:11:55.811538 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 156828us
I20260709 13:11:55.832852 30313 tablet_copy_client.cc:323] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:11:55.849030 30308 tablet_copy_client.cc:806] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:55.850831 30308 tablet_copy_client.cc:670] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:55.851405 30306 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:55.852552 30306 tablet_bootstrap.cc:492] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:55.853418 30306 ts_tablet_manager.cc:1403] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.286s	user 0.111s	sys 0.151s
I20260709 13:11:55.857023 30306 raft_consensus.cc:359] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:55.857962 30306 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:55.858753 30306 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:55.863180 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet c40cc430e0bf4a5f946bc53291d0b771 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:11:55.863907 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet c40cc430e0bf4a5f946bc53291d0b771 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-c40cc430e0bf4a5f946bc53291d0b771
I20260709 13:11:55.872466 29407 tablet_copy_source_session.cc:215] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:55.875556 30306 ts_tablet_manager.cc:1434] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.007s
I20260709 13:11:55.875862 30308 tablet_copy_client.cc:538] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:55.878911 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-6c21d46fd7a440b09555995fc5c75ad3 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:11:55.879444 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-6c21d46fd7a440b09555995fc5c75ad3 on tablet 6c21d46fd7a440b09555995fc5c75ad3 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:55.885411 30313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40cc430e0bf4a5f946bc53291d0b771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.894721 30306 ts_tablet_manager.cc:933] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:55.901738 30308 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:55.912125 30313 tablet_copy_client.cc:806] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:55.913583 30313 tablet_copy_client.cc:670] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:55.921731 30306 tablet_copy_client.cc:323] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:11:55.924605 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 71fb5043e48f4e1a86ec8d962d18b0b4 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:11:55.925149 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 71fb5043e48f4e1a86ec8d962d18b0b4 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-71fb5043e48f4e1a86ec8d962d18b0b4
I20260709 13:11:55.929527 30313 tablet_copy_client.cc:538] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:55.945017 30313 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:55.954542 29556 tablet_copy_source_session.cc:215] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:55.967028 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fb5043e48f4e1a86ec8d962d18b0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.981415 30308 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:55.982630 30308 tablet_bootstrap.cc:492] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:55.983567 30308 ts_tablet_manager.cc:1403] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.019s
I20260709 13:11:55.987042 30308 raft_consensus.cc:359] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:55.989142 30308 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:55.990131 30308 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:55.994225 30313 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:55.995690 30313 tablet_bootstrap.cc:492] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:55.996544 30313 ts_tablet_manager.cc:1403] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.009s
I20260709 13:11:56.007193 30308 ts_tablet_manager.cc:1434] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:11:55.999816 30313 raft_consensus.cc:359] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:56.012428 30313 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:56.014240 30313 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:56.016532 30159 raft_consensus.cc:1217] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:56.021906 30313 ts_tablet_manager.cc:1434] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.007s
I20260709 13:11:56.030098 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-3890858f888845ec958c83aa9b1ccf5d received from {username='slave'} at 127.0.0.1:47726
I20260709 13:11:56.030625 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-3890858f888845ec958c83aa9b1ccf5d on tablet 3890858f888845ec958c83aa9b1ccf5d with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:56.034866 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-c40cc430e0bf4a5f946bc53291d0b771 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:11:56.035318 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-c40cc430e0bf4a5f946bc53291d0b771 on tablet c40cc430e0bf4a5f946bc53291d0b771 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:56.047988 30159 raft_consensus.cc:1217] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:56.065884 30306 tablet_copy_client.cc:806] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:56.066670 30306 tablet_copy_client.cc:670] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:56.070983 30306 tablet_copy_client.cc:538] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:56.081507 30306 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:56.104664 30306 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:56.106410 30306 tablet_bootstrap.cc:492] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:56.107281 30306 ts_tablet_manager.cc:1403] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.005s
I20260709 13:11:56.110627 30306 raft_consensus.cc:359] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:56.111584 30306 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:56.112263 30306 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:56.114916 30306 ts_tablet_manager.cc:1434] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:56.116758 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-71fb5043e48f4e1a86ec8d962d18b0b4 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:11:56.117187 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-71fb5043e48f4e1a86ec8d962d18b0b4 on tablet 71fb5043e48f4e1a86ec8d962d18b0b4 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:56.333909 30159 raft_consensus.cc:1217] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:56.400285 30303 raft_consensus.cc:1064] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:56.403622 30303 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:56.410015 30159 raft_consensus.cc:1217] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:56.428848 30159 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.430536 29467 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.432049 30304 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.434717 29392 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.444114 30304 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.446242 30304 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:11:56.494745 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 53458.7us
I20260709 13:11:56.507548 30322 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.518234 29467 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.515369 30159 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.539234 29388 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.544445 29292 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.593516 29540 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:56.608299 30159 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:56.609036 29467 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:56.609802 30322 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:56.610824 30304 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:56.620425 30283 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.624055 30159 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.627614 29467 raft_consensus.cc:2955] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.635066 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c21d46fd7a440b09555995fc5c75ad3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:56.642271 30302 raft_consensus.cc:1064] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:56.645373 30302 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:56.646639 29294 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.662559 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c21d46fd7a440b09555995fc5c75ad3 with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:11:56.670042 30331 tablet_replica.cc:333] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:11:56.671419 30331 raft_consensus.cc:2243] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.673636 30331 raft_consensus.cc:2272] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.683831 30331 ts_tablet_manager.cc:1916] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:56.702220 30159 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.705279 30285 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.726691 29540 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.728544 30292 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:56.731652 30331 ts_tablet_manager.cc:1929] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:56.732300 30331 log.cc:1199] T 6c21d46fd7a440b09555995fc5c75ad3 P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/6c21d46fd7a440b09555995fc5c75ad3
I20260709 13:11:56.734251 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 6c21d46fd7a440b09555995fc5c75ad3 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:56.738070 29464 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.740222 30302 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.760265 30285 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.768961 29540 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.768147 29464 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.775435 30159 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.783990 29294 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.801113 29388 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:56.813475 29467 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:56.824172 30160 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:56.827102 30302 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:56.829212 30302 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:56.839246 30158 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.840595 30285 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.866484 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c40cc430e0bf4a5f946bc53291d0b771 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:56.866848 29294 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.879774 30302 raft_consensus.cc:1064] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:56.883613 30302 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:56.877826 29464 raft_consensus.cc:2955] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:56.890549 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet c40cc430e0bf4a5f946bc53291d0b771 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:11:56.916354 30322 raft_consensus.cc:1064] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:56.919540 30322 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:56.924461 30158 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.927595 30341 tablet_replica.cc:333] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:11:56.928128 30338 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.932124 29546 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.934419 29464 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.939472 30159 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.942305 29464 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.946902 30304 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:56.947256 30336 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.949739 30283 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:56.941215 30341 raft_consensus.cc:2243] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.960695 30338 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:56.968571 30341 raft_consensus.cc:2272] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.971449 29392 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:56.981771 30323 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:56.987586 30341 ts_tablet_manager.cc:1916] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:57.028030 30341 ts_tablet_manager.cc:1929] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:57.028570 30341 log.cc:1199] T c40cc430e0bf4a5f946bc53291d0b771 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/c40cc430e0bf4a5f946bc53291d0b771
I20260709 13:11:57.027501 30304 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.030216 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet c40cc430e0bf4a5f946bc53291d0b771 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:57.036294 29388 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.045542 30302 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.048375 29546 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.064250 30158 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.081279 29294 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.072834 29463 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.103590 30159 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.107203 29464 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.149981 29293 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.166872 29392 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:57.172304 30158 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:57.174074 30302 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:57.178483 29463 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:57.184294 30338 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:57.187381 30302 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.188649 30159 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.195223 29537 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:57.209249 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3890858f888845ec958c83aa9b1ccf5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:57.210744 30158 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:57.214254 29463 raft_consensus.cc:2955] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.217293 30349 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:57.219071 29295 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.218062 29388 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:57.233304 30323 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:57.249362 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 3890858f888845ec958c83aa9b1ccf5d with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:11:57.251055 30341 tablet_replica.cc:333] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:11:57.250898 30322 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.252322 30341 raft_consensus.cc:2243] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.253213 30341 raft_consensus.cc:2272] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.257309 30341 ts_tablet_manager.cc:1916] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:57.284444 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71fb5043e48f4e1a86ec8d962d18b0b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:57.297020 29392 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.299353 29295 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.309125 30341 ts_tablet_manager.cc:1929] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:57.312307 30158 raft_consensus.cc:2955] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:11:57.331692 30341 log.cc:1199] T 3890858f888845ec958c83aa9b1ccf5d P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/3890858f888845ec958c83aa9b1ccf5d
I20260709 13:11:57.333735 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 3890858f888845ec958c83aa9b1ccf5d (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:57.354512 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 71fb5043e48f4e1a86ec8d962d18b0b4 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:11:57.375767 30351 tablet_replica.cc:333] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:11:57.377135 30351 raft_consensus.cc:2243] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.377987 30351 raft_consensus.cc:2272] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.383034 30351 ts_tablet_manager.cc:1916] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:57.398727 30351 ts_tablet_manager.cc:1929] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:57.399127 30351 log.cc:1199] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/71fb5043e48f4e1a86ec8d962d18b0b4
I20260709 13:11:57.400619 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 71fb5043e48f4e1a86ec8d962d18b0b4 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:11:58.449149 29546 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:58.456928 29395 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:58.457314 29509 consensus_peers.cc:597] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22f2621d025741fcb1f7e73ad1af2f4f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.458786 29466 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:58.459772 30322 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.462446 30283 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.476140 29395 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.476753 29464 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.475523 30322 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.501834 29294 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.507185 29464 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:11:58.518560 29435 consensus_peers.cc:597] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a79c5f3852446bd956bcf002f2bd78c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.519832 29537 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:58.521132 29388 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:58.521585 30274 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:11:58.524382 30337 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.537585 30274 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.545338 29546 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.556758 29388 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.558980 29395 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:58.560739 29292 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.582974 29546 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:58.584373 29360 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59bfc5123acd4083b0f36af624300133. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.586555 30339 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.591192 29463 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:58.601881 30302 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:58.613133 30367 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.616377 29464 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.615059 29546 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.639153 29292 catalog_manager.cc:5697] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.643601 29463 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:58.666591 29388 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:58.666956 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91c368d56c234a6ea4e13263c724dbda. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.668126 29546 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:58.668340 30337 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.669778 30364 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.691264 30365 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.693194 29537 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.729187 29388 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.747730 29294 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:11:58.950937 30374 ts_tablet_manager.cc:933] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:58.953177 30374 tablet_copy_client.cc:323] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:11:58.954952 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 6a79c5f3852446bd956bcf002f2bd78c from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:11:58.955456 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 6a79c5f3852446bd956bcf002f2bd78c from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-6a79c5f3852446bd956bcf002f2bd78c
I20260709 13:11:58.963497 29481 tablet_copy_source_session.cc:215] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:58.966598 30374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a79c5f3852446bd956bcf002f2bd78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.984720 30374 tablet_copy_client.cc:806] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:58.985426 30374 tablet_copy_client.cc:670] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:58.989630 30374 tablet_copy_client.cc:538] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:58.997967 30374 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:59.019735 30374 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:59.020874 30374 tablet_bootstrap.cc:492] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:59.021754 30374 ts_tablet_manager.cc:1403] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.024s	user 0.026s	sys 0.001s
I20260709 13:11:59.024482 30374 raft_consensus.cc:359] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.025218 30374 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:59.025918 30374 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.029844 30374 ts_tablet_manager.cc:1434] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:11:59.031906 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-6a79c5f3852446bd956bcf002f2bd78c received from {username='slave'} at 127.0.0.1:39036
I20260709 13:11:59.032356 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-6a79c5f3852446bd956bcf002f2bd78c on tablet 6a79c5f3852446bd956bcf002f2bd78c with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:59.040763 30374 ts_tablet_manager.cc:933] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:11:59.065543 30378 ts_tablet_manager.cc:933] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:11:59.067510 30374 tablet_copy_client.cc:323] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:11:59.074754 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet 59bfc5123acd4083b0f36af624300133 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:11:59.075415 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet 59bfc5123acd4083b0f36af624300133 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-59bfc5123acd4083b0f36af624300133
I20260709 13:11:59.076483 30378 tablet_copy_client.cc:323] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:11:59.083333 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 22f2621d025741fcb1f7e73ad1af2f4f from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:11:59.083969 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 22f2621d025741fcb1f7e73ad1af2f4f from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-22f2621d025741fcb1f7e73ad1af2f4f
I20260709 13:11:59.089247 29407 tablet_copy_source_session.cc:215] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:59.093492 30374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bfc5123acd4083b0f36af624300133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:59.102254 29556 tablet_copy_source_session.cc:215] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:59.109622 30378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f2621d025741fcb1f7e73ad1af2f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:59.124441 30374 tablet_copy_client.cc:806] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:59.125255 30374 tablet_copy_client.cc:670] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:59.129830 30374 tablet_copy_client.cc:538] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:59.136441 30378 tablet_copy_client.cc:806] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:59.137338 30378 tablet_copy_client.cc:670] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:59.142083 30374 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:59.144059 30378 tablet_copy_client.cc:538] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:59.160651 30378 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:59.170389 30374 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:59.171679 30374 tablet_bootstrap.cc:492] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:59.172559 30374 ts_tablet_manager.cc:1403] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:11:59.176290 30374 raft_consensus.cc:359] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.177270 30374 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:59.178040 30374 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.194144 30374 ts_tablet_manager.cc:1434] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.004s
I20260709 13:11:59.216356 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-59bfc5123acd4083b0f36af624300133 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:11:59.216892 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-59bfc5123acd4083b0f36af624300133 on tablet 59bfc5123acd4083b0f36af624300133 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:59.222954 30378 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:59.224328 30378 tablet_bootstrap.cc:492] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:59.226267 30378 ts_tablet_manager.cc:1403] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.013s
I20260709 13:11:59.229784 30378 raft_consensus.cc:359] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.230703 30378 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:59.231438 30378 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.233898 30378 ts_tablet_manager.cc:1434] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:59.239435 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-22f2621d025741fcb1f7e73ad1af2f4f received from {username='slave'} at 127.0.0.1:51828
I20260709 13:11:59.239928 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-22f2621d025741fcb1f7e73ad1af2f4f on tablet 22f2621d025741fcb1f7e73ad1af2f4f with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:59.271899 30378 ts_tablet_manager.cc:933] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:11:59.273873 30378 tablet_copy_client.cc:323] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:11:59.276453 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 91c368d56c234a6ea4e13263c724dbda from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:11:59.277053 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 91c368d56c234a6ea4e13263c724dbda from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-91c368d56c234a6ea4e13263c724dbda
I20260709 13:11:59.286063 29481 tablet_copy_source_session.cc:215] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:59.289541 30378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c368d56c234a6ea4e13263c724dbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:59.308532 30378 tablet_copy_client.cc:806] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:59.309552 30378 tablet_copy_client.cc:670] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:59.313079 30378 tablet_copy_client.cc:538] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:59.325344 30378 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:11:59.348012 30378 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:59.348969 30378 tablet_bootstrap.cc:492] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:11:59.349635 30378 ts_tablet_manager.cc:1403] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:11:59.352743 30378 raft_consensus.cc:359] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.353420 30378 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:11:59.354056 30378 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:11:59.357391 30378 ts_tablet_manager.cc:1434] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:11:59.359493 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-91c368d56c234a6ea4e13263c724dbda received from {username='slave'} at 127.0.0.1:39036
I20260709 13:11:59.359964 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-91c368d56c234a6ea4e13263c724dbda on tablet 91c368d56c234a6ea4e13263c724dbda with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:11:59.455004 30158 raft_consensus.cc:1217] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:59.477857 30158 raft_consensus.cc:1217] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:59.538295 30158 raft_consensus.cc:1217] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:59.880304 30159 raft_consensus.cc:1217] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:59.896596 30274 raft_consensus.cc:1064] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:11:59.904603 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 71932.9us
I20260709 13:11:59.930982 30390 raft_consensus.cc:1064] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:11:59.940613 30390 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:11:59.993537 30274 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:00.042182 30387 raft_consensus.cc:1064] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:00.046140 30387 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:00.054343 29466 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.055766 30159 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.056113 30388 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.062610 30390 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.077509 29541 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.082329 29392 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.083046 30337 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.085500 30158 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.087591 30337 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.111855 30283 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.116242 29395 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.118366 30389 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.179962 30389 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.184319 30158 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.206619 29541 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.228300 30390 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.233743 30156 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.235055 29395 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.240592 29294 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.261824 29388 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.277482 30158 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.279573 29542 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.281629 30339 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.303406 29464 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.307233 30339 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:00.310148 30339 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:00.330061 29464 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.373948 30339 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.376948 30159 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.487789 29292 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.387411 29470 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.515592 29466 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:00.524948 29542 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:00.530933 30274 raft_consensus.cc:1064] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:00.535382 30158 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.537070 30353 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:00.534265 30274 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:00.540491 29464 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.549052 30356 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:00.548026 30353 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.549796 30158 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.561008 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22f2621d025741fcb1f7e73ad1af2f4f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:00.564795 30159 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.569851 29542 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.574455 30337 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.574136 29466 raft_consensus.cc:2955] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.577373 29292 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.576037 30389 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.573616 29294 catalog_manager.cc:5697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.595731 29542 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.609073 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 22f2621d025741fcb1f7e73ad1af2f4f with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:12:00.629702 30337 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.631145 30159 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.650794 29541 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.653637 30158 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.656306 30274 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:00.656873 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a79c5f3852446bd956bcf002f2bd78c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:00.658041 29389 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:00.664753 29541 raft_consensus.cc:2955] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.667265 30365 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.668552 30274 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:00.653762 30412 tablet_replica.cc:333] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:12:00.683476 30412 raft_consensus.cc:2243] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.685154 30412 raft_consensus.cc:2272] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.700476 30412 ts_tablet_manager.cc:1916] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:00.745801 30337 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.749185 30158 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.750298 29395 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.754733 29294 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.772572 30412 ts_tablet_manager.cc:1929] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:00.773285 30412 log.cc:1199] T 22f2621d025741fcb1f7e73ad1af2f4f P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/22f2621d025741fcb1f7e73ad1af2f4f
I20260709 13:12:00.779686 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 22f2621d025741fcb1f7e73ad1af2f4f (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:00.793346 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a79c5f3852446bd956bcf002f2bd78c with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:12:00.797780 29395 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:00.803283 29541 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.808091 30159 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.810173 29542 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.812686 30412 tablet_replica.cc:333] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:12:00.813964 30412 raft_consensus.cc:2243] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:00.814744 30412 raft_consensus.cc:2272] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.815184 30339 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.810005 29292 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.821065 30387 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.849064 30387 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.854810 29466 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:00.855331 30158 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.860507 29541 raft_consensus.cc:2955] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.865703 30159 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.866277 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 59bfc5123acd4083b0f36af624300133 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:00.872438 29391 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:00.873355 29291 catalog_manager.cc:5697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.876397 30389 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.842502 30412 ts_tablet_manager.cc:1916] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:00.879760 30389 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:00.886798 30337 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.905222 30159 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.908977 29391 raft_consensus.cc:2955] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:00.911326 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 59bfc5123acd4083b0f36af624300133 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:12:00.935572 30416 tablet_replica.cc:333] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:12:00.975093 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 91c368d56c234a6ea4e13263c724dbda with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:00.988082 29293 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:01.005810 30412 ts_tablet_manager.cc:1929] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:01.010694 30416 raft_consensus.cc:2243] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.013396 30416 raft_consensus.cc:2272] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.015731 30412 log.cc:1199] T 6a79c5f3852446bd956bcf002f2bd78c P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/6a79c5f3852446bd956bcf002f2bd78c
I20260709 13:12:01.018512 30416 ts_tablet_manager.cc:1916] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:01.017850 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 6a79c5f3852446bd956bcf002f2bd78c (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:01.030401 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 91c368d56c234a6ea4e13263c724dbda with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:01.049285 30417 tablet_replica.cc:333] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:12:01.050854 30417 raft_consensus.cc:2243] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.051780 30417 raft_consensus.cc:2272] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.055656 30417 ts_tablet_manager.cc:1916] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:01.063413 30416 ts_tablet_manager.cc:1929] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:01.064049 30416 log.cc:1199] T 59bfc5123acd4083b0f36af624300133 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/59bfc5123acd4083b0f36af624300133
I20260709 13:12:01.066215 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 59bfc5123acd4083b0f36af624300133 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:01.073915 30417 ts_tablet_manager.cc:1929] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:01.074422 30417 log.cc:1199] T 91c368d56c234a6ea4e13263c724dbda P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/91c368d56c234a6ea4e13263c724dbda
I20260709 13:12:01.076208 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 91c368d56c234a6ea4e13263c724dbda (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:02.124095 29463 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:02.131357 29435 consensus_peers.cc:597] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2992ae50b9804afb8a7cfe63feb5bf34. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:02.131497 29546 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:02.133150 30389 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.133638 29389 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:02.135471 30389 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.147128 30419 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.148743 29541 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.159274 29391 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.176625 29463 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.178678 29291 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:12:02.190207 29435 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb7c51305cb0421f843fcf7f543b7163. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:02.190603 29391 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:02.191581 29541 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:02.193097 30337 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.195577 30389 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.212253 30389 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.214664 29391 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.236414 29541 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.249776 29541 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.279023 29294 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.303889 29463 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:02.305426 29509 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d6296aca66540dc81b696ae74a6fd42. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:02.306677 29391 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:02.308801 30388 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.310482 30390 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.321599 30388 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.322340 29391 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.322635 29463 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.344156 29291 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.351845 29391 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:02.379652 29360 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36373f233812459591c31993a4959894. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:02.387979 29541 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:02.389736 30391 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.386929 29463 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:02.396287 30391 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.404696 30391 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.407800 29546 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.420989 29463 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.428604 29294 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:02.631888 30439 ts_tablet_manager.cc:933] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:02.634456 30439 tablet_copy_client.cc:323] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:02.637424 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet cb7c51305cb0421f843fcf7f543b7163 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:02.638057 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet cb7c51305cb0421f843fcf7f543b7163 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-cb7c51305cb0421f843fcf7f543b7163
I20260709 13:12:02.666383 29481 tablet_copy_source_session.cc:215] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:02.673194 30441 ts_tablet_manager.cc:933] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:02.693248 30439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7c51305cb0421f843fcf7f543b7163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.735780 30441 tablet_copy_client.cc:323] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:02.737936 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 2992ae50b9804afb8a7cfe63feb5bf34 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:02.738983 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 2992ae50b9804afb8a7cfe63feb5bf34 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-2992ae50b9804afb8a7cfe63feb5bf34
I20260709 13:12:02.759510 30444 ts_tablet_manager.cc:933] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:02.762799 30439 tablet_copy_client.cc:806] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:02.763640 30439 tablet_copy_client.cc:670] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:02.774375 30444 tablet_copy_client.cc:323] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:12:02.781383 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 2d6296aca66540dc81b696ae74a6fd42 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:12:02.782084 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 2d6296aca66540dc81b696ae74a6fd42 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-2d6296aca66540dc81b696ae74a6fd42
I20260709 13:12:02.783005 29481 tablet_copy_source_session.cc:215] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:02.784570 30439 tablet_copy_client.cc:538] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:02.792048 30441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2992ae50b9804afb8a7cfe63feb5bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.798743 29556 tablet_copy_source_session.cc:215] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:02.800832 30439 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:02.802911 30444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6296aca66540dc81b696ae74a6fd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.822098 30444 tablet_copy_client.cc:806] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:02.822824 30444 tablet_copy_client.cc:670] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:02.837750 30444 tablet_copy_client.cc:538] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:02.848297 30439 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:02.849525 30439 tablet_bootstrap.cc:492] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:02.851140 30439 ts_tablet_manager.cc:1403] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.003s
I20260709 13:12:02.851769 30444 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:02.854835 30439 raft_consensus.cc:359] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.857138 30439 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:02.857905 30439 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.874606 30441 tablet_copy_client.cc:806] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:02.875536 30441 tablet_copy_client.cc:670] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:02.882221 30441 tablet_copy_client.cc:538] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:02.895071 30447 ts_tablet_manager.cc:933] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:12:02.901223 30439 ts_tablet_manager.cc:1434] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.050s	user 0.024s	sys 0.021s
I20260709 13:12:02.903491 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-cb7c51305cb0421f843fcf7f543b7163 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:02.904194 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-cb7c51305cb0421f843fcf7f543b7163 on tablet cb7c51305cb0421f843fcf7f543b7163 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:02.906150 30447 tablet_copy_client.cc:323] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:12:02.908890 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet 36373f233812459591c31993a4959894 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:12:02.909209 30441 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:02.909550 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet 36373f233812459591c31993a4959894 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-36373f233812459591c31993a4959894
I20260709 13:12:02.915037 30444 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:02.916124 30444 tablet_bootstrap.cc:492] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:02.916895 30444 ts_tablet_manager.cc:1403] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.003s
I20260709 13:12:02.920533 30444 raft_consensus.cc:359] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.921903 30444 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:02.922680 30444 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.926281 30444 ts_tablet_manager.cc:1434] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:12:02.928469 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-2d6296aca66540dc81b696ae74a6fd42 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:12:02.928959 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-2d6296aca66540dc81b696ae74a6fd42 on tablet 2d6296aca66540dc81b696ae74a6fd42 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:02.939117 29407 tablet_copy_source_session.cc:215] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:02.943572 30447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36373f233812459591c31993a4959894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.954622 30441 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:02.958720 30441 tablet_bootstrap.cc:492] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:02.959581 30441 ts_tablet_manager.cc:1403] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.007s
I20260709 13:12:02.963850 30441 raft_consensus.cc:359] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.964928 30441 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:02.966827 30441 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:02.968744 30447 tablet_copy_client.cc:806] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:02.969439 30447 tablet_copy_client.cc:670] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:02.971415 30441 ts_tablet_manager.cc:1434] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:12:02.973438 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-2992ae50b9804afb8a7cfe63feb5bf34 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:02.973918 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-2992ae50b9804afb8a7cfe63feb5bf34 on tablet 2992ae50b9804afb8a7cfe63feb5bf34 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:02.985437 30447 tablet_copy_client.cc:538] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:02.997845 30447 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:03.031884 30447 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:03.033385 30447 tablet_bootstrap.cc:492] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:03.034198 30447 ts_tablet_manager.cc:1403] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.017s
I20260709 13:12:03.037613 30447 raft_consensus.cc:359] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:03.038692 30447 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:03.039665 30447 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:03.055446 30447 ts_tablet_manager.cc:1434] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.014s
I20260709 13:12:03.078114 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-36373f233812459591c31993a4959894 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:12:03.078832 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-36373f233812459591c31993a4959894 on tablet 36373f233812459591c31993a4959894 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:03.140291 30158 raft_consensus.cc:1217] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:03.160646 30158 raft_consensus.cc:1217] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:03.329136 30158 raft_consensus.cc:1217] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:03.385915 30158 raft_consensus.cc:1217] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:03.570392 30456 raft_consensus.cc:1064] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:03.573608 30456 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:03.583539 30158 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.584671 29541 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.585819 30337 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.587217 29395 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.587728 30389 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.598066 30337 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:12:03.604146 30337 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.606273 29541 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.627166 30159 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.640241 29293 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:03.646555 29390 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.698694 30337 raft_consensus.cc:1064] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:03.698814 29463 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:03.706266 30337 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:03.723702 30159 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:03.727589 30419 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:03.728945 29542 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:03.739759 30389 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:03.834904 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 89533us
W20260709 13:12:03.856269 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 113931us
I20260709 13:12:03.863991 30389 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.883963 29541 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.883282 29546 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.888852 30158 raft_consensus.cc:2955] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.897432 30159 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.902731 29391 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.903803 30389 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:03.903863 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2992ae50b9804afb8a7cfe63feb5bf34 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:03.908362 30389 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.911857 29292 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:12:03.927440 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 48302.2us
I20260709 13:12:03.931326 30471 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:03.953464 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 2992ae50b9804afb8a7cfe63feb5bf34 with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:12:03.954185 30388 raft_consensus.cc:1064] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:03.957278 30388 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:03.959964 30474 tablet_replica.cc:333] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:12:03.963445 30474 raft_consensus.cc:2243] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.964385 30474 raft_consensus.cc:2272] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.966297 30387 raft_consensus.cc:1064] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:03.969637 30474 ts_tablet_manager.cc:1916] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:03.971027 30387 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:03.970408 30389 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.980974 30158 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.982012 29466 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.981208 29546 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:03.983428 30390 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.985733 30390 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.994257 29395 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:03.997762 30388 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:04.004195 29391 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.015293 30474 ts_tablet_manager.cc:1929] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:04.015883 30474 log.cc:1199] T 2992ae50b9804afb8a7cfe63feb5bf34 P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/2992ae50b9804afb8a7cfe63feb5bf34
I20260709 13:12:04.017827 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 2992ae50b9804afb8a7cfe63feb5bf34 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:04.017192 30388 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.022456 29463 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.025095 29541 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:04.026846 29395 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.029505 30158 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:04.030475 30391 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:04.032383 30455 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:04.035140 29466 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:04.036768 30455 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:04.052326 30158 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.056137 29292 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.058079 29292 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.071557 30387 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.078243 29541 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.085873 29466 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.090317 30158 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.115090 29466 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:04.149060 29389 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:04.149058 30158 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:04.141983 29293 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.155246 30470 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:04.159266 30337 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:04.172281 30471 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.176394 30158 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.184448 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb7c51305cb0421f843fcf7f543b7163 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:04.192924 30159 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:12:04.217108 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 51930.1us
I20260709 13:12:04.230526 29541 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:04.240864 29391 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:04.246527 29389 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:04.248231 30390 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:04.248008 29292 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.255905 30158 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:04.257614 30387 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:04.260757 29389 raft_consensus.cc:2955] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.265055 29542 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:04.269840 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet cb7c51305cb0421f843fcf7f543b7163 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:04.269269 30455 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.270943 30388 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.278620 30485 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:04.280244 30486 tablet_replica.cc:333] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:12:04.278329 30158 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.282804 30486 raft_consensus.cc:2243] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:04.287060 30486 raft_consensus.cc:2272] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:04.292593 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36373f233812459591c31993a4959894 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:04.292793 29542 raft_consensus.cc:2955] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.297325 30486 ts_tablet_manager.cc:1916] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:04.300395 29389 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.258962 30159 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:04.314080 29293 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.321106 30466 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:04.333024 30486 ts_tablet_manager.cc:1929] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:04.338379 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 36373f233812459591c31993a4959894 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:12:04.339291 30486 log.cc:1199] T cb7c51305cb0421f843fcf7f543b7163 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/cb7c51305cb0421f843fcf7f543b7163
I20260709 13:12:04.337647 30159 raft_consensus.cc:2955] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.346665 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d6296aca66540dc81b696ae74a6fd42 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:04.350695 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet cb7c51305cb0421f843fcf7f543b7163 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:04.353634 30487 tablet_replica.cc:333] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:12:04.370415 30487 raft_consensus.cc:2243] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:04.371703 30487 raft_consensus.cc:2272] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:04.372753 29293 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:04.383342 30487 ts_tablet_manager.cc:1916] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:04.408994 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d6296aca66540dc81b696ae74a6fd42 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:12:04.417415 30487 ts_tablet_manager.cc:1929] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:04.417914 30487 log.cc:1199] T 36373f233812459591c31993a4959894 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/36373f233812459591c31993a4959894
I20260709 13:12:04.419613 30487 tablet_replica.cc:333] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:12:04.419574 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 36373f233812459591c31993a4959894 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:04.420519 30487 raft_consensus.cc:2243] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:04.421288 30487 raft_consensus.cc:2272] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:04.423950 30487 ts_tablet_manager.cc:1916] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:04.436110 30487 ts_tablet_manager.cc:1929] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:04.436594 30487 log.cc:1199] T 2d6296aca66540dc81b696ae74a6fd42 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/2d6296aca66540dc81b696ae74a6fd42
I20260709 13:12:04.438202 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 2d6296aca66540dc81b696ae74a6fd42 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:05.476016 29466 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:05.483199 29435 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1016126be7f841c4acc0cd897e5df0c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.483812 29546 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:05.483929 29389 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:05.485735 30471 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:05.486774 30470 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.497319 30492 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.499948 29395 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.501847 29546 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.532783 29293 catalog_manager.cc:5697] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.557055 29466 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:05.567083 29435 consensus_peers.cc:597] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ad87ed6ec2e4df0b1a1f4bde07cb53e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.567083 29546 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:05.567852 29391 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:05.569181 30492 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.570279 30470 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:05.588203 30471 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.590314 29389 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.592571 29546 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.614193 29546 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:05.616396 29291 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:12:05.621976 29509 consensus_peers.cc:597] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57af445de910412cb7903ef2bf682013. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.622167 29389 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:05.623709 29466 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:05.625222 30488 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:12:05.636606 30488 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.664099 30467 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.665685 29389 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.667505 29466 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.688265 29293 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.692155 29463 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:05.699391 29546 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:05.700228 29389 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:05.700310 29435 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 184cb00180cf42c7b6803577c868b1dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.701148 30471 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.702301 30493 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.725085 30492 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.726768 29541 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.728227 29390 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:05.757504 29293 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.996342 30509 ts_tablet_manager.cc:933] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:05.998575 30509 tablet_copy_client.cc:323] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:06.000643 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 1016126be7f841c4acc0cd897e5df0c3 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:06.001216 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 1016126be7f841c4acc0cd897e5df0c3 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-1016126be7f841c4acc0cd897e5df0c3
I20260709 13:12:06.008705 29481 tablet_copy_source_session.cc:215] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:06.012316 30509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1016126be7f841c4acc0cd897e5df0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.030193 30509 tablet_copy_client.cc:806] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:06.030902 30509 tablet_copy_client.cc:670] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:06.031744 30511 ts_tablet_manager.cc:933] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:06.036301 30509 tablet_copy_client.cc:538] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:06.040926 30511 tablet_copy_client.cc:323] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:06.043151 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:06.043772 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-8ad87ed6ec2e4df0b1a1f4bde07cb53e
I20260709 13:12:06.049176 30509 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:06.088883 30509 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:06.090016 30509 tablet_bootstrap.cc:492] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:06.090920 30509 ts_tablet_manager.cc:1403] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.014s
I20260709 13:12:06.094827 30509 raft_consensus.cc:359] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.095798 30509 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:06.096810 30509 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.100301 29481 tablet_copy_source_session.cc:215] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:06.207773 30511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.287652 30509 ts_tablet_manager.cc:1434] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.196s	user 0.047s	sys 0.082s
I20260709 13:12:06.312079 30518 ts_tablet_manager.cc:933] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:06.322427 30518 tablet_copy_client.cc:323] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:12:06.323313 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-1016126be7f841c4acc0cd897e5df0c3 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:06.323877 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-1016126be7f841c4acc0cd897e5df0c3 on tablet 1016126be7f841c4acc0cd897e5df0c3 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:06.323535 30516 ts_tablet_manager.cc:933] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:06.328791 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 57af445de910412cb7903ef2bf682013 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:12:06.329408 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 57af445de910412cb7903ef2bf682013 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-57af445de910412cb7903ef2bf682013
I20260709 13:12:06.335377 30511 tablet_copy_client.cc:806] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:06.336076 30511 tablet_copy_client.cc:670] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:06.339035 29556 tablet_copy_source_session.cc:215] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:06.343945 30511 tablet_copy_client.cc:538] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:06.348194 30516 tablet_copy_client.cc:323] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:06.349426 30518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57af445de910412cb7903ef2bf682013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.350416 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 184cb00180cf42c7b6803577c868b1dd from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:06.351082 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 184cb00180cf42c7b6803577c868b1dd from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-184cb00180cf42c7b6803577c868b1dd
I20260709 13:12:06.367062 29481 tablet_copy_source_session.cc:215] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:06.369508 30518 tablet_copy_client.cc:806] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:06.370290 30518 tablet_copy_client.cc:670] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:06.372488 30516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184cb00180cf42c7b6803577c868b1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.374312 30511 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:06.374634 30518 tablet_copy_client.cc:538] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:06.385846 30518 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:06.412536 30516 tablet_copy_client.cc:806] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:06.421540 30516 tablet_copy_client.cc:670] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:06.427080 30516 tablet_copy_client.cc:538] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:06.430552 30159 raft_consensus.cc:1217] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:06.431478 30518 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:06.432726 30518 tablet_bootstrap.cc:492] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:06.433597 30518 ts_tablet_manager.cc:1403] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.009s
I20260709 13:12:06.448464 30511 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:06.453553 30511 tablet_bootstrap.cc:492] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:06.454584 30511 ts_tablet_manager.cc:1403] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.081s	user 0.023s	sys 0.014s
I20260709 13:12:06.451924 30516 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:06.445559 30518 raft_consensus.cc:359] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.459012 30518 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:06.459929 30518 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.465296 30518 ts_tablet_manager.cc:1434] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.006s
I20260709 13:12:06.467216 30511 raft_consensus.cc:359] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.469295 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-57af445de910412cb7903ef2bf682013 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:12:06.478853 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-57af445de910412cb7903ef2bf682013 on tablet 57af445de910412cb7903ef2bf682013 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:06.478842 30511 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:06.479899 30511 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.482745 30511 ts_tablet_manager.cc:1434] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:12:06.489319 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-8ad87ed6ec2e4df0b1a1f4bde07cb53e received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:06.489991 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-8ad87ed6ec2e4df0b1a1f4bde07cb53e on tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:06.504034 30159 raft_consensus.cc:1217] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:06.518108 30516 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:06.519531 30516 tablet_bootstrap.cc:492] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:06.521394 30516 ts_tablet_manager.cc:1403] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.017s
I20260709 13:12:06.525883 30516 raft_consensus.cc:359] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.527107 30516 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:06.527896 30516 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:06.529982 30516 ts_tablet_manager.cc:1434] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:06.534408 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-184cb00180cf42c7b6803577c868b1dd received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:06.534981 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-184cb00180cf42c7b6803577c868b1dd on tablet 184cb00180cf42c7b6803577c868b1dd with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:06.643734 30158 raft_consensus.cc:1217] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:06.676090 30158 raft_consensus.cc:1217] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:06.990346 30492 raft_consensus.cc:1064] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:06.995118 30492 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.006040 30159 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.007854 30526 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.008247 29541 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.008407 29389 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.009721 30493 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.011814 30493 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.026304 30526 raft_consensus.cc:1064] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:07.029421 30526 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.050997 30493 raft_consensus.cc:1064] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:07.061025 30493 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.067319 30158 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.068225 29390 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.069725 30492 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.072155 30492 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.080526 29546 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.082369 30526 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:07.100852 30534 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.109877 29390 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.109054 30531 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.111080 29391 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.115891 30160 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.118685 29541 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.120169 30533 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.121447 30493 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.123276 30158 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.131495 30533 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:07.147922 29390 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.164418 30159 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.171120 29545 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.175690 29291 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.181355 29292 catalog_manager.cc:5697] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.192260 29546 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.194492 30531 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.197448 29538 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.215150 29391 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.251219 30159 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.287348 30515 raft_consensus.cc:1064] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:07.315418 29294 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.316636 30515 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.329898 29463 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.330107 29470 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.336153 30160 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.341989 29538 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.347294 30526 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:07.350597 30160 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.351042 30531 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:07.360420 30531 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:07.364336 29391 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.362236 30532 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.368856 30158 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.397881 29538 raft_consensus.cc:2955] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.395244 30526 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:12:07.431102 29470 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.432157 29391 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.433962 30548 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.432782 30158 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:07.440611 30548 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:07.439929 30492 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.452052 30505 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:07.453050 29293 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.454609 29391 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.459481 30160 raft_consensus.cc:2955] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.462296 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1016126be7f841c4acc0cd897e5df0c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:07.470753 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:12:07.491024 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:07.500602 29294 catalog_manager.cc:5697] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.506896 30553 tablet_replica.cc:333] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:12:07.512472 30553 raft_consensus.cc:2243] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.516237 30553 raft_consensus.cc:2272] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.507192 30548 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.521924 30553 ts_tablet_manager.cc:1916] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:07.524544 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 1016126be7f841c4acc0cd897e5df0c3 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:07.531759 29470 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.542259 30158 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.554337 29463 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.562642 30553 ts_tablet_manager.cc:1929] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:07.563329 30553 log.cc:1199] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/8ad87ed6ec2e4df0b1a1f4bde07cb53e
I20260709 13:12:07.565346 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 8ad87ed6ec2e4df0b1a1f4bde07cb53e (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:07.562698 30555 tablet_replica.cc:333] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:12:07.567505 30555 raft_consensus.cc:2243] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.568370 30555 raft_consensus.cc:2272] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.572806 29391 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.574694 30534 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:07.574978 30158 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.577564 30493 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:07.585479 29390 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.586911 30555 ts_tablet_manager.cc:1916] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:07.593631 30532 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.599041 29390 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.600627 29294 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.617852 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 184cb00180cf42c7b6803577c868b1dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:07.642838 29294 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.632316 30160 raft_consensus.cc:2955] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.638233 29538 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:07.660980 30555 ts_tablet_manager.cc:1929] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:07.661139 29463 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.661734 30555 log.cc:1199] T 1016126be7f841c4acc0cd897e5df0c3 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/1016126be7f841c4acc0cd897e5df0c3
I20260709 13:12:07.661120 30159 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:07.664369 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 1016126be7f841c4acc0cd897e5df0c3 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:07.664754 30549 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:07.666836 30556 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:07.667920 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 184cb00180cf42c7b6803577c868b1dd with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:07.669152 30555 tablet_replica.cc:333] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:12:07.693146 30549 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.704244 30555 raft_consensus.cc:2243] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.699738 30160 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.718978 30555 raft_consensus.cc:2272] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.701525 29470 raft_consensus.cc:2955] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.730760 30555 ts_tablet_manager.cc:1916] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:07.747402 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57af445de910412cb7903ef2bf682013 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:07.758970 29294 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:07.762538 30555 ts_tablet_manager.cc:1929] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:07.763163 30555 log.cc:1199] T 184cb00180cf42c7b6803577c868b1dd P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/184cb00180cf42c7b6803577c868b1dd
I20260709 13:12:07.765144 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 184cb00180cf42c7b6803577c868b1dd (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:07.776209 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 57af445de910412cb7903ef2bf682013 with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:12:07.777415 30553 tablet_replica.cc:333] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:12:07.778630 30553 raft_consensus.cc:2243] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.779508 30553 raft_consensus.cc:2272] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.787983 30553 ts_tablet_manager.cc:1916] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:07.804793 30553 ts_tablet_manager.cc:1929] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:07.805321 30553 log.cc:1199] T 57af445de910412cb7903ef2bf682013 P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/57af445de910412cb7903ef2bf682013
I20260709 13:12:07.806878 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 57af445de910412cb7903ef2bf682013 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:08.884371 29538 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:08.895504 29463 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:08.896104 29390 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:08.896207 29509 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 268b94ce95ed4e5abc8be97084461e57. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.897240 30556 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:08.898157 30557 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:08.906472 30557 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:08.909461 29463 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:08.913352 29390 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:08.922307 29463 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:08.930003 29291 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.195000 29389 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:09.203277 30564 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:09.212896 29435 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0648129226444c81aef501f2bf17e434. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.229135 29538 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:09.241016 30565 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:09.250613 29391 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.235445 30564 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:12:09.330227 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 46736.3us
W20260709 13:12:09.353264 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 68456.8us
W20260709 13:12:09.382107 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 103238us
I20260709 13:12:09.371490 29538 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:12:09.451323 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 54347.5us
I20260709 13:12:09.456700 30584 ts_tablet_manager.cc:933] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:09.498427 29294 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.507658 29538 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:09.514673 30584 tablet_copy_client.cc:323] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:09.523525 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 0648129226444c81aef501f2bf17e434 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:09.524183 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 0648129226444c81aef501f2bf17e434 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-0648129226444c81aef501f2bf17e434
I20260709 13:12:09.526345 29463 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:09.528726 30582 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:09.538170 29481 tablet_copy_source_session.cc:215] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:09.539631 30587 ts_tablet_manager.cc:933] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:09.542930 30584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0648129226444c81aef501f2bf17e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:09.544111 29389 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:09.546115 30582 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:09.554400 29509 consensus_peers.cc:597] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc1ed542cbc3498ba13b3fe1f50b5d22. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.555395 30587 tablet_copy_client.cc:323] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:12:09.560990 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 268b94ce95ed4e5abc8be97084461e57 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:12:09.561584 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 268b94ce95ed4e5abc8be97084461e57 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-268b94ce95ed4e5abc8be97084461e57
I20260709 13:12:09.562310 30573 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.567940 30584 tablet_copy_client.cc:806] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:09.575730 30584 tablet_copy_client.cc:670] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:09.573817 29389 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.578197 29470 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.585636 30584 tablet_copy_client.cc:538] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:09.590297 29389 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:09.600279 29292 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.577554 29556 tablet_copy_source_session.cc:215] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:09.605000 30584 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:09.608505 30587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268b94ce95ed4e5abc8be97084461e57. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:09.619675 29360 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf141daac9d14f459ccbaeee8764a9e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.622078 29538 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:09.624266 30581 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:09.630636 30587 tablet_copy_client.cc:806] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:09.631376 30587 tablet_copy_client.cc:670] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:09.636401 30587 tablet_copy_client.cc:538] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:09.639097 30584 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:09.640178 30584 tablet_bootstrap.cc:492] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:09.641057 30584 ts_tablet_manager.cc:1403] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.036s	user 0.027s	sys 0.005s
I20260709 13:12:09.647099 30584 raft_consensus.cc:359] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:09.648072 30584 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:09.649324 30587 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:09.649066 30584 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:09.651705 29470 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:09.653739 30520 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:09.662113 30584 ts_tablet_manager.cc:1434] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 13:12:09.666042 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-0648129226444c81aef501f2bf17e434 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:09.667349 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-0648129226444c81aef501f2bf17e434 on tablet 0648129226444c81aef501f2bf17e434 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:09.682569 30579 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.691437 29470 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.696310 30587 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:09.697396 30587 tablet_bootstrap.cc:492] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:09.718338 30587 ts_tablet_manager.cc:1403] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.040s
I20260709 13:12:09.722162 30587 raft_consensus.cc:359] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:09.723202 30587 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:09.723929 30587 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:09.726830 30587 ts_tablet_manager.cc:1434] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:09.729239 29538 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:09.732249 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-268b94ce95ed4e5abc8be97084461e57 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:12:09.732750 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-268b94ce95ed4e5abc8be97084461e57 on tablet 268b94ce95ed4e5abc8be97084461e57 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:09.764600 29294 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.804828 30158 raft_consensus.cc:1217] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:09.967599 30159 raft_consensus.cc:1217] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:10.027190 30587 ts_tablet_manager.cc:933] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:10.059365 30587 tablet_copy_client.cc:323] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:12:10.085628 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet bc1ed542cbc3498ba13b3fe1f50b5d22 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:12:10.086627 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet bc1ed542cbc3498ba13b3fe1f50b5d22 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-bc1ed542cbc3498ba13b3fe1f50b5d22
I20260709 13:12:10.095335 30584 ts_tablet_manager.cc:933] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:12:10.108178 29556 tablet_copy_source_session.cc:215] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:10.110936 30584 tablet_copy_client.cc:323] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:12:10.148231 30587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc1ed542cbc3498ba13b3fe1f50b5d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:10.194428 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet cf141daac9d14f459ccbaeee8764a9e6 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:12:10.195537 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet cf141daac9d14f459ccbaeee8764a9e6 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-cf141daac9d14f459ccbaeee8764a9e6
I20260709 13:12:10.211545 29407 tablet_copy_source_session.cc:215] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:10.212329 30587 tablet_copy_client.cc:806] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:10.222046 30587 tablet_copy_client.cc:670] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
W20260709 13:12:10.266860 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44053.3us
W20260709 13:12:10.277926 29567 debug-util.cc:398] Leaking SignalData structure 0x7b0800189260 after lost signal to thread 28253
I20260709 13:12:10.341099 30584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf141daac9d14f459ccbaeee8764a9e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:10.429705 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 158104us
W20260709 13:12:10.461535 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08000f47e0 after lost signal to thread 29329
W20260709 13:12:10.463980 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce660 after lost signal to thread 29421
W20260709 13:12:10.465828 29567 debug-util.cc:398] Leaking SignalData structure 0x7b0800284ba0 after lost signal to thread 29496
W20260709 13:12:10.469993 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6ba0 after lost signal to thread 29570
W20260709 13:12:10.493978 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 119280us
W20260709 13:12:10.497035 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 47430us
W20260709 13:12:10.500933 29567 debug-util.cc:398] Leaking SignalData structure 0x7b0800338d20 after lost signal to thread 30184
W20260709 13:12:10.552254 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 76524.3us
I20260709 13:12:10.566404 30601 raft_consensus.cc:1064] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:10.572553 30601 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:10.600360 30156 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:10.606892 30614 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:10.610679 29391 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:10.615509 30584 tablet_copy_client.cc:806] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:10.616318 30584 tablet_copy_client.cc:670] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:10.618984 30563 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:10.625211 30584 tablet_copy_client.cc:538] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:10.640122 30584 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:10.642614 29538 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:10.650898 30614 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:10.718096 30601 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.729209 30584 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:10.723847 29538 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.730418 30584 tablet_bootstrap.cc:492] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:10.731366 30584 ts_tablet_manager.cc:1403] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.048s
I20260709 13:12:10.735128 30574 raft_consensus.cc:1064] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:10.734151 29391 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.737907 30155 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.746223 30584 raft_consensus.cc:359] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:10.752270 30584 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:10.753227 30584 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:10.741616 30574 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:10.757438 30587 tablet_copy_client.cc:538] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:10.767661 29292 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.779845 30587 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:10.787146 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:10.801214 30584 ts_tablet_manager.cc:1434] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.069s	user 0.020s	sys 0.000s
I20260709 13:12:10.814921 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-cf141daac9d14f459ccbaeee8764a9e6 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:12:10.815583 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-cf141daac9d14f459ccbaeee8764a9e6 on tablet cf141daac9d14f459ccbaeee8764a9e6 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:10.838478 29470 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:10.842087 30616 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:12:10.843668 30155 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:10.844300 29391 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:10.855938 30574 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:10.858634 30616 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:10.896692 30616 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.900553 30155 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.913554 29470 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.916848 30587 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:10.918241 30587 tablet_bootstrap.cc:492] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:10.919313 30587 ts_tablet_manager.cc:1403] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.142s	user 0.034s	sys 0.006s
I20260709 13:12:10.922472 29395 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.923743 30587 raft_consensus.cc:359] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:10.924590 30587 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:10.925289 30587 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:10.928800 30587 ts_tablet_manager.cc:1434] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:10.931524 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-bc1ed542cbc3498ba13b3fe1f50b5d22 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:12:10.932093 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-bc1ed542cbc3498ba13b3fe1f50b5d22 on tablet bc1ed542cbc3498ba13b3fe1f50b5d22 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:10.942481 29463 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:10.955797 30156 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:10.960215 30610 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:10.976974 29293 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:10.981307 30160 raft_consensus.cc:1217] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:10.983935 30614 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.002054 30160 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.036722 29389 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:11.057963 30526 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:12:11.060832 29541 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.087726 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0648129226444c81aef501f2bf17e434 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:11.142745 30156 raft_consensus.cc:1217] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:11.161180 29291 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.162320 29395 raft_consensus.cc:2955] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.182272 30156 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:11.186183 30616 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:11.192981 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 0648129226444c81aef501f2bf17e434 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:11.201457 30635 tablet_replica.cc:333] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:12:11.203450 30635 raft_consensus.cc:2243] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.204437 30635 raft_consensus.cc:2272] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.210194 30635 ts_tablet_manager.cc:1916] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:12:11.211884 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 158884us
I20260709 13:12:11.219084 30616 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.223907 30160 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.227262 29391 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:11.253650 30573 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:11.255982 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 268b94ce95ed4e5abc8be97084461e57 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:11.278975 29291 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.313369 29395 raft_consensus.cc:2955] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.332688 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 268b94ce95ed4e5abc8be97084461e57 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:12:11.358003 30635 ts_tablet_manager.cc:1929] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:11.365675 30635 log.cc:1199] T 0648129226444c81aef501f2bf17e434 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/0648129226444c81aef501f2bf17e434
I20260709 13:12:11.367995 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 0648129226444c81aef501f2bf17e434 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:11.382776 29541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:11.383471 30638 tablet_replica.cc:333] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:12:11.383895 29541 raft_consensus.cc:606] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:11.385280 30638 raft_consensus.cc:2243] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.387581 30638 raft_consensus.cc:2272] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.387677 29541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57af445de910412cb7903ef2bf682013"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:11.388814 29541 raft_consensus.cc:606] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:11.393283 30638 ts_tablet_manager.cc:1916] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:11.395633 29541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:11.396513 29541 raft_consensus.cc:606] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:11.425419 30638 ts_tablet_manager.cc:1929] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:11.431473 30638 log.cc:1199] T 268b94ce95ed4e5abc8be97084461e57 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/268b94ce95ed4e5abc8be97084461e57
I20260709 13:12:11.433585 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:11.434418 29463 raft_consensus.cc:606] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:11.435778 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 268b94ce95ed4e5abc8be97084461e57 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:11.447101 29541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:11.458644 29541 raft_consensus.cc:606] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:11.514912 30616 raft_consensus.cc:1064] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:11.522485 30616 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.527595 29391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:11.541095 29391 raft_consensus.cc:606] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:11.543558 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:11.545957 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:11.548946 30611 raft_consensus.cc:993] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.549535 30573 raft_consensus.cc:1081] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.551819 30159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:11.552498 30159 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:11.552847 30159 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.575760 30606 raft_consensus.cc:1064] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:11.592644 30606 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.628381 30611 raft_consensus.cc:993] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.628993 30611 raft_consensus.cc:1081] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.632349 30155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:11.632992 30155 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:11.633445 30155 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.645324 30155 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.635365 30159 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.658820 30607 raft_consensus.cc:993] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:11.659595 30603 raft_consensus.cc:1081] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:11.660559 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:11.661367 29541 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:11.661736 29541 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:11.662876 29541 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.663677 30159 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:11.664237 30160 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:11.664479 29541 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.664384 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:11.665071 29545 raft_consensus.cc:3055] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:11.665347 29545 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:11.666168 29545 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.667685 29545 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.665813 30502 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:12:11.672569 29546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:11.673231 29546 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:11.673681 29546 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.676182 29545 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:11.679488 30126 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:11.680481 30625 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:11.684309 30573 raft_consensus.cc:993] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.685010 30574 raft_consensus.cc:1081] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.687723 30159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57af445de910412cb7903ef2bf682013"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:11.688266 30155 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:11.694509 29463 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:11.695745 30159 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:11.696266 30159 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.689296 29545 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:11.703299 29541 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:11.712806 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:11.704592 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:11.714246 29395 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.705118 29546 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:11.706220 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:11.727882 29391 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.706993 30625 raft_consensus.cc:697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:11.730993 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:11.709127 29463 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:11.711548 30155 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:11.733979 30573 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:11.734615 30625 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.748783 30159 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.767450 30159 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:11.783913 30644 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:11.784801 30644 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:11.810501 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 71095.1us
W20260709 13:12:11.832495 30641 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:12:11.834847 29466 raft_consensus.cc:3055] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:11.835330 29466 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:11.836117 29466 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:11.837172 29466 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.844089 30611 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:11.729401 29546 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:11.864300 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 151595us
I20260709 13:12:11.868800 29466 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:12:11.879878 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 68352.1us
I20260709 13:12:11.874073 29391 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:11.875119 29395 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
W20260709 13:12:11.882979 30643 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:12:11.893210 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:11.894029 29541 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:11.894502 29541 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:11.895550 29541 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.897030 29541 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.894230 30502 raft_consensus.cc:993] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:11.898748 30502 raft_consensus.cc:1081] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:11.901614 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:11.902475 29466 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.909988 30573 raft_consensus.cc:993] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.886118 30608 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:12:11.912412 30573 raft_consensus.cc:1081] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:11.912979 30609 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:11.915665 29541 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:11.786417 30644 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.924504 30160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:11.925216 30160 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:11.925086 29512 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:11.925729 29466 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:11.925771 30160 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.929204 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:11.929888 29391 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.931254 29395 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:11.937387 30647 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:11.937422 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:11.941918 30625 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:11.942473 30625 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:11.943446 30625 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.940346 30160 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:11.947537 30647 raft_consensus.cc:697] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:11.948683 30647 consensus_queue.cc:237] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:11.951747 30160 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:11.953696 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:11.954605 29541 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:11.954990 29541 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:11.951927 30648 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.970935 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:11.971727 29466 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:11.981797 29466 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:11.984280 29470 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:11.995461 29541 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:12.026500 30655 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:12:12.030071 29541 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.028017 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:12.064355 29541 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:12.071120 29391 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:12.044193 30625 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:12.099113 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 57574us
I20260709 13:12:12.097898 30625 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:12.148682 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 98585.6us
W20260709 13:12:12.196993 30661 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:12:12.213603 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 153881us
W20260709 13:12:12.215580 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 85360.7us
I20260709 13:12:12.220515 29545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:12:12.221207 29545 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:12.221645 29545 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:12.221727 30662 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 13:12:12.232091 29545 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:12.252456 29545 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:12.254112 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:12.183118 30625 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:12.258567 29294 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.288036 29294 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.269068 29291 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:12.285355 29463 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.309864 30606 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:12.332866 29470 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:12.358408 30159 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:12.364976 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:12.365751 29391 raft_consensus.cc:3055] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:12.366087 29391 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:12.378929 29542 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:12.381943 29391 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:12.387565 29391 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.390714 29542 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:12.375887 29463 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:12.397119 29464 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:12.399748 29512 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:12.396947 29292 catalog_manager.cc:5697] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:12.413772 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 48131.1us
I20260709 13:12:12.415108 30655 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:12.418243 30645 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:12:12.418676 30655 raft_consensus.cc:697] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:12.419924 30655 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:12.433794 29395 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:12.464478 29390 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:12.468937 29464 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:12.471119 30625 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:12.473065 29392 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:12:12.477449 30677 log.cc:927] Time spent T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:12:12.480571 30675 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 13:12:12.484594 29391 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:12.532078 30159 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:12.549289 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:12.541419 30644 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:12:12.563577 29392 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:12.540153 30625 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:12:12.574998 29542 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:12.578792 30573 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:12:12.962778 30680 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.063s	user 0.000s	sys 0.010s
W20260709 13:12:12.985499 30679 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.193s	user 0.011s	sys 0.000s
W20260709 13:12:12.991101 30681 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:12:13.169868 29463 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:13.175133 29464 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:13.253435 29464 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:13.242882 30655 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:12:13.266609 30611 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:12:13.370541 29392 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:13.348980 30645 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:12:13.452230 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 191059us
I20260709 13:12:13.457082 29291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 223) took 1302 ms. Trace:
I20260709 13:12:13.574321 29538 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:13.581933 29293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 224) took 1045 ms. Trace:
I20260709 13:12:13.584422 29546 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:13.585716 30649 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.582538 29293 rpcz_store.cc:276] 0709 13:12:12.546099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.550837 (+  4738us) service_pool.cc:224] Handling call
0709 13:12:12.584100 (+ 33263us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b54001b0990. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587d0b2 00007f61ee7f6a89 00007f61ee78eda6 00007f61ee760088 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc
0709 13:12:13.579960 (+995860us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":19242880}
I20260709 13:12:13.513341 29291 rpcz_store.cc:276] 0709 13:12:12.119133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.119275 (+   142us) service_pool.cc:224] Handling call
0709 13:12:13.421412 (+1302137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:12.359467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:12.360133 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:12.360167 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:12:12.360185 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:12.360564 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:12.360663 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:12.360708 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:12.360907 (+   199us) tablet.cc:701] Row locks acquired
0709 13:12:12.360924 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:12.361078 (+   154us) write_op.cc:270] Start()
0709 13:12:12.371087 (+ 10009us) write_op.cc:276] Timestamp: P: 1783602732361030 usec, L: 0
0709 13:12:12.371126 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:12:12.446048 (+ 74922us) log.cc:844] Serialized 603 byte log entry
0709 13:12:12.968012 (+521964us) op_driver.cc:464] REPLICATION: finished
0709 13:12:13.346948 (+378936us) write_op.cc:301] APPLY: starting
0709 13:12:13.347059 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:13.347180 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:13.347314 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:13.347648 (+   334us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:13.355175 (+  7527us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:13.392427 (+ 37252us) write_op.cc:312] APPLY: finished
0709 13:12:13.409955 (+ 17528us) log.cc:844] Serialized 23 byte log entry
0709 13:12:13.410215 (+   260us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.410322 (+   107us) write_op.cc:454] Released schema lock
0709 13:12:13.410376 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:13.410905 (+   529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.410947 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2358,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":363115,"apply.run_cpu_time_us":2382,"apply.run_wall_time_us":63931,"num_ops":1,"prepare.queue_time_us":61901,"prepare.run_cpu_time_us":13672,"prepare.run_wall_time_us":170238,"raft.queue_time_us":662883,"raft.run_cpu_time_us":28254,"raft.run_wall_time_us":297903,"replication_time_us":596682,"spinlock_wait_cycles":223294848,"thread_start_us":634886,"threads_started":4,"wal-append.queue_time_us":82255}]]}
W20260709 13:12:13.668316 30681 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:12:13.698387 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 228826us
W20260709 13:12:13.732831 30683 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:13.691495 30649 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:13.788372 30649 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:13.789657 29540 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:12:13.796018 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 107992us
W20260709 13:12:13.797472 30709 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:12:13.811118 30671 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.811807 30671 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:13.814162 30671 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:13.830996 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:13.834576 29539 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:13.838490 29294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 114) took 1675 ms. Trace:
W20260709 13:12:13.840600 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 141132us
I20260709 13:12:13.863375 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:13.873059 29438 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:13.876336 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 288482us
I20260709 13:12:13.878844 30601 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:13.887750 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 300355us
I20260709 13:12:13.886089 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:13.839116 29294 rpcz_store.cc:276] 0709 13:12:12.163266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.163434 (+   168us) service_pool.cc:224] Handling call
0709 13:12:13.838365 (+1674931us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:12.552574 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:12.594397 (+ 41823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:12.594469 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:12:12.594498 (+    29us) tablet.cc:662] Decoding operations
0709 13:12:12.595125 (+   627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:12.595198 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:12.595237 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:12.595683 (+   446us) tablet.cc:701] Row locks acquired
0709 13:12:12.595714 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:12:12.595953 (+   239us) write_op.cc:270] Start()
0709 13:12:12.596122 (+   169us) write_op.cc:276] Timestamp: P: 1783602732595877 usec, L: 0
0709 13:12:12.596168 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:12:12.715644 (+119476us) log.cc:844] Serialized 925 byte log entry
0709 13:12:13.037444 (+321800us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e899ce28 00007f61ec3d7581 00007f61ec3d6d58 00007f61ec3db9f1 00007f61ec3db9a9 00007f61ec3db939 00007f61ec3db901 00007f61ec3dab2d 000000000038f354 000000000038f199
0709 13:12:13.401521 (+364077us) op_driver.cc:464] REPLICATION: finished
0709 13:12:13.462512 (+ 60991us) write_op.cc:301] APPLY: starting
0709 13:12:13.464502 (+  1990us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:13.580328 (+115826us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:13.585576 (+  5248us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:13.742963 (+157387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:13.784672 (+ 41709us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:12:13.791516 (+  6844us) write_op.cc:312] APPLY: finished
0709 13:12:13.791779 (+   263us) log.cc:844] Serialized 29 byte log entry
0709 13:12:13.791988 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.792086 (+    98us) write_op.cc:454] Released schema lock
0709 13:12:13.794537 (+  2451us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:13.802218 (+  7681us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.802269 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":44836,"apply.run_cpu_time_us":3077,"apply.run_wall_time_us":344207,"num_ops":2,"prepare.queue_time_us":238273,"prepare.run_cpu_time_us":28666,"prepare.run_wall_time_us":488584,"replication_time_us":795464,"spinlock_wait_cycles":9556224,"thread_start_us":148558,"threads_started":1}]]}
I20260709 13:12:13.890798 30601 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.900511 30601 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.912838 30689 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:13.910452 30697 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:13.904886 30716 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:13.919552 30697 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:13.934257 30716 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:13.943956 30697 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:13.966756 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 45732.3us
I20260709 13:12:13.981222 29291 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.985242 29292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 221) took 1638 ms. Trace:
I20260709 13:12:13.986809 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:13.991792 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:13.985652 29292 rpcz_store.cc:276] 0709 13:12:12.346906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.347129 (+   223us) service_pool.cc:224] Handling call
0709 13:12:12.393748 (+ 46619us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b54001b0990. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587d0b2 00007f61ee7f6a89 00007f61ee78eda6 00007f61ee760088 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc
0709 13:12:13.985163 (+1591415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:13.038013 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:13.105605 (+ 67592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:13.106182 (+   577us) write_op.cc:435] Acquired schema lock
0709 13:12:13.106572 (+   390us) tablet.cc:662] Decoding operations
0709 13:12:13.155028 (+ 48456us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:13.156451 (+  1423us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:13.157058 (+   607us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:13.160709 (+  3651us) tablet.cc:701] Row locks acquired
0709 13:12:13.162290 (+  1581us) write_op.cc:260] PREPARE: finished
0709 13:12:13.168511 (+  6221us) write_op.cc:270] Start()
0709 13:12:13.180080 (+ 11569us) write_op.cc:276] Timestamp: P: 1783602733168447 usec, L: 0
0709 13:12:13.180104 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:13.345892 (+165788us) log.cc:844] Serialized 544 byte log entry
0709 13:12:13.466900 (+121008us) spinlock_profiling.cc:243] Waited 80.4 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e899ce28 00007f61ec3d7581 00007f61ec3d6d58 00007f61ec3db9f1 00007f61ec3db9a9 00007f61ec3db939 00007f61ec3db901 00007f61ec3dab2d 000000000038f354 000000000038f199
0709 13:12:13.829528 (+362628us) op_driver.cc:464] REPLICATION: finished
0709 13:12:13.865932 (+ 36404us) write_op.cc:301] APPLY: starting
0709 13:12:13.873221 (+  7289us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:13.879659 (+  6438us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:13.881034 (+  1375us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:13.894173 (+ 13139us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:13.901590 (+  7417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:13.901642 (+    52us) write_op.cc:312] APPLY: finished
0709 13:12:13.901901 (+   259us) log.cc:844] Serialized 23 byte log entry
0709 13:12:13.902089 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.902178 (+    89us) write_op.cc:454] Released schema lock
0709 13:12:13.902220 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:13.902627 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.902655 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4057,"reported_tablets":1,"spinlock_wait_cycles":26398592,"child_traces":[["op",{"apply.queue_time_us":11054,"apply.run_cpu_time_us":2145,"apply.run_wall_time_us":36701,"num_ops":1,"prepare.queue_time_us":610705,"prepare.run_cpu_time_us":7071,"prepare.run_wall_time_us":429097,"replication_time_us":648209,"spinlock_wait_cycles":184865024}]]}
I20260709 13:12:14.015970 30700 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:14.014109 30697 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.977752 30685 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:12:14.007283 30716 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:13.993719 30645 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:12:13.987877 30644 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:12:14.035662 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:14.074909 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:14.036212 30697 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:14.077193 30601 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:14.016592 30700 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:14.124537 30601 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:14.030851 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:14.129019 30700 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:14.135557 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:14.136423 29543 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:14.136912 29469 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:12:14.139940 30685 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:14.140625 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:14.140838 30685 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:14.141170 30685 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:14.143175 30685 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:14.147403 30685 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:14.151322 30697 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:14.161000 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:14.169257 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:14.173637 29389 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:14.196090 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 140552us
I20260709 13:12:14.197039 29294 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.212908 29294 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.297672 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:14.304924 29509 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:14.302426 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:14.296519 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:14.322240 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:14.306739 30693 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:14.306552 30649 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:14.377046 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 59390.4us
I20260709 13:12:14.393373 30156 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:14.404109 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:14.413488 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:14.402504 30692 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:12:14.423405 30690 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:14.461617 30655 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:14.473116 30727 log.cc:927] Time spent T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.172s	user 0.004s	sys 0.000s
I20260709 13:12:14.476476 30157 raft_consensus.cc:2410] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:14.488427 29291 catalog_manager.cc:5697] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.462172 29543 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:14.495538 29540 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:12:14.511714 30721 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.456s	user 0.006s	sys 0.000s
I20260709 13:12:14.513389 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1150) took 1095 ms. Trace:
I20260709 13:12:14.513763 29467 rpcz_store.cc:276] 0709 13:12:13.417426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.461621 (+ 44195us) service_pool.cc:224] Handling call
0709 13:12:13.463717 (+  2096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:13.875069 (+411352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:13.875099 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:13.903135 (+ 28036us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.025914 (+122779us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:14.025957 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.026096 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.510849 (+484753us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:12:14.512916 (+  2067us) raft_consensus.cc:1685] finished
0709 13:12:14.512937 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.513190 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81676,"raft.queue_time_us":228136,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":7897,"spinlock_wait_cycles":36822656,"thread_start_us":319228,"threads_started":2,"wal-append.queue_time_us":152336}
I20260709 13:12:14.521461 29438 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:14.522496 30713 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:14.523075 30713 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:14.523995 30713 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:14.542513 30697 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:14.572764 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 52091.5us
I20260709 13:12:14.611249 29546 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:14.627068 29543 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:14.658166 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:14.681255 30159 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:14.684412 30697 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:14.657526 30612 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:12:14.694177 29469 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:14.698012 30655 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:14.700233 30156 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:14.697182 30698 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:14.751464 30616 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:14.779711 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc1ed542cbc3498ba13b3fe1f50b5d22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:14.791400 29295 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.793419 29291 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.798992 29292 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:14.806572 30159 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:14.830230 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet bc1ed542cbc3498ba13b3fe1f50b5d22 with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:12:14.831697 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf141daac9d14f459ccbaeee8764a9e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:14.844264 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet cf141daac9d14f459ccbaeee8764a9e6 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59284
I20260709 13:12:14.865350 30743 tablet_replica.cc:333] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:12:14.870401 30743 raft_consensus.cc:2243] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.871343 30743 raft_consensus.cc:2272] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.915513 29472 raft_consensus.cc:2955] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:14.919728 29388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:14.920459 29388 raft_consensus.cc:606] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:14.950218 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:14.950976 29467 raft_consensus.cc:606] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:14.965600 29539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:14.966370 29539 raft_consensus.cc:606] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:14.986397 29543 raft_consensus.cc:2955] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:14.984838 30654 raft_consensus.cc:993] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:14.994827 30692 raft_consensus.cc:993] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:14.995924 30692 raft_consensus.cc:1081] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:14.997738 30743 ts_tablet_manager.cc:1916] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:14.998641 29467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59298
I20260709 13:12:15.008289 29467 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.008718 29467 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:14.991027 29539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:15.010488 29539 raft_consensus.cc:606] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:14.993376 30744 tablet_replica.cc:333] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:12:15.012981 30744 raft_consensus.cc:2243] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.994794 30611 raft_consensus.cc:1081] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:15.014497 30744 raft_consensus.cc:2272] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.018183 30744 ts_tablet_manager.cc:1916] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:15.022305 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:15.023015 29472 raft_consensus.cc:606] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:15.031525 30157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:15.032224 30157 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.032649 30157 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.033378 29543 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:15.036440 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:15.037218 29472 raft_consensus.cc:606] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:15.046535 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:15.047278 30655 raft_consensus.cc:993] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:15.047816 30655 raft_consensus.cc:1081] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:15.048780 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:15.044395 29467 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.044955 30607 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:12:15.050200 30159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:15.051649 30159 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.052028 30159 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.055279 29467 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:15.058168 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:15.058889 29388 raft_consensus.cc:3055] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.059274 29388 raft_consensus.cc:740] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:15.064919 30159 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.062772 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:15.064889 29388 consensus_queue.cc:260] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.069599 29544 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.070725 30159 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:15.077191 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:15.077854 29391 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.085186 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:15.086018 29540 raft_consensus.cc:3055] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.086369 29540 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:15.087267 29540 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.088838 29540 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.089084 30718 raft_consensus.cc:993] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:15.089637 30713 raft_consensus.cc:1081] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:15.090370 29391 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:15.091657 29543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:15.092228 29543 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.092615 29543 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.092787 30123 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:15.093811 30685 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.094429 30685 raft_consensus.cc:697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:15.095533 30685 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.096999 30744 ts_tablet_manager.cc:1929] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:15.097908 30159 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:12:15.098977 30159 pending_rounds.cc:85] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 4
I20260709 13:12:15.100726 30159 pending_rounds.cc:107] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:12:15.107030 30159 raft_consensus.cc:2889] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:15.104704 29544 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:15.097503 30744 log.cc:1199] T cf141daac9d14f459ccbaeee8764a9e6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/cf141daac9d14f459ccbaeee8764a9e6
I20260709 13:12:15.093448 29388 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.111451 29438 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:15.113372 29543 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.116994 30603 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:15.115319 30713 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.122063 30713 raft_consensus.cc:697] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:15.123349 30713 consensus_queue.cc:237] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.130964 30743 ts_tablet_manager.cc:1929] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:15.131518 30743 log.cc:1199] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/bc1ed542cbc3498ba13b3fe1f50b5d22
I20260709 13:12:15.133649 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet bc1ed542cbc3498ba13b3fe1f50b5d22 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:15.138247 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet cf141daac9d14f459ccbaeee8764a9e6 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:15.143754 29543 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:15.149981 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:15.151289 29467 raft_consensus.cc:3055] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.151659 29467 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:15.152742 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:15.153342 29391 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.154867 29540 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:15.155650 29388 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:15.158296 29467 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.175124 29295 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.176977 30157 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.180639 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:15.181370 29472 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.199064 29467 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.215237 30157 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:15.217381 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:15.218523 29540 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.218861 29540 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:15.219672 29540 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.221861 29540 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.223817 29292 catalog_manager.cc:5697] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.225601 30603 raft_consensus.cc:993] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:15.226122 30603 raft_consensus.cc:1081] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:15.227923 29543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:15.228473 29543 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.228830 29543 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.249724 29472 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:15.249766 29467 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:15.252585 29512 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:15.258862 29391 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:15.264806 30611 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.265854 30611 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:15.263763 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:15.266877 30611 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.267542 30747 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.268111 30747 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:15.269101 30747 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.273988 29540 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:15.264242 29543 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.280059 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:15.280742 29388 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.281423 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:15.282123 29469 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.282471 29469 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:15.283352 29469 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.284360 29469 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.324505 29543 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:15.328934 29388 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:15.329813 29389 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.353719 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:15.359004 29469 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:15.369077 30607 raft_consensus.cc:993] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:15.372372 30607 raft_consensus.cc:1081] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:15.370008 30616 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.373524 30616 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:15.374627 30157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:12:15.374584 30616 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:15.375319 30157 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.375742 30157 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.370183 29292 catalog_manager.cc:5697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:15.433111 30752 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:12:15.442296 30157 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.443629 29295 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.445999 30157 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:15.447494 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:15.447886 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:15.452498 29389 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.452607 29468 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.453413 29468 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:15.454290 29468 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.455555 29468 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.459723 29291 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.480198 29468 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:15.482664 29389 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:15.491940 30123 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:15.495496 30747 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.496073 30747 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:15.497098 30747 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:15.519219 29543 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:15.553524 30645 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:15.781683 29389 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.797362 29295 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.840446 29388 raft_consensus.cc:1275] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.843393 30718 consensus_queue.cc:1048] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:15.862593 29543 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:15.869349 29543 raft_consensus.cc:1275] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.876914 30607 consensus_queue.cc:1048] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:15.877245 29464 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.914427 29468 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.924036 29468 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:15.932075 30645 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:15.973919 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 77563.6us
I20260709 13:12:15.975137 30759 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:15.986214 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 85729.6us
I20260709 13:12:15.990707 30760 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:15.997160 29391 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:16.002987 30747 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:16.005671 30685 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:12:16.069152 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65087.4us
I20260709 13:12:16.075636 29391 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.108812 29465 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:16.110550 30772 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:16.123528 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:16.164157 30697 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:16.168491 29389 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:16.170377 30772 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:16.183254 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 193385us
I20260709 13:12:16.224776 30760 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:16.255793 29392 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:16.305932 29360 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e8fc42a067a41aa89e5d120919426e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.316661 29538 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:16.319542 29468 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:16.321796 30608 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.323316 30763 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.405005 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:16.412436 30608 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.415019 29538 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.422407 29465 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.483850 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:16.484656 29472 raft_consensus.cc:606] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:16.489005 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:16.489718 29468 raft_consensus.cc:606] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:16.502045 29391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:16.502810 29391 raft_consensus.cc:606] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:16.507445 29538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:16.508069 29538 raft_consensus.cc:606] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:16.511909 29538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:16.512526 29538 raft_consensus.cc:606] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:16.515261 29465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:16.516007 29465 raft_consensus.cc:606] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:16.517896 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:16.520130 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:16.498144 29470 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:16.488370 29291 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.539640 30718 raft_consensus.cc:993] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:16.540231 30718 raft_consensus.cc:1081] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:16.542346 29538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:16.543020 29538 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.543406 29538 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.549693 29538 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:16.557829 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:16.558712 29392 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.562340 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:16.568019 29538 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:16.563176 29465 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.571753 29465 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:16.583473 29465 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:16.584635 29539 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.584896 29465 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:16.586980 29435 consensus_peers.cc:597] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 225e23ac0b4c490cb213c4d4945ec334. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.588045 30718 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:16.591265 29391 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.594017 30718 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:16.597608 29465 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:16.599074 29392 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:16.600819 29509 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:16.607223 30770 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.607754 30770 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:16.616317 30770 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:16.680474 30765 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.698613 29538 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.706655 29295 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.711681 29539 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:16.721284 29465 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:16.723359 30770 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:16.720460 29292 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:16.731475 29509 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b624c2ca9f340c787fc611feea71f37. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.731395 30760 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.735118 29472 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.757210 29389 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:16.764309 29392 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:16.772840 30718 raft_consensus.cc:993] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:16.773404 30718 raft_consensus.cc:1081] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:16.775305 30157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:12:16.776125 30157 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.776593 30157 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.778781 30616 raft_consensus.cc:993] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:16.779496 30616 raft_consensus.cc:1081] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:16.781461 30159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:16.782102 30159 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.782470 30159 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.801481 30718 raft_consensus.cc:993] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:16.802305 30765 raft_consensus.cc:1081] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:16.805190 29538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:16.805904 29538 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.806373 29538 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.811432 30793 ts_tablet_manager.cc:933] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:12:16.815903 29472 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:16.836995 29291 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.849337 30759 raft_consensus.cc:993] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:16.780368 30760 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:16.855732 30759 raft_consensus.cc:1081] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
W20260709 13:12:16.858206 30181 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea080 after lost signal to thread 28253
W20260709 13:12:16.861480 30181 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf0c0 after lost signal to thread 29329
W20260709 13:12:16.863720 30181 debug-util.cc:398] Leaking SignalData structure 0x7b0800243820 after lost signal to thread 29421
I20260709 13:12:16.856267 30159 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:16.865141 30181 debug-util.cc:398] Leaking SignalData structure 0x7b08002afa80 after lost signal to thread 29496
I20260709 13:12:16.870249 29392 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:12:16.874825 30181 debug-util.cc:398] Leaking SignalData structure 0x7b0800318940 after lost signal to thread 29570
W20260709 13:12:16.876566 30181 debug-util.cc:398] Leaking SignalData structure 0x7b08000fca00 after lost signal to thread 30184
I20260709 13:12:16.877971 30502 raft_consensus.cc:993] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:16.878494 30763 raft_consensus.cc:1081] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:16.871791 30155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:12:16.879779 30155 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.880223 30155 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.882376 30159 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:16.883852 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:16.885308 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:16.916213 29543 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.916345 29540 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:16.916729 29543 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:16.889812 29539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:12:16.893625 30155 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:16.918871 29468 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.919445 30155 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:16.917851 29543 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:16.920779 29543 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.921826 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:16.922490 29389 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.923595 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:16.924289 29540 raft_consensus.cc:3055] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.924639 29540 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:16.925714 29540 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:16.927119 29540 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:16.914892 29435 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38fdcb033993416ca10b3d79544c9d59. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.938342 29389 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:16.939569 30123 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:16.940659 30645 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.941133 30645 raft_consensus.cc:697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:16.942189 30645 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:16.868615 30157 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:16.957995 30793 tablet_copy_client.cc:323] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:12:16.893934 29538 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:16.960263 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet 3e8fc42a067a41aa89e5d120919426e3 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:12:16.960438 29538 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:16.961001 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet 3e8fc42a067a41aa89e5d120919426e3 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-3e8fc42a067a41aa89e5d120919426e3
I20260709 13:12:16.963402 30157 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:16.965831 29539 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.966039 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:16.966792 29472 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.967211 29472 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:16.968288 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:16.968905 29392 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.968966 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:16.969614 29470 raft_consensus.cc:3055] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.969928 29470 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:16.968137 29472 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:16.975067 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:16.975740 29389 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.978212 29472 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.979242 29470 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:16.980690 29470 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.986375 29543 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:17.014011 29472 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:17.015105 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:17.005903 29389 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:17.017318 30685 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.017870 30685 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:17.018826 30685 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:17.020849 29389 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:17.022346 30718 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.023542 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:17.008044 29407 tablet_copy_source_session.cc:215] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:17.011530 29468 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:17.001801 29392 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:17.027482 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:17.028518 30772 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.029920 29540 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:17.031780 30793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8fc42a067a41aa89e5d120919426e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:16.966344 29539 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.025518 30770 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.050854 30770 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:17.052054 30770 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:17.053282 30718 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:17.038904 30772 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:17.059363 30772 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:17.072335 29470 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:17.086208 30761 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:17.101087 29539 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:17.107808 29539 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:17.107662 29392 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:17.135214 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:17.136392 29391 raft_consensus.cc:3055] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.136833 29391 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:17.137832 29389 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.140375 29291 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.142707 29391 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:17.142679 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53703.4us
I20260709 13:12:17.134241 29292 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.150262 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:17.151065 30157 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.152274 29391 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.157490 30793 tablet_copy_client.cc:806] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:17.158209 30793 tablet_copy_client.cc:670] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:17.158725 30770 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:17.160346 29292 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.159566 29295 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:17.168449 29292 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.178334 29391 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:17.181034 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:17.179068 30793 tablet_copy_client.cc:538] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:17.183969 30697 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.187244 30697 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:12:17.201018 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 52284.2us
I20260709 13:12:17.210634 29470 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.227890 30697 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:17.213510 30759 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:12:17.262259 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 48804.2us
I20260709 13:12:17.270336 29540 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:17.308171 30807 ts_tablet_manager.cc:933] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:17.321403 30157 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:17.377739 30793 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:17.392541 29295 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.462325 30815 ts_tablet_manager.cc:933] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:17.614636 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 242307us
I20260709 13:12:17.645027 30807 tablet_copy_client.cc:323] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:12:17.649420 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:17.649678 29540 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:17.651163 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 8b624c2ca9f340c787fc611feea71f37 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:12:17.651826 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 8b624c2ca9f340c787fc611feea71f37 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-8b624c2ca9f340c787fc611feea71f37
I20260709 13:12:17.675848 29470 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:17.678762 29556 tablet_copy_source_session.cc:215] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:17.689728 30827 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:17.692360 30827 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:17.717969 29392 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.769729 29468 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:17.780769 30815 tablet_copy_client.cc:323] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:17.787709 29392 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:17.790225 29391 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:17.806951 30831 ts_tablet_manager.cc:933] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:17.817327 30772 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:17.819046 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 225e23ac0b4c490cb213c4d4945ec334 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:17.819712 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 225e23ac0b4c490cb213c4d4945ec334 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-225e23ac0b4c490cb213c4d4945ec334
I20260709 13:12:17.869897 29540 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:17.871217 30807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b624c2ca9f340c787fc611feea71f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:17.917279 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:17.886756 29481 tablet_copy_source_session.cc:215] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:17.944399 30831 tablet_copy_client.cc:323] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:12:17.970322 30829 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:17.969717 30772 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:12:18.030987 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 149628us
W20260709 13:12:18.045596 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 159208us
W20260709 13:12:18.046228 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 140450us
I20260709 13:12:18.057065 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 38fdcb033993416ca10b3d79544c9d59 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:12:18.035784 30760 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:12:18.112058 30815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225e23ac0b4c490cb213c4d4945ec334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.112891 29468 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:18.099141 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52194.8us
I20260709 13:12:18.114212 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 38fdcb033993416ca10b3d79544c9d59 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-38fdcb033993416ca10b3d79544c9d59
I20260709 13:12:18.156595 30793 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.157701 30793 tablet_bootstrap.cc:492] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:18.166914 30793 ts_tablet_manager.cc:1403] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.789s	user 0.035s	sys 0.046s
I20260709 13:12:18.189018 30759 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:12:18.201237 29481 tablet_copy_source_session.cc:215] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:18.209718 30155 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:12:18.207504 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80008.4us
I20260709 13:12:18.214044 30772 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:18.244992 29389 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:18.286506 30793 raft_consensus.cc:359] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:18.287559 30793 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:18.288280 30793 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:18.293542 30793 ts_tablet_manager.cc:1434] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.103s	user 0.003s	sys 0.004s
I20260709 13:12:18.272578 29539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:18.305258 30611 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:12:18.306710 29539 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:18.315912 29388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29e2fd913c0b414a81386c129004967f"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:18.316556 29388 raft_consensus.cc:606] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:18.346174 29538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:18.346918 29538 raft_consensus.cc:606] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:18.346772 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 54018.1us
I20260709 13:12:18.368602 30815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49108 (request call id 372) took 1103 ms. Trace:
I20260709 13:12:18.369196 30815 rpcz_store.cc:276] 0709 13:12:17.265281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.265480 (+   199us) service_pool.cc:224] Handling call
0709 13:12:17.498838 (+233358us) ts_tablet_manager.cc:934] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
0709 13:12:18.097482 (+598644us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:18.225928 (+128446us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:18.226077 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:18.367750 (+141673us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:18.368089 (+   339us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:18.368438 (+   349us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:18.368499 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":69568,"mutex_wait_us":1179,"tablet-copy.queue_time_us":100558,"thread_start_us":97169,"threads_started":2}
I20260709 13:12:18.370645 30839 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:18.372041 30759 raft_consensus.cc:993] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:18.386680 30608 raft_consensus.cc:993] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:18.393734 30815 tablet_copy_client.cc:806] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:18.394552 30815 tablet_copy_client.cc:670] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:18.402082 30839 raft_consensus.cc:1081] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:18.404811 30831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38fdcb033993416ca10b3d79544c9d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.407251 30608 raft_consensus.cc:1081] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:18.458949 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-3e8fc42a067a41aa89e5d120919426e3 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:12:18.469151 29470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29e2fd913c0b414a81386c129004967f"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59298
I20260709 13:12:18.469844 29470 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.470227 29470 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.461550 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-3e8fc42a067a41aa89e5d120919426e3 on tablet 3e8fc42a067a41aa89e5d120919426e3 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:18.483801 29470 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:18.466194 30807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49092 (request call id 259) took 1305 ms. Trace:
I20260709 13:12:18.490206 29388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36866
I20260709 13:12:18.490998 29388 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.491360 29388 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.493270 29470 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:18.537561 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:18.538424 29390 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:18.538805 29390 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:18.555171 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:18.556083 29544 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.540544 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:18.572576 29470 raft_consensus.cc:606] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:18.585906 29388 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:18.591292 29389 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:18.592010 29388 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:18.586851 29390 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:18.596828 29390 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.490393 30807 rpcz_store.cc:276] 0709 13:12:17.160905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.161066 (+   161us) service_pool.cc:224] Handling call
0709 13:12:17.322247 (+161181us) ts_tablet_manager.cc:934] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
0709 13:12:17.814618 (+492371us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:18.290730 (+476112us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:18.290891 (+   161us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:18.405682 (+114791us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:18.441143 (+ 35461us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:18.464485 (+ 23342us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:18.465321 (+   836us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":165031,"tablet-copy.queue_time_us":104355,"thread_start_us":130468,"threads_started":2}
I20260709 13:12:18.598140 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:18.601269 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:18.586910 30815 tablet_copy_client.cc:538] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:18.604251 30157 raft_consensus.cc:1217] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:18.618430 30807 tablet_copy_client.cc:806] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:18.619184 30807 tablet_copy_client.cc:670] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:18.627656 29390 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:18.631865 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:18.660269 29463 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.638394 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:18.649343 30760 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.675479 29544 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:18.678460 29438 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:18.679441 30850 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.675479 29463 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:18.681416 29538 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:18.681790 29538 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:18.679986 30850 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:18.686269 29470 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:18.686465 29538 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:18.694419 29538 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.704583 30850 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:18.709823 29538 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:18.712934 30807 tablet_copy_client.cc:538] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:18.713362 30760 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:12:18.741199 30807 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:18.745646 30839 raft_consensus.cc:993] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:18.845557 30839 raft_consensus.cc:1081] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:18.683734 30831 tablet_copy_client.cc:806] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:18.751521 30815 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:18.746380 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:18.694588 30817 consensus_queue.cc:1175] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:18.775071 30844 raft_consensus.cc:993] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:18.870513 30842 raft_consensus.cc:1081] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:18.871047 30841 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.871667 30841 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:18.872664 30841 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:18.873510 29538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:18.874205 29538 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.874699 29538 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.882838 30831 tablet_copy_client.cc:670] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
W20260709 13:12:18.878188 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 131900us
I20260709 13:12:18.895040 30831 tablet_copy_client.cc:538] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:18.919919 30815 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.921145 30815 tablet_bootstrap.cc:492] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:18.921963 30815 ts_tablet_manager.cc:1403] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.171s	user 0.023s	sys 0.002s
I20260709 13:12:18.926116 29463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59308
I20260709 13:12:18.927189 29463 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.927994 29463 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.945070 29538 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:18.949906 30831 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:18.944802 30815 raft_consensus.cc:359] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:18.950634 30815 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:18.951503 30815 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:18.965837 30815 ts_tablet_manager.cc:1434] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:12:18.970774 29292 catalog_manager.cc:5697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.989857 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-225e23ac0b4c490cb213c4d4945ec334 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:18.990674 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-225e23ac0b4c490cb213c4d4945ec334 on tablet 225e23ac0b4c490cb213c4d4945ec334 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:18.995366 29538 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:18.996091 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:18.996850 29465 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:18.997169 29465 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:18.998042 29465 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:18.998261 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:19.000262 30157 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.999787 29465 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.017112 30157 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:19.019069 29509 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:19.020079 30817 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:19.020674 30817 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:19.021592 30817 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:19.060891 29295 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.065595 30831 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.073385 29465 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:19.078642 30831 tablet_bootstrap.cc:492] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:19.080976 30831 ts_tablet_manager.cc:1403] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.004s
I20260709 13:12:19.084822 30831 raft_consensus.cc:359] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:19.085726 30831 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:19.090777 29463 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:19.094323 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:19.094951 29392 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.099130 29463 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:19.098755 30831 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:19.100294 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:19.100943 29538 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:19.101240 29538 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:19.102108 29538 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:19.103245 29538 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.118703 30831 ts_tablet_manager.cc:1434] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.005s
I20260709 13:12:19.122627 29538 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:19.123788 29438 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:19.124809 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-38fdcb033993416ca10b3d79544c9d59 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:12:19.125321 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-38fdcb033993416ca10b3d79544c9d59 on tablet 38fdcb033993416ca10b3d79544c9d59 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:19.127285 30842 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:19.127918 30842 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:19.128989 30842 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:19.134541 29291 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.157660 30841 raft_consensus.cc:1064] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:19.160550 30841 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:19.173264 29392 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:19.206697 30157 raft_consensus.cc:1217] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
W20260709 13:12:19.207970 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 63623us
I20260709 13:12:19.238240 30807 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.246850 29291 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.254050 29391 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.272032 30157 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:19.273737 30807 tablet_bootstrap.cc:492] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:19.274154 30844 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:19.274760 30807 ts_tablet_manager.cc:1403] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.534s	user 0.019s	sys 0.016s
I20260709 13:12:19.279261 30820 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:19.287423 29463 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:19.300240 29538 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.306828 29541 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.311789 29542 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:19.311589 30842 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:19.291028 30807 raft_consensus.cc:359] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:19.327975 30807 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:19.330566 30807 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:19.333884 30807 ts_tablet_manager.cc:1434] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:12:19.428647 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-8b624c2ca9f340c787fc611feea71f37 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:12:19.429255 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-8b624c2ca9f340c787fc611feea71f37 on tablet 8b624c2ca9f340c787fc611feea71f37 with peer c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:19.386183 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 94430.1us
I20260709 13:12:19.441316 30845 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:19.485414 29463 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:19.515053 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 70854.3us
W20260709 13:12:19.519366 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49450.2us
I20260709 13:12:19.522828 29463 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:19.532327 30882 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:12:19.538533 30817 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:19.541951 30882 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:19.598230 30157 raft_consensus.cc:1217] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:12:19.651332 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:19.651124 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 55961us
W20260709 13:12:19.669106 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71945.5us
I20260709 13:12:19.674330 30157 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:19.694598 29392 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.696491 30159 raft_consensus.cc:1217] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:19.738876 30844 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:12:19.848239 29546 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:19.743266 30820 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
W20260709 13:12:19.923506 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 211486us
W20260709 13:12:20.000166 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 151270us
W20260709 13:12:20.047031 30900 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:12:20.029639 30841 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:12:20.127534 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 474064us
W20260709 13:12:20.193056 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 136042us
W20260709 13:12:20.193692 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 188683us
I20260709 13:12:20.219743 30158 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:12:20.125576 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 106375us
I20260709 13:12:20.304265 29291 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:20.311291 30920 raft_consensus.cc:1064] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:20.314926 30915 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:20.367542 30892 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:20.376959 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.386541 30850 raft_consensus.cc:1064] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:20.395440 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:20.422015 30920 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:20.429039 29470 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:20.390232 30850 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:20.714207 30931 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:12:20.719869 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 152695us
W20260709 13:12:20.745944 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65783.2us
W20260709 13:12:20.756654 30928 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:12:20.835727 29541 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:20.847527 29542 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:20.849098 30158 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:20.849570 30159 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:20.856016 30844 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:20.861883 30718 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:20.863919 30718 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.868646 29389 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:20.872838 29389 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:20.874115 30920 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:20.885720 29546 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:20.894343 30915 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:20.904747 30844 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:12:20.921479 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 43757.1us
I20260709 13:12:20.987149 30844 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.021914 29541 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.035341 30894 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.057739 30889 raft_consensus.cc:1064] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:21.056401 29546 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.065483 29389 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.066341 30889 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:21.086565 30158 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.135855 29389 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.135815 30158 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.138137 29391 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:21.168027 29291 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.172586 29472 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:21.175868 30905 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:21.178607 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53158.7us
I20260709 13:12:21.187116 30158 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:21.205700 29292 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 2 to 3, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:21.225214 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80223us
I20260709 13:12:21.229945 30889 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:12:21.266626 29471 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:21.274187 30158 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:21.282637 30159 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:21.297039 29546 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:21.270151 29472 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:21.314268 30908 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:21.310079 30850 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:12:21.365095 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 60429.2us
I20260709 13:12:21.378500 30718 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:21.390246 30938 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.392724 30159 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.407907 29546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:21.408803 29546 raft_consensus.cc:606] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:21.435904 29389 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:21.450860 30156 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:21.461036 30844 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.461467 29471 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.462352 29546 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.457311 29293 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.457296 30850 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:21.473156 30718 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:21.478861 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 248308us
I20260709 13:12:21.503062 29389 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:12:21.508620 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 53229.9us
I20260709 13:12:21.512498 29465 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:21.534919 29465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:21.535624 29465 raft_consensus.cc:606] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:21.536096 29465 raft_consensus.cc:630] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Rejecting request to transfer leadership because tablet server 7c2e8d3e55c649e2b3acedef25d81e16 is not a voter in the active config
I20260709 13:12:21.544454 30157 raft_consensus.cc:2955] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.618604 30899 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:12:21.632297 30906 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.640161 30155 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.651355 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 225e23ac0b4c490cb213c4d4945ec334 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:21.644150 30963 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:12:21.665181 30922 raft_consensus.cc:993] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:21.665819 30922 raft_consensus.cc:1081] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:21.675722 29392 raft_consensus.cc:2955] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.735081 29392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:21.735880 29392 raft_consensus.cc:606] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:21.741324 29396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36866
I20260709 13:12:21.742035 29396 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.742414 29396 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:21.774598 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 46169.5us
I20260709 13:12:21.789248 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:21.796968 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:21.824930 29392 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.816115 29292 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.857491 29295 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:21.850934 29396 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:21.881484 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 55331.9us
I20260709 13:12:21.888921 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 38fdcb033993416ca10b3d79544c9d59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:21.875370 30845 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:12:21.897657 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 113583us
I20260709 13:12:21.903185 29396 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:21.962252 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 225e23ac0b4c490cb213c4d4945ec334 with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36850
I20260709 13:12:21.966849 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 38fdcb033993416ca10b3d79544c9d59 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:21.971956 30159 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:12:21.983237 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 59495.1us
I20260709 13:12:21.993103 30982 tablet_replica.cc:333] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:12:22.010584 30983 tablet_replica.cc:333] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:12:22.021287 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e8fc42a067a41aa89e5d120919426e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:22.022110 30983 raft_consensus.cc:2243] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:22.012570 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 104044us
I20260709 13:12:22.022863 29295 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:22.033691 30983 raft_consensus.cc:2272] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:22.050626 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e8fc42a067a41aa89e5d120919426e3 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:22.057142 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:22.057945 29471 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:22.063063 30983 ts_tablet_manager.cc:1916] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:22.064518 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:22.065272 29539 raft_consensus.cc:3055] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:22.065584 29539 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:22.066526 29539 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:22.067935 29539 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:22.067914 29467 raft_consensus.cc:2955] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:22.074915 30982 raft_consensus.cc:2243] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:22.079140 30982 raft_consensus.cc:2272] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:22.085047 29471 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:22.089599 30982 ts_tablet_manager.cc:1916] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:22.113648 29546 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:22.117898 30983 ts_tablet_manager.cc:1929] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:22.118916 30983 log.cc:1199] T 38fdcb033993416ca10b3d79544c9d59 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/38fdcb033993416ca10b3d79544c9d59
I20260709 13:12:22.121181 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 38fdcb033993416ca10b3d79544c9d59 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:22.121371 30983 tablet_replica.cc:333] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:12:22.122646 30983 raft_consensus.cc:2243] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:22.123839 30983 raft_consensus.cc:2272] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:22.127296 30983 ts_tablet_manager.cc:1916] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:22.129956 29539 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:22.136629 30159 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:22.146878 30971 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:22.159548 30942 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:22.163931 30159 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:22.179066 30845 raft_consensus.cc:993] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:22.179710 30845 raft_consensus.cc:1081] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:22.189750 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:22.190984 30882 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:22.197041 29293 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 4 to 5, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:22.198858 30882 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:22.199915 30882 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:22.220135 29471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59298
I20260709 13:12:22.220829 29471 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.221202 29471 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.236295 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b624c2ca9f340c787fc611feea71f37 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:22.248536 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b624c2ca9f340c787fc611feea71f37 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59284
I20260709 13:12:22.255471 29396 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:22.269482 30986 tablet_replica.cc:333] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:12:22.277083 30983 ts_tablet_manager.cc:1929] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:22.277083 29293 catalog_manager.cc:5697] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.277976 30983 log.cc:1199] T 3e8fc42a067a41aa89e5d120919426e3 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/3e8fc42a067a41aa89e5d120919426e3
I20260709 13:12:22.281065 29471 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:22.283486 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 3e8fc42a067a41aa89e5d120919426e3 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:22.301586 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:22.301878 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:22.302311 29396 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:22.302623 30159 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.302682 29396 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:22.303149 29471 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:22.311637 29396 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:22.312987 29396 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.315924 30159 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:22.317343 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:22.318427 30981 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:22.319201 30981 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:22.320176 30981 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:22.322890 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.308998 30982 ts_tablet_manager.cc:1929] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:12:22.332587 30982 log.cc:1199] T 225e23ac0b4c490cb213c4d4945ec334 P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/225e23ac0b4c490cb213c4d4945ec334
I20260709 13:12:22.336457 30986 raft_consensus.cc:2243] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:22.337639 30986 raft_consensus.cc:2272] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:22.338778 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 225e23ac0b4c490cb213c4d4945ec334 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:22.340716 30942 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:22.345857 30986 ts_tablet_manager.cc:1916] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:22.350131 29293 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.364102 29396 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:22.403798 29396 raft_consensus.cc:2955] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:22.404925 30986 ts_tablet_manager.cc:1929] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:12:22.405676 30986 log.cc:1199] T 8b624c2ca9f340c787fc611feea71f37 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/8b624c2ca9f340c787fc611feea71f37
I20260709 13:12:22.408795 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 8b624c2ca9f340c787fc611feea71f37 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:12:22.616235 29542 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:22.618525 30979 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:22.659745 29467 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:22.671645 30979 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:22.770277 30159 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:22.772969 30977 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:22.812183 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:22.816083 29396 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:22.824477 30718 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:23.000617 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:23.066218 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29e2fd913c0b414a81386c129004967f"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:23.067081 29467 raft_consensus.cc:606] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:23.070657 29396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:23.071375 29396 raft_consensus.cc:606] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:23.074934 29542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:23.075698 29542 raft_consensus.cc:606] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:23.079478 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:23.080073 29467 raft_consensus.cc:606] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:23.081312 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:23.083701 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:23.288698 30977 raft_consensus.cc:993] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:23.289400 30977 raft_consensus.cc:1081] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:12:23.291595 30157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:12:23.292274 30157 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.292691 30157 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.316939 30981 raft_consensus.cc:993] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:23.317662 30981 raft_consensus.cc:1081] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:23.327700 29542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29e2fd913c0b414a81386c129004967f"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:23.332912 29542 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.333446 29542 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:23.344362 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 79417.6us
I20260709 13:12:23.348865 30882 raft_consensus.cc:993] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:23.349494 30882 raft_consensus.cc:1081] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:12:23.355226 30157 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:23.356453 29468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59298
I20260709 13:12:23.365862 29468 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.366348 29468 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.379240 29468 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:23.449601 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:23.466758 29467 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:23.467098 29467 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:23.467938 29467 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:23.469231 29467 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.452476 30157 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:23.478308 29467 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:23.465634 29542 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:23.485881 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:23.486123 29343 auto_rebalancer.cc:629] Failed to schedule move for tablet 61f7f02fdc8243cd8806a09e7908831e: Remote error: Service unavailable: leader transfer in progress
I20260709 13:12:23.486892 30976 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:23.511610 29546 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:23.516763 29468 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:23.518365 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:23.540474 29391 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:23.540841 29391 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:23.520038 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:23.542906 30159 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.522915 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:23.546819 29471 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:23.547163 29471 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:23.548754 29471 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:23.549911 29471 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.542017 29391 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:23.550918 29391 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.528072 29542 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:23.553531 30159 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:23.537706 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:23.554312 29396 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.562538 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:23.567636 29471 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:23.571007 30977 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:23.576252 30977 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:23.573769 29467 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:23.577349 30977 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:23.578711 29512 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:23.579830 29509 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d03f148e37fd4109805d1d7b3b02b2fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.580941 30892 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:23.581506 30892 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:23.581646 30965 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:23.561657 30976 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:23.583098 30892 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:23.584295 30976 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:23.585714 29391 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:23.594702 30971 raft_consensus.cc:993] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:23.595561 30971 raft_consensus.cc:1081] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:23.581684 29396 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:23.625051 29293 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 3, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 3 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.646837 31002 raft_consensus.cc:2955] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:23.648988 29468 raft_consensus.cc:2955] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:23.670249 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:23.671118 29391 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.674211 29392 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:23.686708 29390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36866
I20260709 13:12:23.687471 29390 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.688138 29390 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.687439 29391 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:23.689818 30971 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:23.699651 29390 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:23.704643 29390 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:23.709808 29295 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.717257 29292 catalog_manager.cc:5697] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 3, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 3 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.739799 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:23.740594 29467 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.760183 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:23.761214 29541 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:23.761624 29541 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:23.763528 29467 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:23.765657 29391 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:23.767944 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:23.767441 29541 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:23.772373 29541 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.772827 30979 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:23.778736 30979 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:23.779734 30979 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:23.787796 29541 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:23.795143 29391 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:23.796993 29295 catalog_manager.cc:5697] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:23.842847 29390 raft_consensus.cc:2955] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:12:23.854238 29360 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0585fb6756aa496392b1ee0371aa9804. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.877655 29295 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:23.886865 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 74709.5us
I20260709 13:12:23.895278 29468 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:23.897442 29541 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:23.917495 30882 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:23.924410 31015 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:23.949389 31016 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:23.965310 29546 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:23.981737 29468 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:23.990058 29390 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:23.995467 30976 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:24.017333 29392 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:24.023169 29396 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:24.010637 29390 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:24.044049 29295 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 3, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.056110 30718 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:24.063088 31003 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:24.085171 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:24.109772 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 53501us
I20260709 13:12:24.113147 29465 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:12:24.171583 31020 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:12:24.126843 30976 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:12:24.188210 29467 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:12:24.191130 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 75725.3us
I20260709 13:12:24.209107 30892 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:12:24.241741 29360 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbc3743d348b41f48617d0cb35c85353. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:24.240247 31021 ts_tablet_manager.cc:933] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:24.250272 29468 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:24.252069 30882 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:12:24.285684 31034 ts_tablet_manager.cc:933] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:12:24.285945 29539 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:24.297267 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:24.296605 30882 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:12:24.365645 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 124326us
W20260709 13:12:24.367565 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 165031us
I20260709 13:12:24.371440 30159 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:24.418924 31034 tablet_copy_client.cc:323] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:12:24.308872 31021 tablet_copy_client.cc:323] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
W20260709 13:12:24.464895 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 97416.6us
I20260709 13:12:24.569586 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:24.577317 29467 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:24.588222 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 200854us
I20260709 13:12:24.570815 29468 raft_consensus.cc:606] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:12:24.669276 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 66951.9us
I20260709 13:12:24.674511 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet d03f148e37fd4109805d1d7b3b02b2fd from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:12:24.675199 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet d03f148e37fd4109805d1d7b3b02b2fd from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-d03f148e37fd4109805d1d7b3b02b2fd
I20260709 13:12:24.698697 31054 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:12:24.740191 31006 raft_consensus.cc:2955] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:24.776831 29541 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.784489 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet 0585fb6756aa496392b1ee0371aa9804 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:12:24.785205 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet 0585fb6756aa496392b1ee0371aa9804 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-0585fb6756aa496392b1ee0371aa9804
I20260709 13:12:24.785055 29467 raft_consensus.cc:2955] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:24.798384 29407 tablet_copy_source_session.cc:215] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:24.817538 31034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0585fb6756aa496392b1ee0371aa9804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.819087 29539 raft_consensus.cc:2955] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:24.820429 29556 tablet_copy_source_session.cc:215] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:24.783069 31057 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:12:24.823520 31006 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.855419 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03f148e37fd4109805d1d7b3b02b2fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:24.856122 29390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36373f233812459591c31993a4959894"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:24.856853 29390 raft_consensus.cc:606] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:24.861413 29546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef663d2174234a11995ce0c886e35150"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:24.862080 29546 raft_consensus.cc:606] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:24.864166 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:24.866411 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:24.887745 31064 ts_tablet_manager.cc:933] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
W20260709 13:12:24.910197 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 56072.2us
I20260709 13:12:24.914413 30892 raft_consensus.cc:993] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:24.914898 30892 raft_consensus.cc:1081] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
W20260709 13:12:24.937107 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 100433us
I20260709 13:12:24.943675 31057 raft_consensus.cc:993] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:24.974676 31057 raft_consensus.cc:1081] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:24.951508 29396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef663d2174234a11995ce0c886e35150"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36866
I20260709 13:12:24.977944 29396 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.979452 29396 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.985823 31064 tablet_copy_client.cc:323] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:12:24.963179 31061 raft_consensus.cc:993] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:24.987005 31043 raft_consensus.cc:1081] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:12:24.976392 29293 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 2, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 1 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.988174 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet cbc3743d348b41f48617d0cb35c85353 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:12:24.988833 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet cbc3743d348b41f48617d0cb35c85353 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-cbc3743d348b41f48617d0cb35c85353
I20260709 13:12:24.996958 29407 tablet_copy_source_session.cc:215] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:25.001765 31064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc3743d348b41f48617d0cb35c85353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:25.015393 29396 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:25.025542 29546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36373f233812459591c31993a4959894"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:12:25.027045 29546 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.027490 29546 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.034737 29542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:12:25.035373 29542 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.035722 29542 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.037194 31034 tablet_copy_client.cc:806] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:25.049913 31034 tablet_copy_client.cc:670] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:25.045503 29542 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:25.057514 29542 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:25.054201 31021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49092 (request call id 295) took 1011 ms. Trace:
I20260709 13:12:25.052035 29546 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:25.058719 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:25.074831 29468 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.059957 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:25.077759 29471 raft_consensus.cc:3055] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.078148 29471 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:25.079046 29471 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:25.080312 29471 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.090516 29546 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:25.069955 31034 tablet_copy_client.cc:538] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:25.091791 29396 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:25.095237 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44270.4us
I20260709 13:12:25.096865 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:25.071514 31021 rpcz_store.cc:276] 0709 13:12:24.042401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.042878 (+   477us) service_pool.cc:224] Handling call
0709 13:12:24.249331 (+206453us) ts_tablet_manager.cc:934] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
0709 13:12:24.853950 (+604619us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:24.882037 (+ 28087us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:24.882177 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:25.030105 (+147928us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:25.050408 (+ 20303us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:25.054049 (+  3641us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:25.054122 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":2250,"tablet-copy.queue_time_us":167611,"thread_start_us":136668,"threads_started":2}
I20260709 13:12:25.097640 29546 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:25.112927 29396 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.125370 31064 tablet_copy_client.cc:806] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:25.129598 31064 tablet_copy_client.cc:670] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:25.130967 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:25.132339 29391 raft_consensus.cc:3055] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.132655 29391 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:25.133512 29391 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:25.133795 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:25.134680 30159 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.135049 29391 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.136482 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:25.137042 29542 raft_consensus.cc:3055] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:25.137351 29542 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:25.128700 29468 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:25.154692 31021 tablet_copy_client.cc:806] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:25.158506 31021 tablet_copy_client.cc:670] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:25.158921 29391 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:25.157649 29471 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:25.154748 29542 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:25.163869 29542 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.166683 29512 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:25.178483 31002 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.179030 31002 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:25.180027 31002 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:25.180428 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:25.186820 31034 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:25.187216 31057 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.191700 31057 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:25.190862 31064 tablet_copy_client.cc:538] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:25.192772 31057 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:25.194348 29396 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:25.172488 30159 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:25.188082 29542 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:25.204679 31021 tablet_copy_client.cc:538] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:25.206645 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:25.218614 31003 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.219144 31003 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:25.220069 31003 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:25.228370 31021 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:25.231943 29292 catalog_manager.cc:5697] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.211206 31064 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:12:25.452499 29294 catalog_manager.cc:5697] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:25.443410 31076 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.152s	user 0.000s	sys 0.007s
W20260709 13:12:25.531617 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 58256.6us
W20260709 13:12:25.546695 31074 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:12:25.606650 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 57983.9us
I20260709 13:12:25.609576 29471 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.623551 31034 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:25.633035 31002 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:25.635711 29294 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.639128 31034 tablet_bootstrap.cc:492] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:25.655758 31034 ts_tablet_manager.cc:1403] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.469s	user 0.036s	sys 0.001s
I20260709 13:12:25.671598 29389 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.712639 31077 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:25.661296 31034 raft_consensus.cc:359] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:25.714195 31034 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:25.715077 31034 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:25.719302 31034 ts_tablet_manager.cc:1434] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.005s
I20260709 13:12:25.721594 31021 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:25.722944 31021 tablet_bootstrap.cc:492] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:25.723881 31021 ts_tablet_manager.cc:1403] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.496s	user 0.024s	sys 0.022s
I20260709 13:12:25.731572 30155 raft_consensus.cc:1217] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:12:25.751910 31021 raft_consensus.cc:359] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:25.752902 31021 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:25.753679 31021 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:25.765666 29543 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.764698 30155 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:25.772360 29396 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:25.779327 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-0585fb6756aa496392b1ee0371aa9804 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:12:25.779278 31002 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:25.780076 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-0585fb6756aa496392b1ee0371aa9804 on tablet 0585fb6756aa496392b1ee0371aa9804 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:25.781539 31021 ts_tablet_manager.cc:1434] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:12:25.826279 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-d03f148e37fd4109805d1d7b3b02b2fd received from {username='slave'} at 127.0.0.1:51828
I20260709 13:12:25.831075 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-d03f148e37fd4109805d1d7b3b02b2fd on tablet d03f148e37fd4109805d1d7b3b02b2fd with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:25.803100 31027 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:12:25.793474 31088 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:12:25.879034 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:25.884842 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 89499.9us
W20260709 13:12:25.886632 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 88211.2us
W20260709 13:12:26.106184 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 166764us
W20260709 13:12:26.128867 31064 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:12:26.565395 30123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.114s	sys 0.159s
W20260709 13:12:26.567049 30123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.114s	sys 0.159s
W20260709 13:12:26.573392 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 335760us
W20260709 13:12:26.589954 31094 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.435s	user 0.000s	sys 0.002s
W20260709 13:12:26.590961 31096 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.532s	user 0.002s	sys 0.000s
W20260709 13:12:26.752666 31064 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
W20260709 13:12:26.883827 31094 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
W20260709 13:12:26.940593 30126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.045s
W20260709 13:12:26.944613 30126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.004s	sys 0.045s
W20260709 13:12:26.954967 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 379383us
W20260709 13:12:26.952629 29510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.002s	sys 0.048s
W20260709 13:12:26.984440 29510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.003s	sys 0.049s
I20260709 13:12:27.032781 31064 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:27.043375 30125 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.028s	sys 0.041s
W20260709 13:12:27.051684 30125 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.028s	sys 0.042s
W20260709 13:12:27.040270 29389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.031s	sys 0.031s
W20260709 13:12:27.062325 29389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.032s	sys 0.031s
W20260709 13:12:27.063980 29512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.014s	sys 0.018s
W20260709 13:12:27.065196 29512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.015s	sys 0.018s
I20260709 13:12:27.067727 29471 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.040645 31111 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:27.092762 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 57373.1us
W20260709 13:12:27.148413 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48640.2us
I20260709 13:12:27.143918 31081 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.106483 31044 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.091936 30977 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.175880 31002 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.196610 31124 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.196040 31002 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.199712 31104 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.201532 31002 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:27.200860 31104 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.183869 31064 tablet_bootstrap.cc:492] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:12:27.112136 31111 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.228428 31117 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.230813 31116 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.233064 31102 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.234952 31106 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:27.197999 31124 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.258044 31126 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.258822 31099 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.259825 31016 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.320981 31102 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.268114 31006 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.204993 30977 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.425550 31132 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.406032 31064 ts_tablet_manager.cc:1403] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 2.195s	user 0.050s	sys 0.037s
I20260709 13:12:27.258361 31113 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.405269 31101 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.415617 31095 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.203998 31081 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.204574 31044 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.464370 31027 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.530642 31130 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.489281 31100 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.461082 31016 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.461369 31006 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.405192 31116 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.532919 31130 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.456106 31126 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.512395 31095 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.406418 31106 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.443243 31099 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.650578 31088 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.657905 31040 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.653900 29294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 287) took 1502 ms. Trace:
I20260709 13:12:27.490828 31101 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.660653 29294 rpcz_store.cc:276] 0709 13:12:26.138147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.138396 (+   249us) service_pool.cc:224] Handling call
0709 13:12:27.640483 (+1502087us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567,"reported_tablets":1}
I20260709 13:12:27.646097 31128 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.655758 31115 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.660017 31040 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:27.750286 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 70583.2us
I20260709 13:12:27.680685 31105 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.439071 31117 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.759878 31133 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.728104 31043 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.658665 31088 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.770550 31127 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.778383 31022 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.768679 31003 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.781157 31016 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:27.781566 31106 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:27.781647 30977 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:27.782064 31006 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:27.782819 31104 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:27.542809 31113 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.544934 31027 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.562512 31100 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.806205 31045 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:27.748797 31111 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:27.782614 31136 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:27.751827 31128 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:27.800311 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 48917.9us
I20260709 13:12:27.489372 31132 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.761879 31109 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.757721 31077 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.752905 31137 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:27.835815 30158 raft_consensus.cc:1217] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:27.793833 31116 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:27.773281 31078 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.783937 31135 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.847493 31126 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:27.809139 31125 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.828514 31016 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.826936 31003 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.762784 31115 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.822795 31133 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.798910 31043 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.830256 31127 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:27.818611 31105 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:27.837445 31006 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.832202 31022 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.310310 29291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 280) took 1361 ms. Trace:
I20260709 13:12:27.851994 31141 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:28.305253 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:27.862107 31124 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:28.348599 29362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.006s	sys 0.016s
I20260709 13:12:28.350121 31123 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:28.337154 29360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.013s	sys 0.005s
I20260709 13:12:28.312878 29291 rpcz_store.cc:276] 0709 13:12:26.948726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.948986 (+   260us) service_pool.cc:224] Handling call
0709 13:12:28.310135 (+1361149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":615682,"reported_tablets":1}
W20260709 13:12:27.996615 31122 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.543s	user 0.000s	sys 0.004s
I20260709 13:12:27.948755 31044 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:27.971093 31082 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:27.984457 31086 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.091822 31140 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:28.372045 31125 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.365180 31110 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.151783 31049 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:28.409554 29360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.015s	sys 0.007s
I20260709 13:12:28.024863 31113 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:27.987175 31101 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.260020 31117 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.410622 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:28.452401 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.000s	sys 0.051s
W20260709 13:12:28.476454 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.000s	sys 0.052s
I20260709 13:12:27.970480 31131 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.325793 31116 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:27.885028 31081 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.484346 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:28.142243 31128 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:27.893057 31136 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.028955 31100 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:28.293712 31040 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.290707 31099 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.380927 31077 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:28.468127 29362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.009s	sys 0.020s
W20260709 13:12:28.471233 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.190s	user 0.023s	sys 0.085s
W20260709 13:12:28.502570 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.024s	sys 0.085s
W20260709 13:12:28.504949 29438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.015s	sys 0.031s
W20260709 13:12:28.505328 29438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.016s	sys 0.032s
I20260709 13:12:28.309569 31016 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.491041 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:28.120059 31139 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.497750 31132 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:28.486634 31101 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.498937 31138 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:28.499402 31107 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.499756 31120 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:28.525117 29509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.028s	sys 0.087s
W20260709 13:12:28.526280 29509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.028s	sys 0.087s
I20260709 13:12:27.871810 31045 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:28.509711 30123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.014s	sys 0.066s
I20260709 13:12:28.480033 31046 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.510069 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1512) took 2606 ms. Trace:
I20260709 13:12:28.488626 31057 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:28.517115 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:28.522655 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:28.492147 31088 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.527191 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:28.535904 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:28.506184 31113 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:28.477870 31110 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.370893 31006 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.532073 29389 rpcz_store.cc:276] 0709 13:12:25.895205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.898587 (+  3382us) service_pool.cc:224] Handling call
0709 13:12:25.898896 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.935416 (+ 36520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.935467 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:25.939870 (+  4403us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.063923 (+1124053us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:27.064064 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.064263 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:28.501835 (+1437572us) raft_consensus.cc:1685] finished
0709 13:12:28.501858 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:28.501996 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84062,"raft.queue_time_us":36199,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":108636,"thread_start_us":935990,"threads_started":1,"wal-append.queue_time_us":1015699}
W20260709 13:12:28.531795 30123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.015s	sys 0.067s
I20260709 13:12:28.402920 31141 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.508195 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:28.536718 29390 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:28.489127 31116 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.473688 31123 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.509841 31130 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.525717 31081 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:28.381590 31078 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.513417 31146 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:28.612866 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:28.532060 31102 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:28.536435 29361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.034s	sys 0.069s
W20260709 13:12:28.634824 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 117390us
I20260709 13:12:28.372422 31137 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.380340 31135 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.638922 31144 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:28.639459 31079 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.639812 31149 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.531776 31101 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.538668 31114 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.476714 31086 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.489483 31049 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.538671 31057 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:28.480736 31140 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.544695 31022 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.371825 31109 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.541126 31151 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:28.513087 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:28.537081 31138 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.542927 31113 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.648698 31103 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.513638 31131 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.532531 31139 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.538223 31107 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.492188 31082 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:28.546077 31046 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:29.243104 29361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.814s	user 0.045s	sys 0.096s
I20260709 13:12:28.799026 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:28.815966 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:28.625679 31088 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:29.060293 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 94801.6us
W20260709 13:12:29.250659 29436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.030s	sys 0.052s
I20260709 13:12:29.119825 29294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 288) took 1282 ms. Trace:
I20260709 13:12:28.825837 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:28.780151 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:28.886924 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 349352us
I20260709 13:12:28.650307 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:28.881699 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:29.223349 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.002s	sys 0.008s
I20260709 13:12:29.078992 29292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 167) took 3178 ms. Trace:
I20260709 13:12:28.794466 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:29.071468 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:29.111034 31136 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:29.324350 31116 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.640548 31129 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.571004 31150 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.969341 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:28.816798 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:29.324934 31006 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.606549 31120 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:29.308802 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:29.339362 29438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.005s	sys 0.009s
W20260709 13:12:29.868710 29438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.019s	sys 0.015s
W20260709 13:12:29.869486 29436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.045s	sys 0.084s
I20260709 13:12:29.870474 29541 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
W20260709 13:12:29.872216 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.018s	sys 0.030s
W20260709 13:12:29.872771 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 285424us
W20260709 13:12:29.822182 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 528220us
I20260709 13:12:29.873449 29294 rpcz_store.cc:276] 0709 13:12:27.837695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.838007 (+   312us) service_pool.cc:224] Handling call
0709 13:12:29.119735 (+1281728us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1154351,"reported_tablets":1}
I20260709 13:12:29.871977 29546 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:28.785614 31153 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:28.787624 31123 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.640514 31142 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:29.871438 29543 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:28.794252 31040 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:29.871991 29466 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:29.444893 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1548) took 1431 ms. Trace:
I20260709 13:12:29.242921 29465 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:29.406836 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 311) took 1575 ms. Trace:
I20260709 13:12:29.252796 31077 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.770499 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 544) took 1489 ms. Trace:
I20260709 13:12:28.985448 31095 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:29.935097 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1517) took 1631 ms. Trace:
I20260709 13:12:29.873572 31049 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.769266 31115 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.789006 31133 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.768075 31127 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:30.012760 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 144174us
I20260709 13:12:29.913631 31101 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:29.912581 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 188) took 1104 ms. Trace:
I20260709 13:12:28.807449 31117 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:28.773360 31132 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:30.209200 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:28.901446 31159 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:28.927680 31160 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:29.995579 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1475) took 1487 ms. Trace:
I20260709 13:12:28.799187 31099 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:29.863464 31057 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.659403 31003 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:28.807044 31125 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.802552 31061 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:30.055110 29540 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:28.780546 31130 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:29.079007 31121 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:28.975740 31100 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:29.871498 29292 rpcz_store.cc:276] 0709 13:12:25.883252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.883449 (+   197us) service_pool.cc:224] Handling call
0709 13:12:29.061251 (+3177802us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120630,"reported_tablets":2}
I20260709 13:12:29.252655 31141 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:29.388458 31079 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:28.965551 31161 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:12:29.918701 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 44105.7us
I20260709 13:12:28.782892 31043 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:29.251767 31027 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:28.814767 31147 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:29.110296 31148 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:29.860514 31086 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.763680 31105 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:28.772958 31152 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:29.295794 31114 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:29.359150 31129 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.265183 29546 rpcz_store.cc:276] 0709 13:12:28.773724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.773858 (+   134us) service_pool.cc:224] Handling call
0709 13:12:29.877724 (+1103866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:29.253892 31081 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:29.122890 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 343) took 1267 ms. Trace:
I20260709 13:12:30.266752 29468 rpcz_store.cc:276] 0709 13:12:28.264925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.326303 (+ 61378us) service_pool.cc:224] Handling call
0709 13:12:28.327257 (+   954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.443141 (+1115884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.443181 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:29.864664 (+421483us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:29.864721 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.895624 (+ 30903us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540006fc54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:29.895717 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.895910 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565614976}
W20260709 13:12:30.054219 29470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1476) took 1381 ms (client timeout 1595 ms). Trace:
W20260709 13:12:30.055562 29463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1474) took 1426 ms (client timeout 1599 ms). Trace:
W20260709 13:12:30.270239 29466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1471) took 1762 ms (client timeout 1520 ms). Trace:
W20260709 13:12:30.271539 29465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1477) took 1752 ms (client timeout 1664 ms). Trace:
I20260709 13:12:30.271955 29539 rpcz_store.cc:276] 0709 13:12:28.014238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.015746 (+  1508us) service_pool.cc:224] Handling call
0709 13:12:28.060830 (+ 45084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.437782 (+1376952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.437835 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:29.437899 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:29.437953 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.444618 (+  6665us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540037d7d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:29.444665 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.444795 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3165668224}
W20260709 13:12:30.274742 29543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 189) took 1484 ms (client timeout 1547 ms). Trace:
I20260709 13:12:28.878232 31154 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:29.253072 31064 raft_consensus.cc:359] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:29.324393 31140 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:29.507691 31162 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:29.251135 31151 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:29.361904 31045 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:30.056027 30126 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.547s (SENT) [suppressed 2 similar messages]
I20260709 13:12:29.562166 31138 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:30.278256 29464 rpcz_store.cc:276] 0709 13:12:28.508634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.530403 (+ 21769us) service_pool.cc:224] Handling call
0709 13:12:29.995472 (+1465069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:29.405038 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:29.360810 31149 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.270668 30155 rpcz_store.cc:276] 0709 13:12:27.832398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.832754 (+   356us) service_pool.cc:224] Handling call
0709 13:12:27.851275 (+ 18521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.253194 (+1401919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.253244 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:29.253308 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:29.253353 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.406489 (+153136us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54004736d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:29.406563 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.406743 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3223387520}
W20260709 13:12:30.284528 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 410841us
I20260709 13:12:30.057737 31006 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:30.286695 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 192) took 1470 ms. Trace:
I20260709 13:12:29.841430 31156 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:30.136335 31150 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:30.264591 31113 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:29.102162 31016 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:30.292946 31161 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.291834 31109 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:30.292307 31079 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:30.294860 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:30.275681 31137 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:30.240276 31163 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:29.436988 31103 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.301726 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:30.287894 31049 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:29.404241 31110 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:30.278371 31117 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.283550 31040 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.281664 31132 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.178458 31153 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.288823 31159 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.284781 31099 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:29.878464 31088 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:29.296916 31146 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:29.471107 31144 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.400177 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1549) took 2373 ms. Trace:
W20260709 13:12:30.635223 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.023s	sys 0.063s
W20260709 13:12:30.386461 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 99643.4us
W20260709 13:12:30.386595 29466 rpcz_store.cc:269] 0709 13:12:28.507356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.507549 (+   193us) service_pool.cc:224] Handling call
0709 13:12:30.270159 (+1762610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:30.672770 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:30.385866 29463 rpcz_store.cc:269] 0709 13:12:28.508324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.508449 (+   125us) service_pool.cc:224] Handling call
0709 13:12:29.934943 (+1426494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408}
W20260709 13:12:30.386132 29465 rpcz_store.cc:269] 0709 13:12:28.519415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.612503 (+ 93088us) service_pool.cc:224] Handling call
0709 13:12:30.271446 (+1658943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:30.681581 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:30.374799 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:31.096674 29361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.035s	sys 0.074s
W20260709 13:12:31.117218 29361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.038s	sys 0.086s
I20260709 13:12:31.116842 29539 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:31.116439 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:31.118153 29539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1503) took 1535 ms (client timeout 1975 ms). Trace:
W20260709 13:12:31.118775 29539 rpcz_store.cc:269] 0709 13:12:29.582668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.681259 (+1098591us) service_pool.cc:224] Handling call
0709 13:12:31.117926 (+436667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.119179 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:31.119439 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:31.121232 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:30.682263 29540 rpcz_store.cc:276] 0709 13:12:28.816053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.816290 (+   237us) service_pool.cc:224] Handling call
0709 13:12:30.286403 (+1470113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:30.726266 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1504) took 1143 ms. Trace:
I20260709 13:12:31.122913 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.123355 29541 rpcz_store.cc:276] 0709 13:12:29.583035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.294580 (+711545us) service_pool.cc:224] Handling call
0709 13:12:30.726143 (+431563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.124938 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.124986 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.125968 29541 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
W20260709 13:12:30.367534 29470 rpcz_store.cc:269] 0709 13:12:28.510418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.612788 (+102370us) service_pool.cc:224] Handling call
0709 13:12:29.892166 (+1279378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.127036 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.127205 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:30.682003 29543 rpcz_store.cc:269] 0709 13:12:28.790226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.877381 (+ 87155us) service_pool.cc:224] Handling call
0709 13:12:30.274653 (+1397272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.129395 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.130318 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.130890 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.131835 29540 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:31.131927 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:31.128862 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:30.700469 29542 rpcz_store.cc:276] 0709 13:12:28.015162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.034261 (+ 19099us) service_pool.cc:224] Handling call
0709 13:12:28.035696 (+  1435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.211533 (+2175837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.211582 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:30.211641 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:30.211683 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.387942 (+176259us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b5400396554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:30.388025 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.388177 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4926761216}
I20260709 13:12:31.135320 29541 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:31.137759 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1489) took 2255 ms. Trace:
I20260709 13:12:31.140172 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:31.141043 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1498) took 1652 ms. Trace:
I20260709 13:12:31.116397 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:30.297257 31061 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:31.138077 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1497) took 1765 ms. Trace:
I20260709 13:12:29.913467 31082 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:30.296265 31100 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:31.313163 31107 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:30.293638 31130 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.297648 31160 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.681182 31162 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.668768 31172 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:31.277037 29541 rpcz_store.cc:276] 0709 13:12:29.489108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.136945 (+1647837us) service_pool.cc:224] Handling call
0709 13:12:31.140039 (+  3094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.140538 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.140568 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.140675 (+   107us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:31.140738 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.140816 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.140952 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.161329 31040 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.141930 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:31.170228 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.024s	sys 0.068s
I20260709 13:12:31.142629 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1496) took 1909 ms. Trace:
I20260709 13:12:31.169879 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1493) took 2282 ms. Trace:
I20260709 13:12:31.324084 31120 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:31.257057 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:31.196496 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:31.168023 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1491) took 2281 ms. Trace:
I20260709 13:12:31.231824 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:31.138379 29537 rpcz_store.cc:276] 0709 13:12:28.882408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.883771 (+  1363us) service_pool.cc:224] Handling call
0709 13:12:28.884293 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.691379 (+1807086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.691412 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:30.691455 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:30.691484 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.136944 (+445460us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54001b9754. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:31.137044 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.137414 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4155388288}
I20260709 13:12:31.233214 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:31.320252 31144 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.297397 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:30.726991 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1502) took 1144 ms. Trace:
I20260709 13:12:31.159066 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:31.262364 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:30.944507 30123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.004s	sys 0.032s
I20260709 13:12:30.369411 31147 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:31.307724 29542 rpcz_store.cc:276] 0709 13:12:29.373125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.136277 (+1763152us) service_pool.cc:224] Handling call
0709 13:12:31.136921 (+   644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.137539 (+   618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.137568 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.137628 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:31.137666 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.137744 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.137841 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.245505 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:30.399735 31168 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:30.629292 31169 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:30.669528 31086 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:31.192370 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52770.9us
W20260709 13:12:31.250898 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 1.19468e+06us
I20260709 13:12:31.345115 31172 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:30.637313 31142 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:30.400616 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 110707us
I20260709 13:12:31.160190 30153 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:30.299299 31157 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:30.642359 31177 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:31.343346 31138 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:31.320572 31100 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:30.669716 31105 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:30.303175 31133 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:31.328315 31130 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:30.766040 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:30.684394 31064 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:12:30.767841 31156 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.766415 31163 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.368997 31148 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:30.376621 31057 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 1.089s
I20260709 13:12:30.726923 31049 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.636953 31152 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.395625 31121 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:30.690896 30151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 348) took 2196 ms (client timeout 1975 ms). Trace:
I20260709 13:12:31.350399 29546 rpcz_store.cc:276] 0709 13:12:28.886964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.770572 (+1883608us) service_pool.cc:224] Handling call
0709 13:12:31.138868 (+368296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.169184 (+ 30316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.169219 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.169288 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:31.169331 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.169418 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.169628 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.580106 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:31.463201 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 111638us
I20260709 13:12:30.306675 30154 rpcz_store.cc:276] 0709 13:12:27.855899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.970836 (+114937us) service_pool.cc:224] Handling call
0709 13:12:29.122468 (+1151632us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540075e828. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ed8caaa1 00007f61ed945ebc 00007f61ed97b08c 00007f61ed96593b 00007f61ed9653d2 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c
0709 13:12:29.122800 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548960000}
W20260709 13:12:31.652339 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 302731us
I20260709 13:12:31.742514 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:31.878940 31088 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.880060 31149 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:31.880964 31160 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.880793 31105 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:31.350641 29543 rpcz_store.cc:276] 0709 13:12:29.233268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.133054 (+1899786us) service_pool.cc:224] Handling call
0709 13:12:31.141554 (+  8500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.142084 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.142130 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.142221 (+    91us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:31.142279 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.142380 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.142550 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.459811 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1501) took 1857 ms. Trace:
I20260709 13:12:31.889554 29537 rpcz_store.cc:276] 0709 13:12:29.581977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.364550 (+1782573us) service_pool.cc:224] Handling call
0709 13:12:31.434334 (+ 69784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.434862 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.434902 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.434983 (+    81us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:31.435026 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.435102 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.439102 (+  4000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.719769 29470 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:31.846334 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:30.269171 30156 rpcz_store.cc:276] 0709 13:12:27.173356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.177626 (+  4270us) service_pool.cc:224] Handling call
0709 13:12:27.196995 (+ 19369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.895060 (+698065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.912900 (+ 17840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.952021 (+ 39121us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:27.956901 (+  4880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.617222 (+660321us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54006e0ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:28.626787 (+  9565us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:28.650934 (+ 24147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541476736}
W20260709 13:12:31.355795 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 1.48581e+06us
I20260709 13:12:31.343428 31077 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:31.883229 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1550) took 1249 ms. Trace:
I20260709 13:12:30.766848 31171 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:30.637714 31046 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:30.368510 31043 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:31.727073 31159 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:31.884123 31105 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.899230 29542 rpcz_store.cc:276] 0709 13:12:30.634064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.881722 (+1247658us) service_pool.cc:224] Handling call
0709 13:12:31.882325 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.882776 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.882810 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.882877 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:31.882915 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.883002 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.883143 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.351881 29544 rpcz_store.cc:276] 0709 13:12:28.886287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.405718 (+519431us) service_pool.cc:224] Handling call
0709 13:12:29.406203 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.636766 (+1230563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.636818 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:30.638823 (+  2005us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:30.638888 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.167293 (+528405us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540037c3d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:31.167377 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.167786 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2829231360}
I20260709 13:12:31.604300 31099 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.844878 31150 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.658710 31161 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:31.905424 29464 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:31.606158 31081 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:31.608767 31117 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:31.742161 31135 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.728835 31146 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:31.463459 31078 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:31.743072 31114 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.884531 31103 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:31.607563 31132 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:31.884277 31153 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:31.910621 30123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.976s	user 0.011s	sys 0.071s
I20260709 13:12:31.914451 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:31.606797 31129 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:31.888165 29545 rpcz_store.cc:276] 0709 13:12:29.582306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.289775 (+707469us) service_pool.cc:224] Handling call
0709 13:12:30.726917 (+437142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.886962 30152 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:31.660549 31061 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:31.462009 31151 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.881112 31138 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:31.463665 31154 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:31.887923 31169 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:30.768008 31006 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:31.882710 31157 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:31.882236 31133 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:31.931356 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.176862 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.240267 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1527) took 1127 ms. Trace:
I20260709 13:12:32.240593 29464 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:32.240783 29470 rpcz_store.cc:276] 0709 13:12:31.113290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.895752 (+782462us) service_pool.cc:224] Handling call
0709 13:12:32.240184 (+344432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.195912 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 313) took 1269 ms. Trace:
I20260709 13:12:32.243184 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1495) took 3204 ms. Trace:
I20260709 13:12:32.187177 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1556) took 1064 ms. Trace:
I20260709 13:12:32.180217 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1494) took 3293 ms. Trace:
I20260709 13:12:32.246122 29542 rpcz_store.cc:276] 0709 13:12:31.122810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.907670 (+784860us) service_pool.cc:224] Handling call
0709 13:12:32.034994 (+127324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.186626 (+151632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.186671 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.186762 (+    91us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:32.186807 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.186904 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.187073 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.080364 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1499) took 2542 ms. Trace:
I20260709 13:12:32.237293 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 151) took 1864 ms. Trace:
I20260709 13:12:32.246951 29539 rpcz_store.cc:276] 0709 13:12:28.887293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.119804 (+2232511us) service_pool.cc:224] Handling call
0709 13:12:31.120642 (+   838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.908833 (+788191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.908867 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.908937 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:31.908970 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.179935 (+270965us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54000f3cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:32.179993 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.180143 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805987584}
I20260709 13:12:32.179262 29472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1523) took 1513 ms. Trace:
I20260709 13:12:32.260303 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.178222 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 187) took 3407 ms. Trace:
I20260709 13:12:31.984972 29466 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:32.261803 29466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1539) took 1026 ms. Trace:
I20260709 13:12:32.175005 31099 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:32.244882 29540 rpcz_store.cc:276] 0709 13:12:29.039100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.132664 (+2093564us) service_pool.cc:224] Handling call
0709 13:12:31.133256 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.331609 (+198353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.331647 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.334972 (+  3325us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:31.335029 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.242937 (+907908us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540036cc54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:32.243004 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.243132 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451445120}
W20260709 13:12:32.261080 30153 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 346) took 3773 ms (client timeout 1661 ms). Trace:
I20260709 13:12:32.262909 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.263768 30155 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:32.226862 31131 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:32.265578 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.244881 30160 rpcz_store.cc:276] 0709 13:12:30.684255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.684440 (+   185us) service_pool.cc:224] Handling call
0709 13:12:31.931510 (+1247070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.924624 31147 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.602413 31139 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:32.255151 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.258876 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.259812 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 161) took 1628 ms. Trace:
I20260709 13:12:32.260234 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 153) took 1886 ms. Trace:
I20260709 13:12:32.262228 29466 rpcz_store.cc:276] 0709 13:12:31.235811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.443814 (+208003us) service_pool.cc:224] Handling call
0709 13:12:32.261734 (+817920us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:31.999402 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 47944.9us
I20260709 13:12:32.260761 29472 rpcz_store.cc:276] 0709 13:12:30.666198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.122319 (+456121us) service_pool.cc:224] Handling call
0709 13:12:31.142561 (+ 20242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.908973 (+766412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.909005 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.909078 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:31.909124 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.178952 (+269828us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540019afd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:32.179011 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.179164 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753301376}
I20260709 13:12:32.249363 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1538) took 1023 ms. Trace:
W20260709 13:12:32.082877 29360 connection.cc:256] RPC call timeout handler was delayed by -1.9010081480000736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
I20260709 13:12:32.249174 29469 rpcz_store.cc:276] 0709 13:12:30.372704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.376861 (+  4157us) service_pool.cc:224] Handling call
0709 13:12:30.377263 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.466133 (+1088870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.516592 (+ 50459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.568285 (+ 51693us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:31.568364 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.236653 (+668289us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54000d0554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:32.236745 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.237034 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2181901696}
I20260709 13:12:32.231812 31121 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:32.263200 30153 rpcz_store.cc:269] 0709 13:12:28.487614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.488451 (+   837us) service_pool.cc:224] Handling call
0709 13:12:32.249190 (+3760739us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54005a0854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:32.260964 (+ 11774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3502030592}
I20260709 13:12:32.268746 29468 rpcz_store.cc:276] 0709 13:12:30.631900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.120705 (+488805us) service_pool.cc:224] Handling call
0709 13:12:31.121274 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.339959 (+218685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.340013 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.340091 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:31.340134 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.259548 (+919414us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54002a44d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:32.259598 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.259749 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483796352}
I20260709 13:12:32.268818 29467 rpcz_store.cc:276] 0709 13:12:30.373450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.377526 (+  4076us) service_pool.cc:224] Handling call
0709 13:12:30.377850 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.402822 (+1024972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.402896 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.402968 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:31.403016 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.259779 (+856763us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540032d7d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:32.259824 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.260013 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351691648}
I20260709 13:12:32.176896 31142 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:32.232758 31049 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:32.269892 29464 rpcz_store.cc:276] 0709 13:12:31.221659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.176358 (+954699us) service_pool.cc:224] Handling call
0709 13:12:32.244496 (+ 68138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.039211 31148 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.272615 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.125586 31162 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:32.270078 29360 connection.cc:256] RPC call timeout handler was delayed by -1.6184081480000714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
I20260709 13:12:32.261363 29538 rpcz_store.cc:276] 0709 13:12:28.770276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.770870 (+   594us) service_pool.cc:224] Handling call
0709 13:12:28.771194 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.909617 (+3138423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.909671 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.909732 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:31.909772 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.177658 (+267886us) spinlock_profiling.cc:243] Waited 3.14 s on lock 0x7b540037cdd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:32.177740 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.177990 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7212197248}
I20260709 13:12:32.254406 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 316) took 1007 ms. Trace:
I20260709 13:12:32.276592 31163 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:31.951095 31064 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:32.283378 29466 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:32.283751 31146 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:32.284355 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.285147 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.290527 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1537) took 1136 ms. Trace:
I20260709 13:12:32.286330 29468 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:32.292497 29463 rpcz_store.cc:276] 0709 13:12:31.142205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.249106 (+1106901us) service_pool.cc:224] Handling call
0709 13:12:32.278137 (+ 29031us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:32.286633 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 2.37348e+06us
I20260709 13:12:32.293766 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.294694 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.290133 30158 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
W20260709 13:12:32.126906 30151 rpcz_store.cc:269] 0709 13:12:28.494752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.534788 (+ 40036us) service_pool.cc:224] Handling call
0709 13:12:29.252668 (+717880us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:12:30.690754 (+1438086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32406912}
I20260709 13:12:32.297183 31152 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:32.298353 31138 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.299736 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:31.993629 31171 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.304428 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:32.305380 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 391077us
I20260709 13:12:32.306023 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.306277 31171 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.306813 30158 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:32.057209 31077 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.207892 31168 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.307960 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.309307 31168 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.309952 31077 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:32.311749 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.314940 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.315655 29472 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
W20260709 13:12:32.317526 30123 connection.cc:256] RPC call timeout handler was delayed by -2.1987501290000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:12:32.317685 31154 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:32.317970 30123 connection.cc:256] RPC call timeout handler was delayed by -2.1780501289999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:12:32.318357 30123 connection.cc:256] RPC call timeout handler was delayed by -2.0430501289999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:12:32.318709 30123 connection.cc:256] RPC call timeout handler was delayed by -1.8810501289999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:12:32.319003 30123 connection.cc:256] RPC call timeout handler was delayed by -1.8810501289999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:12:32.320516 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1529) took 1189 ms. Trace:
I20260709 13:12:32.321300 31169 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:31.950516 31086 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.323379 29465 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:32.325451 31086 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.124884 31043 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.327133 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:32.328588 31043 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.124648 31177 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.330052 29471 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:32.332062 31177 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.333026 31156 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:32.319300 30123 connection.cc:256] RPC call timeout handler was delayed by -1.8549501289999171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:12:32.317531 29472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1526) took 1205 ms. Trace:
I20260709 13:12:32.306331 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:32.335052 29472 rpcz_store.cc:276] 0709 13:12:31.112494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.316489 (+1203995us) service_pool.cc:224] Handling call
0709 13:12:32.316914 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.317203 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.317230 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.317272 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:32.317300 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.317355 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.317460 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.336283 31061 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.336668 31061 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:32.337042 31061 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.337152 29472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1530) took 1205 ms. Trace:
I20260709 13:12:32.337538 29472 rpcz_store.cc:276] 0709 13:12:31.131839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.336159 (+1204320us) service_pool.cc:224] Handling call
0709 13:12:32.336511 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.336771 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.336800 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.336869 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:32.336901 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.336958 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.337076 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:32.339601 30126 connection.cc:256] RPC call timeout handler was delayed by -2.15152800199985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:12:32.340142 30126 connection.cc:256] RPC call timeout handler was delayed by -2.1254280019998077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:12:32.340519 30126 connection.cc:256] RPC call timeout handler was delayed by -2.0930280019997554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 13:12:32.340896 30126 connection.cc:256] RPC call timeout handler was delayed by -1.9639988869998888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:12:32.334918 30154 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:32.321008 29464 rpcz_store.cc:276] 0709 13:12:31.131366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.319225 (+1187859us) service_pool.cc:224] Handling call
0709 13:12:32.319596 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.319927 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.320194 (+   267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.320258 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:32.320293 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.320351 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.320454 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.291477 29469 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:32.341256 30126 connection.cc:256] RPC call timeout handler was delayed by -1.9027164779997747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:12:32.343034 30126 connection.cc:256] RPC call timeout handler was delayed by -1.9022647789997791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 13:12:32.304529 31133 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:32.343402 30126 connection.cc:256] RPC call timeout handler was delayed by -1.3047648179997395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
I20260709 13:12:32.291684 30156 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:32.344379 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.351219 30158 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:32.351538 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.344463 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.348042 31157 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.352849 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.353894 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:32.354344 29471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1535) took 1213 ms (client timeout 1542 ms). Trace:
I20260709 13:12:32.329802 31099 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:32.354770 29471 rpcz_store.cc:269] 0709 13:12:31.141279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.141423 (+   144us) service_pool.cc:224] Handling call
0709 13:12:32.354153 (+1212730us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5400215054. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:32.354249 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257416448}
I20260709 13:12:32.356755 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1542) took 1116 ms. Trace:
I20260709 13:12:32.357100 29471 rpcz_store.cc:276] 0709 13:12:31.240743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.355666 (+1114923us) service_pool.cc:224] Handling call
0709 13:12:32.356030 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.356404 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.356437 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.356485 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:32.356521 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.356587 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.356697 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.346235 31146 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:32.347602 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:32.349139 30126 connection.cc:256] RPC call timeout handler was delayed by -1.0927527289998125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
I20260709 13:12:32.348202 31169 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:32.277283 31172 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.361156 31146 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.363840 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1533) took 1230 ms. Trace:
I20260709 13:12:32.363937 31169 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:32.365116 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1540) took 1128 ms. Trace:
I20260709 13:12:32.370638 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1532) took 1238 ms. Trace:
I20260709 13:12:32.362103 29472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1534) took 1221 ms. Trace:
I20260709 13:12:32.371006 29465 rpcz_store.cc:276] 0709 13:12:31.236876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.353122 (+116246us) service_pool.cc:224] Handling call
0709 13:12:32.364911 (+1011789us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540019b4d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:32.365026 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992440576}
I20260709 13:12:32.371522 29464 rpcz_store.cc:276] 0709 13:12:31.132686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.342304 (+1209618us) service_pool.cc:224] Handling call
0709 13:12:32.370012 (+ 27708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.370272 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.370310 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.370365 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:32.370396 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.370474 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.370573 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.372118 29472 rpcz_store.cc:276] 0709 13:12:31.140872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.343008 (+1202136us) service_pool.cc:224] Handling call
0709 13:12:32.361337 (+ 18329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.361669 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.361721 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.361804 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:32.361840 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.361903 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.362021 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.365597 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:32.367579 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.369269 31006 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:32.248621 29541 rpcz_store.cc:276] 0709 13:12:29.545425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.344654 (+1799229us) service_pool.cc:224] Handling call
0709 13:12:31.345306 (+   652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.345959 (+   653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.345994 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.518024 (+172030us) log.cc:844] Serialized 26 byte log entry
0709 13:12:31.906128 (+388104us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:31.906294 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.918051 (+ 11757us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.079963 (+161912us) raft_consensus.cc:1685] finished
0709 13:12:32.079997 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.080205 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":395,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":1978,"thread_start_us":239716,"threads_started":1,"wal-append.queue_time_us":416406}
I20260709 13:12:32.341271 31064 ts_tablet_manager.cc:1434] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 4.862s	user 0.062s	sys 0.090s
I20260709 13:12:32.370886 29469 rpcz_store.cc:276] 0709 13:12:31.133164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.342746 (+1209582us) service_pool.cc:224] Handling call
0709 13:12:32.363229 (+ 20483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.363448 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.363478 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.363549 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:32.363579 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.363631 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.363764 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.374394 29545 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:32.285357 30152 rpcz_store.cc:276] 0709 13:12:31.241406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.241580 (+   174us) service_pool.cc:224] Handling call
0709 13:12:32.248223 (+1006643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.380419 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:32.376483 31064 ts_tablet_manager.cc:1467] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Tablet startup took 4903ms
I20260709 13:12:32.391332 29542 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.388609 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.401727 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:32.403395 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.404255 29389 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.412792 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.413776 29390 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:32.404847 31006 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:32.421054 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 75559.4us
I20260709 13:12:32.418865 31006 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:32.424345 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.427265 29390 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.427716 31006 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.427279 31180 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:32.438845 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 185252us
I20260709 13:12:32.434635 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:32.447010 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46186.4us
I20260709 13:12:32.447901 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.449368 29390 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.440938 31180 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:32.453763 31180 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:32.387516 31064 ts_tablet_manager.cc:1469] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Trace:
0709 13:12:24.848145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.848281 (+   136us) service_pool.cc:224] Handling call
0709 13:12:24.888222 (+ 39941us) ts_tablet_manager.cc:934] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
0709 13:12:25.000360 (+112138us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:25.032887 (+ 32527us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:25.033026 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:25.107473 (+ 74447us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:25.107822 (+   349us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:25.108203 (+   381us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:25.108278 (+    75us) inbound_call.cc:177] Queueing success response
0709 13:12:25.180210 (+ 71932us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800370ba0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e5758ed8 00007f61e58b3de2 00007f61ed918d23 00007f61ed91855d 00007f61ed9b43d8 00007f61ed9e5f4e 00007f61ed9cafdd
0709 13:12:25.210745 (+ 30535us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:12:27.479274 (+2268529us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:12:27.997042 (+517768us) tablet_replica.cc:261] Starting instrumentation
0709 13:12:28.486014 (+488972us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":300,"mutex_wait_us":52427,"raft.queue_time_us":43356,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":26308480,"tablet-copy.queue_time_us":38928,"tablet-download-pool.queue_time_us":179,"tablet-download-pool.run_cpu_time_us":1299,"tablet-download-pool.run_wall_time_us":26472,"thread_start_us":137205,"threads_started":2}
I20260709 13:12:32.468722 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.469635 29389 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:32.471139 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.471925 29389 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.469653 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.474888 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.477492 31061 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.480538 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.481287 29469 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:32.473018 29438 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:32.488325 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.488469 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.489089 29469 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:32.485749 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:32.499554 31135 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.499994 31135 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:32.500408 31135 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.500967 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.500766 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.501942 29390 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.500702 31086 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.503844 31086 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:32.504310 31086 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.482561 29512 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.507463 31077 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.507622 29512 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.507928 31077 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:32.508352 31077 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.510696 31139 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.508770 29512 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.500834 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.500784 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:32.526964 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.511168 31139 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:32.548985 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 48484.1us
I20260709 13:12:32.546547 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:32.553556 31137 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.554098 31137 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:32.554502 31137 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.548625 31139 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.557616 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:32.558621 29512 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.559703 31131 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.560292 31131 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:32.560722 31131 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.562356 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.562799 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.559757 31161 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.567108 31161 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:32.567617 31161 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:32.559703 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 47700us
I20260709 13:12:32.570468 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:32.572528 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 99659.3us
I20260709 13:12:32.575551 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:32.577486 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 60926.4us
I20260709 13:12:32.580963 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.582508 29360 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:32.582811 31121 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.582963 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.583427 31121 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:32.583922 31121 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.585246 31078 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.585682 31078 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:32.586055 31078 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.586833 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.583880 29391 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.590905 29472 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:32.592260 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.569481 31006 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:32.595724 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.596385 29391 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:32.596889 31006 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.597661 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.599179 29509 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:32.600315 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:32.580554 31061 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.572041 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.602851 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.603220 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.602187 31110 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:32.604524 31110 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:32.604909 31110 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:32.602816 31079 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.622674 31079 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:32.623226 31079 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.624905 29512 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.625883 31129 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.626302 31129 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:32.626565 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45520.1us
I20260709 13:12:32.626698 31129 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.624951 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.630771 29438 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.631899 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.637779 31146 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.638502 31146 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.638863 31146 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:32.639205 31146 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.634733 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.639221 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.638872 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.641304 29512 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.641360 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:32.649444 31148 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.649951 31148 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.652622 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.655221 31148 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.650346 29438 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:32.656256 29360 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:32.680169 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.681200 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:32.686169 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 45353.4us
I20260709 13:12:32.694959 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.686983 29512 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.697289 31142 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.697659 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.697853 31103 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:32.683324 31168 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.719769 31168 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:32.719934 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.720242 31168 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:32.702243 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51978.7us
I20260709 13:12:32.699195 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.699950 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.704634 31061 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:32.710786 29363 connection.cc:256] RPC call timeout handler was delayed by -2.5999651540000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:12:32.707376 31172 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.713441 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:32.708472 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.717919 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:32.723441 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 82176.2us
I20260709 13:12:32.717981 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.719059 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.719189 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:32.720677 29390 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.705852 31180 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:32.722086 29363 connection.cc:256] RPC call timeout handler was delayed by -2.532465153999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:12:32.726050 29363 connection.cc:256] RPC call timeout handler was delayed by -2.4703651540000919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:12:32.726534 29363 connection.cc:256] RPC call timeout handler was delayed by -2.1904651540000941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
I20260709 13:12:32.735337 29472 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:32.736951 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:32.739440 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.710532 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.711048 31142 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:32.740253 29464 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:32.725384 31172 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:32.748528 29388 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:32.750654 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.745889 31131 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:32.781019 31131 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:32.698411 31078 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:32.807844 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 126421us
W20260709 13:12:32.796448 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49568.5us
W20260709 13:12:32.800817 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 65616.7us
I20260709 13:12:32.742597 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:32.747656 31142 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.751926 31172 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.734453 31103 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:32.794639 31156 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:32.824677 29438 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:32.830135 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 103047us
I20260709 13:12:32.832558 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.839956 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.842120 29438 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:32.844883 29541 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:32.844947 29472 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:32.867631 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.845222 31171 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.863812 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:12:32.881922 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 43613.8us
I20260709 13:12:32.883011 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:32.883134 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.883944 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.863071 31061 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.852772 31131 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:32.887399 29388 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.877125 31171 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:32.892510 31171 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.849262 30151 raft_consensus.cc:1217] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:32.887936 29542 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:32.906268 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:32.909065 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 59520.7us
I20260709 13:12:32.935514 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:32.889323 31061 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:32.872651 31086 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:32.947458 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.947278 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.906952 31153 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.888861 31131 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:32.948120 29540 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:32.947896 31099 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:32.951128 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.948678 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.952965 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.955659 29472 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:32.951102 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.957173 29538 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:32.958143 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.961241 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.961311 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:32.958773 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 126634us
I20260709 13:12:32.958292 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:32.964084 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53628.7us
I20260709 13:12:32.964751 29435 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:32.963418 29546 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:32.965610 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:32.968164 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.968787 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.949150 31061 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.976855 29540 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:32.953737 30156 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:32.954140 31153 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:32.956321 31131 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.981195 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.962603 31180 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:32.956305 31099 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:32.984473 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.980046 29537 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:32.942581 31135 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:32.978477 31146 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:32.957890 31133 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:32.986733 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:32.988864 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:32.989641 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.990777 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.005752 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:32.951792 31110 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.010828 31133 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:32.999189 31099 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.998762 31043 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.006839 31103 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:32.951793 31077 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.007397 31078 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:32.990382 31153 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.014022 29468 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:33.029182 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.016072 31110 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:33.034148 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 69456.7us
I20260709 13:12:33.042891 29435 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:33.015018 31133 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:32.965342 31139 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:33.045966 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 57163.9us
I20260709 13:12:33.029621 31043 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:33.051707 29512 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.044564 29388 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:33.054416 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:33.012269 31129 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.068958 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.056932 29438 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.072671 29435 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:33.077802 31086 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.046154 31180 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:12:33.082608 31125 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:33.083135 31125 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.083525 31125 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:33.067574 31137 consensus_meta.cc:287] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.513s	user 0.017s	sys 0.023s
I20260709 13:12:33.055560 31157 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.038023 31161 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.100929 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:33.102545 29542 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:33.106945 31137 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.107055 31099 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.108546 29435 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:33.109172 31177 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:33.109638 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 52795.6us
I20260709 13:12:33.117378 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.053159 31148 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.114805 31086 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:33.070312 31043 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.116907 31177 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:33.122761 31146 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.124011 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.126622 31168 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.095420 31157 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:33.095340 31110 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:33.127769 31172 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.133876 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.093401 31164 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:33.136219 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.138152 29464 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:12:33.139382 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.140466 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.140611 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.141582 29512 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.142241 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.142390 31191 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.188759 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.124465 31086 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.132094 31177 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.124018 31006 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:33.168169 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:33.129097 31099 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.130714 31193 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.111573 31061 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.203814 31201 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:33.217571 31201 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.218025 31201 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.218183 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.218886 29396 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:33.146191 31157 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.209355 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.146706 31110 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:33.215095 31121 consensus_meta.cc:287] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.016s
I20260709 13:12:33.221006 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:33.210763 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 69291.1us
I20260709 13:12:33.186919 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.191717 31164 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.273821 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.125717 31142 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.228976 29395 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:33.278206 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 142083us
I20260709 13:12:33.274029 29392 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.192899 31191 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:33.275254 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 107255us
I20260709 13:12:33.273312 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.283648 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.285382 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:33.277597 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.280587 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.281608 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.199222 31086 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:33.287348 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.289412 29391 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.208875 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.292456 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.230362 31110 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:33.201311 31202 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.292841 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.297035 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.297848 29391 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:33.298110 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.298854 29397 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:33.299750 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.300360 29396 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:33.277588 31164 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.224815 31198 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:33.207767 31171 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.285567 31191 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.309780 29544 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:33.313817 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.273846 31204 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.230896 31193 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.256039 31121 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.317108 31125 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.295934 31135 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:33.302790 31202 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:33.303041 30154 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.295377 31077 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.320127 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.305016 31138 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:33.304895 31161 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.295688 31131 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.311873 31198 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.330173 29470 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.375190 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.406165 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.402222 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.365350 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.443344 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:33.434737 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 151752us
I20260709 13:12:33.365391 29472 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.417433 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.440696 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.448168 29467 raft_consensus.cc:2393] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:33.449546 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.380456 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.375664 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.378582 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:33.454542 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 169102us
I20260709 13:12:33.455844 31209 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:33.456612 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:33.458168 29544 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:33.460927 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.461541 30158 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.317488 31129 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.470640 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:33.486886 29468 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:33.488683 29545 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:33.321710 31204 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.419389 31125 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:33.362354 31114 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.440300 31139 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.359125 31202 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.423699 31148 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:33.504966 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.457294 31172 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.459502 31137 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.511163 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:33.370793 31203 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:33.511600 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.511982 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.529151 29541 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.459338 31198 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.514525 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.533185 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.533514 29538 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.515347 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.489945 31168 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.519544 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.528077 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:33.528582 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 147902us
I20260709 13:12:33.537367 29544 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.534747 29546 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:33.535516 29468 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:33.519994 31079 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.003s
I20260709 13:12:33.536541 29465 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.539131 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.532394 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.535797 29466 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.512794 31114 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:33.508239 31204 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.543846 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:33.547346 31210 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.548297 31131 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.552101 31171 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:33.530196 31125 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:33.512285 31061 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:33.564798 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 94334.8us
I20260709 13:12:33.536350 31142 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.554383 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.554037 31079 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.583609 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:33.590358 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.592482 29435 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:33.574175 31164 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:33.597144 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53436.6us
I20260709 13:12:33.559749 31114 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.621855 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.540699 31148 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.622648 30160 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:33.532652 31203 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.565755 31210 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:33.564059 31110 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.631592 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:33.630754 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.596500 31132 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:33.633520 29543 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.601239 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.639281 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:33.639102 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.627038 31121 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:33.642622 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71576.3us
I20260709 13:12:33.626921 31148 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:33.646396 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:33.629256 31203 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.654004 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.654274 31195 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.672905 30155 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.640990 31193 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.642228 31209 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:33.680382 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 87933.8us
I20260709 13:12:33.682569 29435 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:33.683758 30158 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:33.687799 31164 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.690742 31079 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:33.666950 31132 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:33.686451 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.696395 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.697113 29472 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.698873 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.699667 29463 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:33.645812 31148 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.704800 29541 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:33.706358 29544 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:33.711683 29540 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.714308 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.714602 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.715142 29466 raft_consensus.cc:2393] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 2: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:33.715953 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.716951 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.717027 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.717578 29469 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.717664 29466 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.707535 31161 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:12:33.708851 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:33.720975 31162 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.722797 31162 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:33.722246 31156 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.725958 29538 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:33.726524 29472 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:33.726974 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.727682 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.730064 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.730221 31061 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:33.738417 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:33.740482 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58205.1us
I20260709 13:12:33.742003 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:33.737893 29512 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.745622 29545 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:33.732607 31177 consensus_meta.cc:287] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.003s
I20260709 13:12:33.748188 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.743232 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:33.749074 29463 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.751485 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:33.754208 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:33.757956 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.765017 29544 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.741165 31061 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:33.769436 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.767264 31213 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:33.771309 31213 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:33.771740 31213 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.772718 29538 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 3: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:33.776146 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:33.779727 31142 raft_consensus.cc:1064] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:33.741652 31156 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:33.782344 30160 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:33.763990 31133 consensus_meta.cc:287] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.000s
I20260709 13:12:33.788055 29512 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:33.788043 31164 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:33.789748 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.772984 31061 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.795199 31193 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:33.791469 31132 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:33.792059 31156 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.752616 31201 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.783190 29466 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:33.808410 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.809141 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.809369 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.781443 31125 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:33.810674 31216 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:33.811342 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:33.812116 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.757113 31177 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.810410 29388 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.818127 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.810387 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.796518 31133 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.732180 29389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:33.735435 31162 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.785337 31135 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:33.823834 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:33.824885 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:33.826112 30158 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:33.815938 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:33.828948 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:33.799682 31110 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:33.832238 29389 raft_consensus.cc:606] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:33.838892 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:33.841445 29397 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:33.849620 29470 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.847306 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:33.847565 31157 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.006s
I20260709 13:12:33.852207 29509 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:33.857429 31153 consensus_meta.cc:287] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.800s	user 0.009s	sys 0.004s
I20260709 13:12:33.857860 31153 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.859699 29467 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:33.861802 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 85731.2us
W20260709 13:12:33.860651 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53035.9us
I20260709 13:12:33.868299 29512 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.869726 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:33.871492 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 83899.6us
I20260709 13:12:33.871542 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:33.872735 31079 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:33.873286 31079 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:33.873603 29438 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.874511 29438 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.874285 31079 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.874420 31221 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:33.875998 31221 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:33.877189 31121 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:33.877795 31121 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:33.877951 31221 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.879186 31221 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.878934 31121 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:33.881515 31086 consensus_meta.cc:287] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.003s
I20260709 13:12:33.881856 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:33.881922 31086 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.883456 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:33.884482 31079 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:33.885694 31214 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:33.886236 31214 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:33.886751 31222 consensus_queue.cc:1059] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:33.887285 31214 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.888043 31209 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:33.888592 31209 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:33.890110 31209 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.891685 31222 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:33.892059 31222 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:33.895056 29438 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.895470 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:33.896252 31217 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:33.896981 31217 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:33.884953 31086 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:33.898379 31217 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:33.870509 31172 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:33.905138 31172 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:33.905560 31172 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.907435 31224 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:33.908591 29468 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.867666 31131 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:33.920212 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:33.948796 29538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29e2fd913c0b414a81386c129004967f"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:33.949599 29538 raft_consensus.cc:606] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:33.953457 29541 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.954407 29543 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:33.958276 29389 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.955467 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.959308 29540 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:33.955031 29544 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:33.903689 31162 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.956657 29512 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.961391 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:33.962114 29538 raft_consensus.cc:2393] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:33.960309 29469 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:12:33.967219 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 85195.7us
I20260709 13:12:33.969906 29512 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:33.961148 31209 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:33.868324 31157 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:33.977517 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.978037 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.979285 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.980262 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.980581 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.980311 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.981148 29393 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:33.982192 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.984263 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.984763 29393 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.985075 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:33.969280 31131 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.987957 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.990386 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:33.988453 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 91771.4us
I20260709 13:12:33.991025 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:33.972222 31212 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:33.994796 29464 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:33.926831 31204 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.011632 30155 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:34.027213 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.987965 31193 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.034075 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.035284 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.035866 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.038522 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:33.992254 31131 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:33.975371 31203 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.045118 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.045779 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.046283 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:33.986362 31086 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:12:33.986107 31125 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:12:34.039407 31196 consensus_queue.cc:1059] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:12:34.126044 31157 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.117522 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:34.036890 31211 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:34.125142 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:12:34.127592 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.657s (SENT)
I20260709 13:12:34.042201 31193 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:34.228667 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.218904 30123 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.126921 31153 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.040614 31061 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:34.335891 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.339711 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 291977us
I20260709 13:12:33.997771 31214 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.136s
W20260709 13:12:34.240417 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.328830 31213 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
W20260709 13:12:34.323098 31202 consensus_meta.cc:287] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.786s	user 0.012s	sys 0.009s
W20260709 13:12:34.325775 31198 consensus_meta.cc:287] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.003s
I20260709 13:12:34.227617 31164 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.346675 31203 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.375191 29468 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:34.274187 31133 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:34.287254 31211 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:34.316525 31204 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:34.384910 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.231082 31201 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.371315 31137 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:12:34.271648 31225 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.449s
I20260709 13:12:34.343250 31172 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.409646 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.273504 31086 consensus_queue.cc:1243] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer 7c2e8d3e55c649e2b3acedef25d81e16 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:34.376231 31198 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.406625 31212 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:34.316260 31131 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:34.427693 31217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.012s	sys 0.032s
I20260709 13:12:34.374612 31202 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.373310 31213 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:34.428285 31161 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:34.470299 29463 consensus_meta.cc:287] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.715s	user 0.006s	sys 0.008s
I20260709 13:12:34.475072 30155 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:34.475690 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.484200 29463 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:12:34.453392 31195 consensus_meta.cc:287] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.005s
W20260709 13:12:34.483826 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 486109us
W20260709 13:12:34.455266 31217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.012s	sys 0.033s
W20260709 13:12:34.483350 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 115661us
I20260709 13:12:34.491664 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.451236 31212 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:34.453923 31164 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:34.214076 31228 consensus_queue.cc:1059] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.329s
I20260709 13:12:34.498128 29471 raft_consensus.cc:1240] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.495051 29392 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:34.479944 31099 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:34.495925 29512 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:34.487680 31216 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:34.514961 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 387381us
I20260709 13:12:34.499289 31195 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:34.518138 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.521696 29392 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:34.522027 31210 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.506639 31219 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:12:34.479163 31193 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.543569 29463 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:34.488583 31161 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:34.569566 30123 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.680s (SENT)
I20260709 13:12:34.570356 30123 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.627317 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.628365 29392 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:34.539480 31202 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:34.549083 30154 consensus_meta.cc:287] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.052s	user 0.017s	sys 0.003s
I20260709 13:12:34.537456 31198 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:34.493310 31211 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.679483 29390 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
W20260709 13:12:34.672178 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 108134us
I20260709 13:12:34.697599 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1557) took 1293 ms. Trace:
I20260709 13:12:34.698253 29471 rpcz_store.cc:276] 0709 13:12:33.409854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.417677 (+  7823us) service_pool.cc:224] Handling call
0709 13:12:33.418061 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.498666 (+1080605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.697236 (+198570us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540006fc54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:34.697526 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481893760}
I20260709 13:12:34.540326 31103 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.538196 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-cbc3743d348b41f48617d0cb35c85353 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:12:34.700268 31103 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:34.700516 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-cbc3743d348b41f48617d0cb35c85353 on tablet cbc3743d348b41f48617d0cb35c85353 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:34.670400 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.701499 31103 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:34.533511 31043 consensus_meta.cc:287] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.387s	user 0.014s	sys 0.000s
I20260709 13:12:34.702752 31043 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:34.703593 31209 consensus_meta.cc:287] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 13:12:34.641801 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.703888 29465 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.704046 31209 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.704873 29470 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.673856 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:34.535022 31210 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.710419 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.522346 31233 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:34.626267 31191 consensus_meta.cc:287] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.299s	user 0.015s	sys 0.000s
I20260709 13:12:34.713023 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.714807 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.718780 29538 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:34.710474 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:34.706981 30123 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.830s (SENT)
I20260709 13:12:34.722215 30123 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.727291 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:34.703655 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.729136 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.729734 29541 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.730089 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.730796 29394 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:34.731700 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.732885 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.733395 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:34.733929 30157 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:34.734790 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:34.735984 29471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:34.629633 31061 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.740288 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1550) took 1367 ms. Trace:
I20260709 13:12:34.740061 31212 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.740675 29464 rpcz_store.cc:276] 0709 13:12:33.373011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.373139 (+   128us) service_pool.cc:224] Handling call
0709 13:12:33.374820 (+  1681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.019331 (+644511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.739721 (+720390us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400422a54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:34.739907 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425321344}
W20260709 13:12:34.742596 31162 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.000s
I20260709 13:12:34.742311 29464 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.743495 29389 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:34.654616 31225 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.726112 31233 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.745357 31213 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:34.748121 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.732807 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.764910 29541 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:34.765964 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.766228 31161 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:34.766813 29394 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:34.751148 29544 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:34.752619 31125 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:34.753158 29538 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:34.753891 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.755297 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.757128 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.758415 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.759238 31177 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.532027 31099 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:34.749818 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.768030 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:34.770819 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 63876.6us
I20260709 13:12:34.771417 31164 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:34.771687 31114 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.130s	user 0.010s	sys 0.003s
I20260709 13:12:34.803301 31114 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.804230 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.804548 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.805406 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.805509 31114 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:34.773151 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 249271us
I20260709 13:12:34.805717 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.806264 29388 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.824476 31195 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:34.848620 31195 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:34.816875 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:34.849706 31196 raft_consensus.cc:3055] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:34.806320 29397 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.846216 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1576) took 1109 ms. Trace:
I20260709 13:12:34.850274 31196 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:34.850611 29465 rpcz_store.cc:276] 0709 13:12:33.736416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.760625 (+ 24209us) service_pool.cc:224] Handling call
0709 13:12:33.774115 (+ 13490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.704374 (+930259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.845883 (+141509us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54002a53d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:34.846130 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137782656}
W20260709 13:12:34.799496 30123 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.010s (SENT)
I20260709 13:12:34.807643 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.851970 30123 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.811720 29466 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.696465 30154 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:34.785563 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:34.787106 31125 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:34.790323 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:34.790515 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:34.726641 31191 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.822274 30153 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:34.840682 31222 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.865914 31222 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.867779 29543 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:34.870009 30160 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.789945 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:34.870973 29469 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:12:34.791477 31148 consensus_meta.cc:287] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.060s	user 0.020s	sys 0.003s
I20260709 13:12:34.791960 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.792968 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.794795 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 329) took 1208 ms. Trace:
I20260709 13:12:34.794728 31233 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:34.799504 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:34.806663 30151 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:34.810472 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:34.832363 31138 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:34.884753 31138 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:34.884831 30156 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:34.874738 31228 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.821108 31235 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:12:34.887707 30152 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.888078 31099 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:34.888249 31235 raft_consensus.cc:3055] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:34.888675 31235 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:34.849601 31195 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.810241 31193 consensus_queue.cc:1059] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:12:34.842233 31172 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.817828 31137 consensus_queue.cc:1059] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:12:34.890117 31110 raft_consensus.cc:3055] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:34.890725 31110 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:34.890833 30152 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:34.891029 31137 raft_consensus.cc:3055] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:34.821307 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:34.891507 31137 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:34.849823 29470 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.892695 30152 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:34.813895 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:34.853225 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67810.6us
I20260709 13:12:34.817016 29464 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.822974 30159 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:34.811357 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:34.780484 29435 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.860726 29472 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.835170 31213 consensus_queue.cc:1059] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:12:34.871757 29392 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:34.873442 30157 rpcz_store.cc:276] 0709 13:12:33.586965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.587122 (+   157us) service_pool.cc:224] Handling call
0709 13:12:34.794593 (+1207471us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54004687d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:34.794731 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844377728}
I20260709 13:12:34.828519 31079 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:34.861033 31086 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.894964 30159 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:34.899663 29388 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
W20260709 13:12:34.883430 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83966.7us
W20260709 13:12:34.901017 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.010s (SENT)
I20260709 13:12:34.901495 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:34.872215 30154 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 372) took 1746 ms (client timeout 1729 ms). Trace:
I20260709 13:12:34.894986 29463 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 2: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:34.899930 31079 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:34.904982 29463 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.895154 30158 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:12:34.896384 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 115994us
I20260709 13:12:34.898690 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:34.899480 29538 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.906387 29545 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:34.906471 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.907186 29543 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:34.911999 31171 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:34.914326 31086 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:34.851239 31196 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:34.915861 31086 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:34.917026 31243 consensus_queue.cc:1175] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "88760af579b54a6393c6251aa3c6b870" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:12:34.918712 31157 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.916618 31196 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.891520 31195 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.890152 30156 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.878819 31148 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.834720 31142 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:34.957577 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 56599.6us
I20260709 13:12:34.926625 29469 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.900061 31043 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:34.924098 29435 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:34.953701 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 70756.2us
I20260709 13:12:34.901402 31211 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:34.958400 30123 leader_election.cc:336] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.039s (SENT)
I20260709 13:12:34.967727 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:34.970547 29294 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.972234 29397 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:34.972561 29294 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.975200 31114 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:34.976006 31114 consensus_queue.cc:1243] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer 7c2e8d3e55c649e2b3acedef25d81e16 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:34.977341 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:34.977908 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.921128 31172 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:12:34.929123 31228 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:34.962373 29360 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:34.980621 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 56690us
I20260709 13:12:34.983704 29466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 179) took 1084 ms. Trace:
I20260709 13:12:34.989233 29466 rpcz_store.cc:276] 0709 13:12:33.899485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.899627 (+   142us) service_pool.cc:224] Handling call
0709 13:12:33.899988 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.852928 (+952940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.983434 (+130506us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54000d0554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:34.983640 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096295808}
I20260709 13:12:34.991870 29468 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:34.966951 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:34.903807 30154 rpcz_store.cc:269] 0709 13:12:33.125356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.129056 (+  3700us) service_pool.cc:224] Handling call
0709 13:12:34.861157 (+1732101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.991197 31177 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:34.963204 30159 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:34.996887 29435 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.997921 31043 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.983475 31217 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:34.999198 29435 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.999539 31217 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.002092 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.002928 31216 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.003170 31114 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.996889 30159 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:35.010136 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 47864.8us
W20260709 13:12:35.011930 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.974318 29294 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.016690 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:34.929733 31193 consensus_queue.cc:1059] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:12:35.017561 30158 raft_consensus.cc:2376] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3. Re-sending same reply.
I20260709 13:12:35.004287 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.025005 29360 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:35.025081 29435 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.021539 29470 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:34.963848 31213 consensus_queue.cc:1059] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:12:34.945283 31157 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:12:34.960588 31133 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:12:35.039081 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 92775.6us
W20260709 13:12:35.040243 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 81881.6us
I20260709 13:12:35.023389 31233 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:35.042666 29435 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.047696 29435 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:35.051568 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:35.062286 30123 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.249s (SENT) [suppressed 45 similar messages]
I20260709 13:12:35.062464 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:35.031132 31171 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:35.034691 31225 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.066421 29435 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:34.957692 31240 consensus_queue.cc:1059] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:12:35.039029 31216 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.980225 31079 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:35.006616 31236 consensus_queue.cc:1175] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:12:35.074847 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.040541 31164 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:12:35.044858 31233 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:35.085218 31234 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:35.088413 31250 raft_consensus.cc:993] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:35.091338 31132 consensus_queue.cc:1059] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:35.032004 31241 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:12:35.081221 31212 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.104077 29435 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:35.069777 31253 raft_consensus.cc:2764] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:12:35.047622 31251 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:35.073366 31156 raft_consensus.cc:2764] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:12:35.054607 31202 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:35.042052 31221 consensus_queue.cc:1059] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:12:35.107250 30159 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:35.109179 31132 raft_consensus.cc:3055] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:35.433753 31161 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:35.434122 31252 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.348s	user 0.004s	sys 0.010s
W20260709 13:12:35.434163 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.295826 31224 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:35.437719 31103 raft_consensus.cc:3055] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:12:35.435993 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.436462 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.121569 31234 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:35.103173 31216 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.131825 31191 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:35.122929 31235 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.463325 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 568) took 1448 ms. Trace:
I20260709 13:12:35.497498 31235 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.463845 31132 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:35.120301 31079 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:35.444391 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 382034us
W20260709 13:12:35.449906 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 405965us
I20260709 13:12:35.504243 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:35.455523 31251 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:35.470083 31196 consensus_meta.cc:287] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.001s
I20260709 13:12:35.510502 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:35.511215 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 407214us
I20260709 13:12:35.511803 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.513523 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.445698 31121 raft_consensus.cc:3055] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:35.518332 31121 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:35.518509 29471 raft_consensus.cc:606] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:35.518941 29471 raft_consensus.cc:614] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:35.519410 31121 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.128171 31217 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:35.521320 31211 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:35.485785 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.522676 31142 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.523553 31142 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.523658 31250 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:35.525007 31228 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:35.525424 31228 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:35.525631 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.518335 31237 raft_consensus.cc:1081] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:12:35.527467 30158 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:35.526417 31228 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.497107 30151 rpcz_store.cc:276] 0709 13:12:34.009494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.010761 (+  1267us) service_pool.cc:224] Handling call
0709 13:12:34.799666 (+788905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.882310 (+ 82644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.134222 (+251912us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54004687d0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:35.452844 (+318622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748970752}
I20260709 13:12:35.103518 31233 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.505704 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:35.514974 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:35.516306 31251 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.517590 31191 consensus_queue.cc:1059] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:35.520757 31121 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.464589 31148 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:35.484257 31103 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:35.540606 29545 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:12:35.541595 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.544421 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:35.483024 31224 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.556205 29290 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 4, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 4 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.557164 31255 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:35.557317 31224 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:35.527714 31177 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.557816 31255 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.470849 31125 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:35.569124 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 58750us
I20260709 13:12:35.536862 31211 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:35.480314 31110 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.493321 31161 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.574595 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:35.558665 31218 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:12:35.578508 29468 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:35.480132 31137 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.564199 31213 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:35.567233 31228 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.590705 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:35.489497 31138 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.604960 31161 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:35.604318 31211 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.498957 31234 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.577803 31243 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:35.577915 31156 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:35.615549 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.616745 31110 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.565649 31099 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:35.602895 31213 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:35.568703 31177 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.576138 31043 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:12:35.581264 31201 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:12:35.578598 31193 consensus_queue.cc:1059] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:12:35.619167 31161 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:35.597704 31132 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.620599 31164 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:35.658221 31043 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:12:35.658919 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 79886.7us
I20260709 13:12:35.595778 31157 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:12:35.677727 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 87121.2us
I20260709 13:12:35.619599 31156 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:35.619159 31243 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:35.664594 31242 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.665362 31177 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:35.641356 31250 consensus_queue.cc:1059] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:12:35.656940 31195 consensus_meta.cc:287] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.725s	user 0.014s	sys 0.021s
W20260709 13:12:35.670924 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44297.3us
W20260709 13:12:35.702780 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.613056 31202 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:12:35.679347 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:35.581182 31103 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:35.669734 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.667778 31161 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:35.690723 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 75203.8us
I20260709 13:12:35.714293 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:35.714717 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:35.715155 29395 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.715772 29363 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:35.695655 29397 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:35.697504 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:35.699005 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:35.700505 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 75529.4us
I20260709 13:12:35.653083 31213 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.718497 29512 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:35.687350 31132 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.697466 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:35.643246 31260 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:12:35.685695 31156 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.729401 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:35.643468 31261 consensus_queue.cc:1059] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:12:35.673930 31043 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:35.731117 31256 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:12:35.731492 29544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:35.731429 31043 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.717967 29392 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.695350 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:35.733079 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.722548 31161 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.738400 31255 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:35.741967 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:35.742599 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:35.680502 31164 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.723907 29540 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:35.724923 31193 raft_consensus.cc:3055] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:35.735004 31266 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:35.558398 29290 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 3 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.682507 31086 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:35.723022 31268 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:35.713526 31250 consensus_queue.cc:1243] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:12:35.745223 29543 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.747849 29470 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:35.749406 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:35.750859 29472 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:35.751921 30155 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:35.726831 31253 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:35.757493 29363 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:35.743930 31103 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.771135 29465 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:35.752115 31210 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.807751 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 50336.9us
I20260709 13:12:35.757114 31251 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:35.752416 31193 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:35.792374 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:35.827901 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.790176 31253 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:35.793567 31269 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:35.836617 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:35.819125 31251 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:35.846980 29537 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:35.847136 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:35.849723 29537 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:35.836215 31253 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.817417 31210 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:35.852758 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:35.852730 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:35.853895 29537 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.857343 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:35.856186 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:35.863023 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.842921 31251 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:35.863852 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.855994 31274 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.869871 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:35.841698 31201 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:35.877452 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.846654 31260 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:35.853513 31086 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:35.886144 31086 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:35.888373 31086 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:35.890417 31270 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:35.890954 31270 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:35.879503 31262 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:35.851788 31121 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.848222 31269 raft_consensus.cc:697] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:35.864272 31193 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.885545 31164 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:35.896179 31270 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:35.897272 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 126121us
I20260709 13:12:35.903715 29395 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:35.904407 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.904386 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 94898.1us
I20260709 13:12:35.907207 29539 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
W20260709 13:12:35.925000 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.927327 30158 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:35.931756 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:35.895269 31262 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:35.900317 31193 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.900600 31260 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.897854 31264 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:35.924541 31266 raft_consensus.cc:2764] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:12:35.928936 31225 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:35.931541 31164 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.892159 31201 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.957360 29539 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:35.959412 31222 raft_consensus.cc:3055] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:35.936177 31086 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.966257 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.966292 31222 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:35.969349 31251 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.946308 31262 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.954538 31260 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.940950 31210 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:35.977705 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.981583 29392 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:35.965912 31270 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:35.989176 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.964713 31278 consensus_queue.cc:1059] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:12:35.995430 31222 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.996925 31222 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:36.004326 29539 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:36.005963 29539 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:36.007205 29539 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:35.894819 29290 catalog_manager.cc:5697] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.003409 29537 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:35.973340 31164 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.984467 31212 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:12:35.951788 31255 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:12:35.966084 31225 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.982631 31086 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:35.898373 31269 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:36.025184 31243 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.028024 31201 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.029995 31164 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:36.042366 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.990097 31156 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:35.983553 31264 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.053450 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:36.058987 31225 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:36.060182 31156 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:36.068801 31243 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:36.082636 30123 leader_election.cc:336] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.555s (SENT)
I20260709 13:12:36.086732 30123 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:36.070716 31237 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:36.055857 30156 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:36.077061 31225 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.102402 31237 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:36.105183 31237 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.106509 31237 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:36.109028 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.102144 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 170622us
W20260709 13:12:36.110836 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.113978 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.102767 31164 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:36.131150 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:36.126464 31191 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:12:36.136461 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1619) took 1159 ms. Trace:
I20260709 13:12:36.142551 31177 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:12:36.145679 31177 consensus_queue.cc:1243] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer 88760af579b54a6393c6251aa3c6b870 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:12:36.147118 31265 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.384s	user 0.003s	sys 0.000s
I20260709 13:12:36.148888 31086 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.144305 31251 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.137006 29542 rpcz_store.cc:276] 0709 13:12:34.977186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.978213 (+  1027us) service_pool.cc:224] Handling call
0709 13:12:34.978622 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:34.979026 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.979055 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:34.979598 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.030733 (+ 51135us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:35.030784 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.030858 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:35.150710 (+119852us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b2400261158. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e573a9c4 00007f61e5738acb 00007f61e58f3dc9 00007f61e58f3a55 00007f61e58f309d 00007f61e852510e 00007f61e853c88c 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221
0709 13:12:36.114200 (+963490us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b24002610c8. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e573a9c4 00007f61e5738acb 00007f61e58f3dc9 00007f61e58f3a55 00007f61e58f2fb0 00007f61e8569488 00007f61e8569be8 00007f61e8541398 00007f61e853c76a 00007f61e853bbb6
0709 13:12:36.136191 (+ 21991us) raft_consensus.cc:1685] finished
0709 13:12:36.136219 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.136375 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":33350400,"thread_start_us":50723,"threads_started":1,"wal-append.queue_time_us":105746}
W20260709 13:12:36.160538 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 46758.6us
I20260709 13:12:36.161412 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:36.155973 31110 consensus_meta.cc:287] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
I20260709 13:12:36.157306 31086 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:36.109237 31225 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.155030 31260 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.193310 29542 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:36.191052 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:36.181244 31191 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:36.201228 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:36.202018 30160 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:36.216213 31138 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:36.183861 31161 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.209515 31210 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:36.208905 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:36.229996 31241 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:36.211113 31191 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:36.234262 29542 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:36.233117 31241 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:36.221412 31264 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.232441 31210 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.249248 29542 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:36.251416 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.255069 30156 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:36.249104 31210 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:36.272333 31161 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:36.271875 31191 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.275210 30154 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:12:36.275676 31213 consensus_meta.cc:287] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:12:36.276180 31213 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:36.282676 30155 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 576) took 1464 ms (client timeout 1828 ms). Trace:
W20260709 13:12:36.294081 30155 rpcz_store.cc:269] 0709 13:12:34.817837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.820898 (+  3061us) service_pool.cc:224] Handling call
0709 13:12:36.282413 (+1461515us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400475c54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:36.282584 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876546432}
I20260709 13:12:36.295845 29392 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:36.298291 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:36.284740 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1612) took 1386 ms. Trace:
W20260709 13:12:36.298954 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.291200 29537 raft_consensus.cc:1240] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:36.300117 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:36.299222 29540 rpcz_store.cc:276] 0709 13:12:34.898213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.898368 (+   155us) service_pool.cc:224] Handling call
0709 13:12:36.284504 (+1386136us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54001b8854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:36.284634 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451981568}
W20260709 13:12:36.300904 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.299705 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:36.307225 29397 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:36.310627 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:36.311280 29388 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:36.312543 29435 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:36.316159 29392 raft_consensus.cc:3055] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:36.309693 31125 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:36.316406 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 379927us
I20260709 13:12:36.240020 31241 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:36.292192 31235 consensus_meta.cc:287] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.793s	user 0.012s	sys 0.001s
I20260709 13:12:36.316977 29392 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:36.284715 31233 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.006s
I20260709 13:12:36.293411 31043 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:36.295441 31262 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:36.269801 29509 leader_election.cc:336] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.594s (SENT)
I20260709 13:12:36.278414 31213 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.324745 31233 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.399684 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:36.282917 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:36.323423 29392 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.319084 31264 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:36.374243 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:36.403126 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 56760.8us
W20260709 13:12:36.374641 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 50492us
W20260709 13:12:36.374310 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 57096.6us
I20260709 13:12:36.375787 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.387676 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.321870 31280 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:36.387691 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:36.404886 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.399680 31241 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:36.400195 31218 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:36.413264 30152 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:36.415989 31218 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.417299 29542 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:36.418085 29392 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:36.418305 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.419108 29539 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:36.419312 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 149565us
W20260709 13:12:36.420306 29509 leader_election.cc:336] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.640s (SENT)
I20260709 13:12:36.402658 31135 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.422597 31218 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:36.424597 31233 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.399978 31164 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:36.425704 31164 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.426328 31142 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.428056 29395 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:36.421473 29509 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.673s (SENT)
W20260709 13:12:36.429872 29509 leader_election.cc:336] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.746s (SENT)
W20260709 13:12:36.431166 29509 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.781s (SENT)
I20260709 13:12:36.387766 31225 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:36.435046 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:36.440145 29509 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.816s (SENT)
I20260709 13:12:36.435163 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.438498 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.441165 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:36.441298 29542 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
W20260709 13:12:36.446516 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.447938 29545 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:12:36.445642 30159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.028s
W20260709 13:12:36.450206 30159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.014s	sys 0.029s
W20260709 13:12:36.446569 29360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.008s	sys 0.033s
W20260709 13:12:36.451224 29360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.008s	sys 0.034s
I20260709 13:12:36.455144 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:36.455958 29543 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
W20260709 13:12:36.459443 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.020s
I20260709 13:12:36.461131 30156 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:36.459887 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.007s	sys 0.020s
I20260709 13:12:36.456246 30152 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:12:36.469839 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.031s	sys 0.096s
W20260709 13:12:36.472229 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.472201 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.031s	sys 0.096s
W20260709 13:12:36.437161 31253 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.004s
I20260709 13:12:36.493196 29435 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:36.476686 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 535101us
W20260709 13:12:36.481832 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.488463 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.491804 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 51662.9us
I20260709 13:12:36.409230 31172 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:12:36.440192 31280 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:36.421432 30151 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:36.502557 29509 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.879s (SENT)
I20260709 13:12:36.448088 31213 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.507993 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:36.512971 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.532219 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.491559 31148 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:36.492363 31264 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:36.504395 31164 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:36.497206 31212 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:36.541070 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.563119 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 60616.4us
W20260709 13:12:36.575347 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.527626 31242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.017s	sys 0.020s
W20260709 13:12:36.533967 31222 consensus_meta.cc:287] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.000s
W20260709 13:12:36.587990 29509 leader_election.cc:336] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.922s (SENT)
W20260709 13:12:36.592002 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 97626.3us
I20260709 13:12:36.592190 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:36.589306 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.590509 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.537235 31148 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:36.540930 31261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.009s	sys 0.005s
W20260709 13:12:36.534772 31268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.010s	sys 0.023s
W20260709 13:12:36.594935 31242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.018s	sys 0.021s
I20260709 13:12:36.500521 31253 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:36.600050 29509 leader_election.cc:336] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.016s (SENT)
I20260709 13:12:36.580499 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:12:36.581100 31278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.033s
W20260709 13:12:36.601382 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.607120 29392 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:36.617869 29467 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:36.608551 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:36.611500 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:36.539391 31254 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:36.612612 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:36.537145 31161 consensus_queue.cc:1059] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:12:36.609256 31148 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:36.606868 31268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.010s	sys 0.024s
W20260709 13:12:36.606676 31261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.009s	sys 0.005s
I20260709 13:12:36.599684 31287 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:36.705876 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.706404 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 97967.8us
W20260709 13:12:36.711120 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.911s (SENT)
I20260709 13:12:36.603636 31269 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:36.537235 31266 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:12:36.604666 31213 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.620607 30152 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:36.619941 31278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.009s	sys 0.033s
I20260709 13:12:36.594192 31212 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:36.714623 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 114606us
I20260709 13:12:36.734328 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.735692 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.705240 31172 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:12:36.724191 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 111649us
I20260709 13:12:36.757699 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:36.731314 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.718230 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:36.752080 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.760332 29545 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:36.766206 31286 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.767107 31286 raft_consensus.cc:3055] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:36.767481 31286 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:36.768309 31266 raft_consensus.cc:3055] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:36.768774 31266 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:36.768427 31286 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.769891 31286 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:36.769706 31266 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.771008 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.771200 31266 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:36.772199 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 53648.5us
I20260709 13:12:36.772419 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:36.773627 31255 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.774322 31255 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.775553 31099 raft_consensus.cc:3055] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:36.776003 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:36.776813 31161 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.778110 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:36.778874 31161 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.780035 31211 consensus_queue.cc:1059] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:36.781016 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:36.781780 31161 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.782075 31305 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:36.782931 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 585) took 1086 ms. Trace:
I20260709 13:12:36.783504 30151 rpcz_store.cc:276] 0709 13:12:35.696647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.704740 (+  8093us) service_pool.cc:224] Handling call
0709 13:12:36.782680 (+1077940us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540025b554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:36.782843 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593273088}
I20260709 13:12:36.784078 31273 raft_consensus.cc:3055] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:36.784505 31273 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:36.784559 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:36.782696 31305 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:36.774097 31177 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.785667 30153 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 3
I20260709 13:12:36.723838 31287 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.713512 31290 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:36.800055 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:36.756747 31270 consensus_meta.cc:287] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.763s	user 0.002s	sys 0.013s
I20260709 13:12:36.802559 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1589) took 1966 ms. Trace:
W20260709 13:12:36.789891 31103 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.980s	user 0.011s	sys 0.010s
I20260709 13:12:36.823103 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:36.833293 29363 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:36.831630 29509 leader_election.cc:336] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.181s (SENT)
I20260709 13:12:36.838564 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:36.823380 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.834065 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 123007us
W20260709 13:12:36.799994 31234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.022s	sys 0.044s
I20260709 13:12:36.776007 31099 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:36.841603 30123 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.924s (SENT)
I20260709 13:12:36.879485 30123 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:36.838025 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.823880 29467 rpcz_store.cc:276] 0709 13:12:34.835716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.835944 (+   228us) service_pool.cc:224] Handling call
0709 13:12:34.836239 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.618417 (+1782178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.792028 (+173611us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540035b954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:36.802449 (+ 10421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4090680064}
W20260709 13:12:36.884851 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51653.9us
W20260709 13:12:36.810284 31297 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:12:36.835489 29542 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:36.705375 31280 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.794203 31262 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.801741 31161 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:36.829830 30160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.056s	sys 0.118s
W20260709 13:12:36.865840 31234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.025s	sys 0.044s
I20260709 13:12:36.811919 31225 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:36.796437 31172 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:36.910115 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 135111us
I20260709 13:12:36.812546 30153 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:12:36.890213 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:36.761843 31213 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.867018 31164 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.822093 31287 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:36.824376 31177 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:36.955953 29537 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.001s	sys 0.014s
W20260709 13:12:36.956446 29537 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.001s	sys 0.014s
I20260709 13:12:36.785535 31273 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.828743 31222 consensus_queue.cc:1059] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:12:36.888342 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:36.932924 29470 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:36.926697 31261 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.892330 31255 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:36.894767 31233 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:36.892339 31086 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.709s	user 0.006s	sys 0.010s
I20260709 13:12:36.938048 29541 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:36.755177 31264 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.986985 31233 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:36.987550 31233 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:36.916929 29467 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:36.896956 30160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.056s	sys 0.118s
I20260709 13:12:36.917744 31103 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:36.959340 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 46242.9us
I20260709 13:12:36.963291 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:36.890796 31218 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:12:36.898813 31270 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.934922 31308 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.935177 30153 raft_consensus.cc:2917] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:12:36.971918 31225 raft_consensus.cc:3055] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:36.971994 31243 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:36.973217 31266 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:36.973999 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 87578us
W20260709 13:12:36.974798 31241 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.002s
I20260709 13:12:36.975386 31242 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:36.976029 31099 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:36.998288 31202 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.981258 29465 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:36.934554 31135 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:36.982470 31172 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:36.984159 31177 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:36.985105 31261 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:36.985754 31302 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:12:37.017455 31225 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:36.966163 29468 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.000233 29471 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:37.014499 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:37.022876 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.012138 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.021497 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:36.987502 31288 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.379s	user 0.005s	sys 0.005s
I20260709 13:12:36.998047 31086 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:37.020141 31156 raft_consensus.cc:3055] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.045472 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:37.020781 31234 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.956539 31164 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.014348 31216 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:12:36.903716 31137 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.073940 31099 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.024498 31303 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:12:37.076004 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:37.084162 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 62749.3us
I20260709 13:12:37.104624 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:36.980262 31305 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:37.028326 31292 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.308s	user 0.001s	sys 0.001s
I20260709 13:12:37.018733 31270 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.045265 31273 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:37.089074 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.118328 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.090004 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 258412us
I20260709 13:12:37.045316 31250 raft_consensus.cc:3055] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:37.039991 31253 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.030319 30153 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:37.094688 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 253119us
W20260709 13:12:37.139209 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.085018 31237 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:12:37.074651 31177 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.188051 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.188803 29438 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:37.124821 29394 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:37.122906 31278 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:37.089741 31156 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:37.086642 31212 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:37.123202 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 108834us
I20260709 13:12:37.124699 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.125017 29471 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:37.126220 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.203711 29467 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:37.126808 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:37.129709 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.096712 31266 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:37.130504 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:37.133720 29546 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:37.139755 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.025040 31114 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.096959 31234 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.183033 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.185914 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:37.046825 31202 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.192054 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:37.186373 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:37.193524 29438 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:37.022328 31308 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.204196 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 589) took 1329 ms. Trace:
I20260709 13:12:37.129015 31312 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:37.204943 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 78271.1us
W20260709 13:12:37.208847 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 78376.9us
I20260709 13:12:37.227998 30159 rpcz_store.cc:276] 0709 13:12:35.874359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.874542 (+   183us) service_pool.cc:224] Handling call
0709 13:12:35.874990 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.877162 (+  2172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.877205 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.890951 (+ 13746us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.450768 (+559817us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:36.450829 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.450924 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.203943 (+753019us) raft_consensus.cc:1685] finished
0709 13:12:37.203965 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.204115 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1662,"raft.queue_time_us":3004,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10851,"thread_start_us":559335,"threads_started":1,"wal-append.queue_time_us":691035}
I20260709 13:12:37.234407 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:37.199007 31306 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.217240 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.192238 31305 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.238433 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:37.195046 31157 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.241255 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:37.197322 31278 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:37.209934 31114 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.129505 31250 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:37.211417 31253 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:37.195452 31177 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.243214 31295 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:37.225697 31217 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.210789 31103 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:37.276175 29438 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:37.141786 31241 consensus_queue.cc:1059] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 13:12:37.243012 31264 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:37.274852 31201 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.190093 31225 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.245882 31312 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:37.276355 31278 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:37.305233 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 68824.4us
I20260709 13:12:37.278029 31213 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:37.276041 31243 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:12:37.293645 31316 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:37.336532 31218 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:37.274890 31157 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.299731 31133 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:37.245860 31306 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.302745 31103 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.346868 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:37.252331 31305 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.304481 31295 raft_consensus.cc:697] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:37.380438 31295 consensus_queue.cc:237] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.386013 31329 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:37.289687 31311 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:12:37.366099 31114 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.377216 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:37.355365 31218 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:37.380963 31319 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:37.289636 31156 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.338169 31261 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:37.363960 31043 consensus_meta.cc:287] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.974s	user 0.009s	sys 0.005s
I20260709 13:12:37.379261 31305 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.363164 31225 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.361634 31268 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.310453 31201 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.374277 31103 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.406304 31156 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.406730 31177 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.400707 31218 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:37.394248 31297 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.083s	user 0.001s	sys 0.001s
I20260709 13:12:37.407310 31164 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:37.409960 31320 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:37.410089 31157 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:37.400574 31138 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.181s	user 0.009s	sys 0.007s
I20260709 13:12:37.364519 31253 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:12:37.413021 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59462.4us
I20260709 13:12:37.453814 29472 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:37.351753 31266 consensus_queue.cc:1059] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:12:37.404452 31270 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:37.387135 31250 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.360783 31316 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:37.458966 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 222273us
W20260709 13:12:37.467881 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 229521us
I20260709 13:12:37.461234 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:37.438853 31210 consensus_meta.cc:287] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.127s	user 0.012s	sys 0.003s
I20260709 13:12:37.461990 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:37.473764 29543 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
W20260709 13:12:37.468711 29509 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.762s (SENT)
W20260709 13:12:37.476866 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 99745.7us
I20260709 13:12:37.471698 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:37.477763 29545 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:37.474579 31321 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:12:37.455161 31234 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.456137 31171 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.481315 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:37.483338 29543 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:37.484376 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:37.482398 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.485581 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:37.486102 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.486791 29392 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:37.486827 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.487219 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.489609 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.491115 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.492163 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.492687 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.499418 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.501255 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.503645 29438 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:37.504096 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:37.424597 31268 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.504835 29438 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:37.505311 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.506325 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:37.483219 31164 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.507871 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.483021 31270 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.481676 31138 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.511282 29391 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.513361 29390 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:37.515048 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.480798 31210 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.519244 29391 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:37.512099 31315 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260709 13:12:37.495357 31241 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:37.522872 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:37.528553 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:37.426815 31312 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.500707 31329 consensus_queue.cc:1243] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer 7c2e8d3e55c649e2b3acedef25d81e16 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:12:37.491137 31213 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:37.488511 31308 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.527854 29391 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.512324 31157 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.516053 31285 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:37.527534 29390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29e2fd913c0b414a81386c129004967f"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36866
I20260709 13:12:37.515836 31234 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:37.539286 29390 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.539849 29390 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:37.540005 31317 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.177s	user 0.001s	sys 0.001s
I20260709 13:12:37.495134 31171 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.537985 29391 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:37.537603 31318 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:12:37.518533 31164 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:37.632747 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.540414 31241 raft_consensus.cc:697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:37.527122 31261 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.662735 29392 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:37.637951 31287 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.669s	user 0.005s	sys 0.005s
I20260709 13:12:37.542740 29465 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:37.645015 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.541707 29393 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:37.591219 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.692669 29389 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:37.678750 29541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1527) took 1836 ms (client timeout 1726 ms). Trace:
W20260709 13:12:37.735548 29541 rpcz_store.cc:269] 0709 13:12:35.841901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.842111 (+   210us) service_pool.cc:224] Handling call
0709 13:12:37.678537 (+1836426us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540037dcd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:37.678667 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2332030336}
I20260709 13:12:37.697649 29397 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:12:37.588040 31325 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:12:37.651145 31286 consensus_meta.cc:287] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.881s	user 0.011s	sys 0.005s
W20260709 13:12:37.677763 31233 consensus_meta.cc:287] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
I20260709 13:12:37.589879 29394 raft_consensus.cc:2410] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:37.589174 31222 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:37.568349 31099 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:37.749182 31099 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:37.656186 31137 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
I20260709 13:12:37.708645 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:37.580148 31326 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:12:37.737036 29390 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.733552 31196 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.741721 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.598341 31307 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.569s	user 0.002s	sys 0.000s
I20260709 13:12:37.663645 31316 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:37.659097 31148 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.944s	user 0.007s	sys 0.007s
W20260709 13:12:37.641000 31273 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.506s	user 0.001s	sys 0.010s
I20260709 13:12:37.734885 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:37.525178 31138 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.747531 31261 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.814868 31138 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:37.816363 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:37.817829 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:37.637219 31269 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.746665 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:37.724049 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.839237 29464 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
W20260709 13:12:37.840866 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.746184 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:37.700719 31225 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:37.626353 30152 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.001s
W20260709 13:12:37.748342 31328 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 13:12:37.602591 31335 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:37.627796 31210 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:37.693348 31217 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:37.765807 31233 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.751230 29392 raft_consensus.cc:3055] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.898190 29392 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:37.753510 29391 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:37.754344 31309 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.722s	user 0.002s	sys 0.000s
I20260709 13:12:37.754902 30151 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:37.754423 31099 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.755573 29544 raft_consensus.cc:606] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:37.914165 29544 raft_consensus.cc:614] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:37.750782 31222 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:37.755785 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1529) took 1913 ms. Trace:
I20260709 13:12:37.757540 31164 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:37.757824 30123 leader_election.cc:336] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.066s (SENT)
I20260709 13:12:37.760123 31103 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.762274 31278 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.764149 29393 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.864850 31243 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.570685 31201 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.543975 31234 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.543534 31285 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:37.699483 31327 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:12:37.626662 31334 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.778684 29396 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:37.675421 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 146957us
I20260709 13:12:37.782612 31196 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.784333 31250 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.750353 31218 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.578346 31306 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.522428 31270 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.542786 31157 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.543553 31213 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.812254 31125 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:37.591814 31333 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:37.829377 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.746042 31287 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.690420 31268 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:37.832981 31301 log.cc:927] Time spent T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.767s	user 0.003s	sys 0.000s
I20260709 13:12:37.834360 29397 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:37.835491 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 100726us
I20260709 13:12:37.835906 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.841871 29389 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.846715 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.848168 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.851833 29463 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:37.859412 29363 connection.cc:256] RPC call timeout handler was delayed by -1.7001668630000495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 13:12:37.807271 31202 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.862984 29390 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:37.838363 31269 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.011919 29541 raft_consensus.cc:2410] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:37.900647 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.013589 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:37.902158 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:38.019135 29391 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:37.902251 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:37.903189 29466 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:38.020150 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:37.910084 29392 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:37.859086 30152 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:38.012734 31261 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:37.912611 29472 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:37.916288 29538 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:37.918888 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:37.918620 29546 rpcz_store.cc:276] 0709 13:12:35.842606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.842783 (+   177us) service_pool.cc:224] Handling call
0709 13:12:35.852352 (+  9569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.207396 (+1355044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.755504 (+548108us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400061154. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:37.755705 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2935293312}
I20260709 13:12:37.824100 31148 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:37.927960 29395 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:37.859387 31225 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:37.941936 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.927983 31335 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:38.028864 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:37.938906 31285 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:38.007602 31237 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:38.039659 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:37.993019 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:38.010994 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.040705 29393 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:38.040627 29397 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:38.041599 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:38.017248 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:38.042680 29392 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.043344 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.011426 31344 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:37.935536 31243 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.022532 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.019572 29545 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:38.030856 29469 raft_consensus.cc:2368] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3.
W20260709 13:12:38.031172 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 273372us
I20260709 13:12:38.027765 31290 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.029940 30126 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:38.036154 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.043543 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:38.013236 31333 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:37.927282 31241 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.009872 31336 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.051580 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.052013 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.086140 29438 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:38.037966 29542 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:38.059378 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:38.060745 31213 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.061740 31086 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.100739 31273 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.101281 31086 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.101388 31273 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:38.105157 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 343) took 1364 ms. Trace:
I20260709 13:12:38.058269 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:38.105640 31218 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:38.107052 31148 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.109081 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 341) took 1840 ms. Trace:
I20260709 13:12:38.109288 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.110167 29395 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 2: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:37.933501 31234 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.992080 31334 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.021169 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.068977 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:38.120919 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 53280.2us
I20260709 13:12:38.037213 31316 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:38.121140 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.071017 29397 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:38.071079 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:38.071923 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:38.065886 31138 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.073939 31294 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.032533 30152 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 399) took 1548 ms (client timeout 1585 ms). Trace:
I20260709 13:12:38.075311 31323 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:38.077633 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:38.077929 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:38.024859 29394 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:38.054134 31242 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:38.094168 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.089804 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.054469 31079 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:38.100059 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1607) took 1018 ms. Trace:
I20260709 13:12:38.038727 31268 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:12:38.039023 31303 consensus_queue.cc:1059] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:12:38.064366 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.174s (SENT)
I20260709 13:12:38.056615 31237 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.105669 30153 rpcz_store.cc:276] 0709 13:12:36.740487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.740700 (+   213us) service_pool.cc:224] Handling call
0709 13:12:36.785320 (+ 44620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:37.240291 (+454971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:37.246101 (+  5810us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:37.305266 (+ 59165us) log.cc:844] Serialized 26 byte log entry
0709 13:12:37.911194 (+605928us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:37.987962 (+ 76768us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.007239 (+ 19277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.013454 (+  6215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:38.104846 (+ 91392us) raft_consensus.cc:1685] finished
0709 13:12:38.104880 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.105070 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58635,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2437,"raft.queue_time_us":8053,"raft.run_wall_time_us":7385,"spinlock_wait_cycles":7343360,"thread_start_us":445795,"threads_started":1,"wal-append.queue_time_us":710058}
I20260709 13:12:38.109472 30160 rpcz_store.cc:276] 0709 13:12:36.269121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.269250 (+   129us) service_pool.cc:224] Handling call
0709 13:12:36.271777 (+  2527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:36.272275 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.272315 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.272942 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.991792 (+718850us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:36.991850 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.992048 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.821971 (+829923us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:12:38.108686 (+286715us) raft_consensus.cc:1685] finished
0709 13:12:38.108715 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.109005 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1425,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":41111808,"thread_start_us":718416,"threads_started":1,"wal-append.queue_time_us":688588}
I20260709 13:12:38.032727 31261 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 13:12:38.076426 31347 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:12:38.118180 29463 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:38.123272 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:38.045492 31335 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.127781 29392 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:38.133049 29360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.065s	sys 0.117s
I20260709 13:12:38.177208 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:38.233616 29360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.067s	sys 0.125s
I20260709 13:12:38.178085 29467 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:38.131286 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:38.159791 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.191458 30152 rpcz_store.cc:269] 0709 13:12:36.479843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.491065 (+ 11222us) service_pool.cc:224] Handling call
0709 13:12:38.028006 (+1536941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:38.041515 31222 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.297968 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:38.105697 31340 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:12:38.202446 29466 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:38.304876 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.083163 31333 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:38.202705 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 175442us
I20260709 13:12:38.234686 31196 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:38.270660 31273 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:38.096024 31225 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:38.113675 31212 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:38.206382 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.370970 29395 raft_consensus.cc:2376] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2. Re-sending same reply.
I20260709 13:12:38.207360 29472 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:38.209059 29465 rpcz_store.cc:276] 0709 13:12:37.081593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.081994 (+   401us) service_pool.cc:224] Handling call
0709 13:12:37.099505 (+ 17511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.742477 (+642972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.099756 (+357279us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54003b5954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:38.099984 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018803456}
W20260709 13:12:38.171872 31297 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:12:38.067972 31344 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.140981 31210 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:38.215142 29390 raft_consensus.cc:3055] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.377507 29390 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:38.214071 31294 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:38.216495 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 152167us
W20260709 13:12:38.391477 30123 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.249s (SENT)
I20260709 13:12:38.391911 29389 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:38.227269 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.229689 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.396526 29463 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:38.398274 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:38.399214 30156 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:38.202636 31323 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.400184 31323 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:38.270268 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.115005 31290 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.220579 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:38.271910 29545 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:38.209304 31242 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.224357 31316 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.234027 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 841270us
I20260709 13:12:38.179369 29464 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:38.291124 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51398 (request call id 14) took 2545 ms. Trace:
I20260709 13:12:38.199429 31138 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:38.191422 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 64801.9us
I20260709 13:12:38.427078 29544 rpcz_store.cc:276] 0709 13:12:35.731168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.731351 (+   183us) service_pool.cc:224] Handling call
0709 13:12:38.276593 (+2545242us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54001b7954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e899b853 00007f61ed96960a 00007f61e6eef7d4 00007f61e6eef762 00007f61e6eef691 00007f61e6eef60c 00007f61e6eee8c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:38.276734 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4653248384}
I20260709 13:12:38.298779 29391 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:38.431361 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.431908 29391 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:38.432516 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.225467 31254 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:38.273154 31161 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:12:38.299975 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.437261 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:38.437579 29467 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:38.234004 31278 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.438851 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:38.143426 31266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.038s	sys 0.090s
I20260709 13:12:38.310324 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:38.122236 31336 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.274798 31342 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.269362 31103 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.287604 31303 raft_consensus.cc:3055] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.217746 31079 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.354076 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.374402 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:38.216908 29393 raft_consensus.cc:1240] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:38.378046 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.350977 31255 raft_consensus.cc:3055] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.374495 31222 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.381325 29390 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:38.381910 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:38.381381 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:38.383224 31349 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:12:38.384583 31352 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:38.386037 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39036 (request call id 189) took 1260 ms. Trace:
I20260709 13:12:38.391968 30123 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:38.225759 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 157524us
I20260709 13:12:38.402701 29463 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:38.403873 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:38.524566 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.525280 29389 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:38.525043 29469 rpcz_store.cc:276] 0709 13:12:37.125459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.125724 (+   265us) service_pool.cc:224] Handling call
0709 13:12:38.385744 (+1260020us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54002a4ed4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:38.385942 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884633984}
I20260709 13:12:38.478668 29465 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:38.408420 29546 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:38.370563 31212 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.427320 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:38.426578 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.439863 29467 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:12:38.440477 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 130228us
I20260709 13:12:38.440927 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:38.441196 31273 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:12:38.521361 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.505642 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:38.554207 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1593) took 1025 ms. Trace:
I20260709 13:12:38.555169 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1652) took 1096 ms. Trace:
I20260709 13:12:38.441936 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:38.517582 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1659) took 1011 ms. Trace:
I20260709 13:12:38.575855 29542 rpcz_store.cc:276] 0709 13:12:37.459109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.460798 (+  1689us) service_pool.cc:224] Handling call
0709 13:12:37.708458 (+247660us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b58001c4498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ceee 0000000000375939 00007f61ed8f01e0 00007f61ed9b90c4 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:12:38.554914 (+846456us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400252e54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:38.555082 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664835584}
W20260709 13:12:38.555754 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 164314us
I20260709 13:12:38.576684 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.576453 29541 rpcz_store.cc:276] 0709 13:12:37.506372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.745685 (+239313us) service_pool.cc:224] Handling call
0709 13:12:38.517314 (+771629us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003a8254. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:38.517501 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396178176}
W20260709 13:12:38.577304 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.547529 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.577800 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:38.526273 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.578518 29542 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
W20260709 13:12:38.578258 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.580852 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.581643 29469 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:38.581857 29546 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:38.575094 29396 rpcz_store.cc:276] 0709 13:12:37.528765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.529881 (+  1116us) service_pool.cc:224] Handling call
0709 13:12:37.668553 (+138672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.936402 (+267849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.553966 (+617564us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001720d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:38.554138 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236502272}
I20260709 13:12:38.572540 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.536279 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:38.584163 29392 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:38.578440 29395 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:38.585511 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:38.586589 29390 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.589442 29542 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:38.589811 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:38.590830 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.587287 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:38.591619 29389 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:38.591814 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.592792 29396 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:38.593406 29467 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:38.586582 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.893s (SENT)
I20260709 13:12:38.594393 30123 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:38.590590 29360 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:38.592878 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.549218 31225 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:38.580468 31355 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 13:12:38.602645 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.553483 31270 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:38.510035 30154 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:38.556136 31237 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:38.586666 31212 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.605507 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:38.556748 31086 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:38.556270 31344 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.557451 31218 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:38.609690 29392 raft_consensus.cc:2410] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:38.603570 29389 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:38.604067 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:38.441246 31266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.038s	sys 0.092s
I20260709 13:12:38.610569 31294 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.646116 31156 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.646582 31156 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:38.647445 31156 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.648428 31156 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:38.651151 31360 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:12:38.651293 31233 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.653343 30155 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 LEARNER]: Advancing to term 2
I20260709 13:12:38.579739 31255 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:38.573225 31303 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:38.423499 31242 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:38.613269 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.615324 29464 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:38.604285 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:38.666826 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.589376 31261 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:38.667214 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.667086 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 62932.1us
W20260709 13:12:38.667640 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.601833 31191 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:38.607190 29537 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:38.668751 29537 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:38.626883 31225 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:38.627250 29546 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:38.598543 31334 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:38.601603 31329 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:38.630594 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:38.681092 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 158223us
I20260709 13:12:38.681267 29469 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:38.426556 31316 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.690933 30155 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:38.691658 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 349) took 1451 ms. Trace:
I20260709 13:12:38.692003 30155 rpcz_store.cc:276] 0709 13:12:37.240611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.240883 (+   272us) service_pool.cc:224] Handling call
0709 13:12:38.085236 (+844353us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:38.652989 (+567753us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:38.653173 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.691378 (+ 38205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.691594 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11691776}
W20260709 13:12:38.681741 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.694672 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:38.658923 31273 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.698805 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:38.702172 30160 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:38.637706 31234 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:38.641285 31250 consensus_meta.cc:287] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.002s
I20260709 13:12:38.643427 31218 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.441016 31254 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.598254 31137 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:12:38.723062 29543 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:38.658978 29396 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.611702 31332 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:38.659142 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 180190us
I20260709 13:12:38.438604 31243 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:38.438462 31269 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:38.661116 29390 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:38.598968 31213 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:12:38.540045 31342 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:38.668191 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.679975 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1654) took 1220 ms. Trace:
I20260709 13:12:38.683990 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:38.742592 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.742959 29395 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:38.634377 29389 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:38.669938 29537 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.743435 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:38.744233 29537 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:38.665995 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:38.659814 31335 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:38.718223 29472 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:38.718852 29468 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:38.680719 31358 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:38.723831 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:38.681632 31354 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.627568 31356 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:12:38.726641 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:38.730679 29471 raft_consensus.cc:2368] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:38.738638 30160 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:38.681733 31103 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:12:38.722656 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:38.695855 31329 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.716508 31273 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.744858 29390 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:39.307075 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 555388us
I20260709 13:12:38.854355 29541 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:39.228540 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1655) took 1768 ms. Trace:
I20260709 13:12:39.309063 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1542) took 1315 ms. Trace:
I20260709 13:12:39.309470 29541 rpcz_store.cc:276] 0709 13:12:37.993807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.608943 (+615136us) service_pool.cc:224] Handling call
0709 13:12:38.624706 (+ 15763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.854107 (+229401us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540035aaa0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8918dc0 00007f61e89a31c0 00007f61e89a4231 00007f61e89a0d8f 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c
0709 13:12:39.308717 (+454610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.308993 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233758592}
I20260709 13:12:39.309881 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:38.820597 29537 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:38.848423 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:39.317412 29537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1548) took 1292 ms (client timeout 1633 ms). Trace:
I20260709 13:12:39.317699 29397 raft_consensus.cc:2393] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:39.317961 29537 rpcz_store.cc:269] 0709 13:12:38.025200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.374059 (+348859us) service_pool.cc:224] Handling call
0709 13:12:39.317336 (+943277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.089112 31137 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:38.753822 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:38.754058 31332 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:38.898039 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.845443 31218 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.185315 30157 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:38.868722 31254 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.121075 31225 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:38.888988 31333 consensus_meta.cc:287] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.002s
I20260709 13:12:39.077291 31213 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:38.731555 31303 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:38.875645 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:38.846642 31079 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:39.034044 31222 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.843698 31157 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:38.839136 29465 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:39.318377 31329 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:39.054472 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 62940.2us
I20260709 13:12:38.949239 29467 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
W20260709 13:12:38.897281 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.048264 31243 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:38.768122 31234 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:39.333910 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.361332 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.380497 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:39.382571 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:39.380350 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1613) took 1184 ms. Trace:
I20260709 13:12:39.399716 29468 rpcz_store.cc:276] 0709 13:12:38.196071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.684954 (+488883us) service_pool.cc:224] Handling call
0709 13:12:38.718658 (+ 33704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.379960 (+661302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.380254 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.309218 29538 rpcz_store.cc:276] 0709 13:12:37.460252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.460933 (+   681us) service_pool.cc:224] Handling call
0709 13:12:39.228275 (+1767342us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54001b7954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.228452 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028734208}
W20260709 13:12:39.381748 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.404417 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:39.405450 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 97385.1us
I20260709 13:12:39.339814 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:39.406908 29391 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 1.
I20260709 13:12:39.317713 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1670) took 1496 ms. Trace:
I20260709 13:12:39.318248 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1670) took 1091 ms. Trace:
I20260709 13:12:39.407759 29542 rpcz_store.cc:276] 0709 13:12:37.821108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.591138 (+770030us) service_pool.cc:224] Handling call
0709 13:12:38.885455 (+294317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.885748 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.885776 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:38.885823 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:38.885863 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.885916 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.317521 (+431605us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400396550. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.317645 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676155136}
W20260709 13:12:39.312875 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.327809 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 715755us
I20260709 13:12:39.319514 29546 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:39.314904 29438 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:39.360699 29472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1527) took 1302 ms. Trace:
I20260709 13:12:39.330299 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.363581 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1616) took 1158 ms. Trace:
I20260709 13:12:39.330710 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1615) took 1130 ms. Trace:
I20260709 13:12:38.742590 29540 rpcz_store.cc:276] 0709 13:12:37.459928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.460051 (+   123us) service_pool.cc:224] Handling call
0709 13:12:37.460537 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:37.463248 (+  2711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:37.463294 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:37.791702 (+328408us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b1800327ca0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e729aa11 00007f61e72aa372 00007f61e89dca01 00007f61e89a143a
0709 13:12:37.792697 (+   995us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b2c000d87c8. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e729aa11 00007f61e72aa372 00007f61e89dca01 00007f61e89a143a 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2
0709 13:12:37.838545 (+ 45848us) log.cc:844] Serialized 26 byte log entry
0709 13:12:38.224613 (+386068us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:38.224686 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.225578 (+   892us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:38.679706 (+454128us) raft_consensus.cc:1685] finished
0709 13:12:38.679730 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.679906 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2183,"raft.queue_time_us":4567,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9875,"spinlock_wait_cycles":13131008,"thread_start_us":381981,"threads_started":1,"wal-append.queue_time_us":576455}
I20260709 13:12:38.849967 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1658) took 1366 ms. Trace:
I20260709 13:12:39.324945 29539 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:39.411561 29512 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:39.319581 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.413594 29543 rpcz_store.cc:276] 0709 13:12:37.483748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.484126 (+   378us) service_pool.cc:224] Handling call
0709 13:12:38.849724 (+1365598us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540037afd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:38.849879 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2847155456}
I20260709 13:12:38.789412 31099 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:39.319720 31358 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.554800 29395 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:39.325345 31332 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.319301 31137 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.491428 31157 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:39.322996 31354 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.484061 29390 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:38.770376 31364 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:39.323544 31287 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:39.335168 31268 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.412688 29467 rpcz_store.cc:276] 0709 13:12:38.204946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.362642 (+1157696us) service_pool.cc:224] Handling call
0709 13:12:39.363039 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.363245 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.363273 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.363320 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:39.363353 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.363407 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.363518 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.412092 31243 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.033278 31250 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.340857 31316 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.591178 31261 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:39.596431 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.596534 31261 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:39.597494 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.470453 29538 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:39.572821 31367 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:38.731436 31138 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.033898 31269 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:39.604326 31367 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.604723 31269 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:39.483898 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.594481 31268 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:39.609089 31242 consensus_meta.cc:287] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.924s	user 0.014s	sys 0.004s
I20260709 13:12:39.609524 31268 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:39.425189 31164 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:39.610591 31164 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.610693 31250 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.612139 31243 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.612864 31164 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.613413 31164 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:39.613729 31250 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.328696 31333 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:39.488309 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 127626us
I20260709 13:12:39.595969 29467 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:12:39.616164 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1619) took 1391 ms. Trace:
I20260709 13:12:39.616107 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:39.618048 31286 raft_consensus.cc:3055] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:39.618594 31286 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:39.618417 31356 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:39.619764 31286 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:38.753742 31365 raft_consensus.cc:2764] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:12:39.325353 31334 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:39.422046 31135 raft_consensus.cc:670] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:39.621487 31334 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.412813 29465 rpcz_store.cc:276] 0709 13:12:38.200219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.838340 (+638121us) service_pool.cc:224] Handling call
0709 13:12:38.838844 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.330353 (+491509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.330633 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:39.490386 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 79561.2us
W20260709 13:12:39.624586 29388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1579) took 2134 ms (client timeout 2181 ms). Trace:
W20260709 13:12:39.624995 29388 rpcz_store.cc:269] 0709 13:12:37.489658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.491897 (+  2239us) service_pool.cc:224] Handling call
0709 13:12:39.624340 (+2132443us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54003a11d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.624489 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4712128384}
I20260709 13:12:39.625396 30123 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:39.493376 29392 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:39.404274 31337 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:38.843662 31342 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:39.514050 31212 consensus_meta.cc:287] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.883s	user 0.017s	sys 0.002s
I20260709 13:12:39.627501 31212 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.628834 31135 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:39.629472 29394 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:39.629735 31212 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.518699 29542 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:39.630760 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1543) took 1636 ms. Trace:
I20260709 13:12:39.631373 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 193) took 1613 ms. Trace:
I20260709 13:12:39.631829 29466 raft_consensus.cc:2393] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:12:38.953217 31285 consensus_meta.cc:287] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.005s
I20260709 13:12:39.632931 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:39.633494 30160 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:39.412377 29472 rpcz_store.cc:276] 0709 13:12:38.058682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.677785 (+619103us) service_pool.cc:224] Handling call
0709 13:12:38.714281 (+ 36496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.360337 (+646056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.360605 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.486536 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:39.631121 29542 rpcz_store.cc:276] 0709 13:12:37.994144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.483890 (+1489746us) service_pool.cc:224] Handling call
0709 13:12:39.518400 (+ 34510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.630485 (+112085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.630690 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.635231 29391 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 2: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:39.326979 31218 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:39.647217 31334 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:39.647367 31285 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.647728 31218 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.648104 31250 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.648857 31250 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.649853 31285 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.326278 31273 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:39.542241 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 130777us
I20260709 13:12:39.537691 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1672) took 1107 ms. Trace:
W20260709 13:12:39.535991 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 226194us
W20260709 13:12:39.521682 31323 consensus_meta.cc:287] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.121s	user 0.017s	sys 0.006s
I20260709 13:12:39.398892 29396 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:39.508867 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:39.495434 31233 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.515072 31262 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.722422 31255 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.531143 31103 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:39.655637 31365 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:39.330068 31222 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.328444 31225 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.680295 31225 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.543808 31237 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:38.769156 31336 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.578748 31079 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:39.564389 31216 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:39.379580 31171 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:39.601246 31375 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.601457 31099 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:39.601745 31291 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:39.407964 29397 rpcz_store.cc:276] 0709 13:12:38.227003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.271633 (+ 44630us) service_pool.cc:224] Handling call
0709 13:12:38.848169 (+576536us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:12:39.318151 (+469982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8702848}
I20260709 13:12:39.616631 29467 rpcz_store.cc:276] 0709 13:12:38.225187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.594569 (+1369382us) service_pool.cc:224] Handling call
0709 13:12:39.595394 (+   825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.615756 (+ 20362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.616092 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.620234 31356 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:39.609555 31242 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.321286 30156 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:39.628697 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.629904 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:39.520998 29545 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:39.703979 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 229) took 1705 ms. Trace:
I20260709 13:12:39.704298 29545 rpcz_store.cc:276] 0709 13:12:37.998786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.479954 (+1481168us) service_pool.cc:224] Handling call
0709 13:12:39.516890 (+ 36936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.703715 (+186825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.703914 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.637272 30123 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:39.705742 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 68599.1us
I20260709 13:12:39.566849 31358 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.650097 31218 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.541791 29546 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:39.715184 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1674) took 1101 ms. Trace:
I20260709 13:12:39.715655 29546 rpcz_store.cc:276] 0709 13:12:38.613352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.707802 (+ 94450us) service_pool.cc:224] Handling call
0709 13:12:39.715087 (+1007285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.650920 29470 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:39.655450 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.580927 31157 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:39.650842 30152 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:39.691015 31191 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:39.659883 29512 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:39.658207 29539 rpcz_store.cc:276] 0709 13:12:38.430116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.423123 (+993007us) service_pool.cc:224] Handling call
0709 13:12:39.537062 (+113939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.537325 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.537352 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.537398 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:39.537432 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.537488 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.537623 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.663626 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:39.650930 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:39.631788 29394 rpcz_store.cc:276] 0709 13:12:38.017725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.228607 (+210882us) service_pool.cc:224] Handling call
0709 13:12:39.629255 (+1400648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.629887 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.631143 (+  1256us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003a11d0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.631283 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077704064}
I20260709 13:12:39.328879 31213 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.697988 31099 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.658921 31286 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.675400 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:39.667534 31250 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:39.665786 31262 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.665968 31233 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.676288 31241 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:39.661345 31269 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.668195 31103 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:39.759233 31103 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.760555 31103 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:39.681476 31237 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.762810 31237 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.764103 31262 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.765626 31242 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.684196 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:39.685608 29465 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:39.666471 31323 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.769057 31323 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.687248 31137 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:39.688977 31079 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:39.694952 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 290663us
I20260709 13:12:39.694368 31367 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.770385 31216 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.770975 31216 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.772184 30160 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:39.746137 31336 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:39.774044 31354 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.702633 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.711619 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:39.698401 31356 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.711635 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:39.775583 29545 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:39.719810 29544 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:39.720314 29538 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:39.613933 31164 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.723393 29466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1620) took 1492 ms. Trace:
I20260709 13:12:39.778832 29466 rpcz_store.cc:276] 0709 13:12:38.231411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.353613 (+122202us) service_pool.cc:224] Handling call
0709 13:12:39.723087 (+1369474us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540004f454. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.723301 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432771456}
W20260709 13:12:39.726686 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.593961 31364 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.780817 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:39.735328 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 420518us
I20260709 13:12:39.696787 31375 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.781874 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:39.782030 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:39.782532 29396 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.736840 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.736845 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.616221 31333 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.708632 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 408) took 1095 ms. Trace:
I20260709 13:12:39.713426 31365 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:39.739982 29471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1521) took 1842 ms (client timeout 1593 ms). Trace:
W20260709 13:12:39.742103 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 82398.6us
I20260709 13:12:39.728730 31157 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:39.743978 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 68665.5us
I20260709 13:12:39.808169 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:39.776732 29435 connection.cc:256] RPC call timeout handler was delayed by -1.0582011649999004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:12:39.809631 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:39.745111 31161 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:39.718502 30153 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:39.698645 31291 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.750924 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 406) took 1309 ms. Trace:
I20260709 13:12:39.812649 30157 rpcz_store.cc:276] 0709 13:12:38.441548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.441684 (+   136us) service_pool.cc:224] Handling call
0709 13:12:39.750741 (+1309057us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400730354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.750859 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":902075136}
I20260709 13:12:39.752666 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1511) took 1903 ms. Trace:
I20260709 13:12:39.815070 29470 rpcz_store.cc:276] 0709 13:12:37.849014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.849188 (+   174us) service_pool.cc:224] Handling call
0709 13:12:37.849587 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.716841 (+1867254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.752388 (+ 35547us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002a3fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:39.752596 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4142171520}
I20260709 13:12:39.819470 30159 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:39.753504 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:39.702692 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.783370 29539 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:39.784060 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:39.821300 29391 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:39.785861 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:39.822352 29388 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:39.786367 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:39.787015 29509 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.581s (SENT)
I20260709 13:12:39.787228 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.824425 29538 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:39.803087 29438 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:39.803603 29471 rpcz_store.cc:269] 0709 13:12:37.897581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.013305 (+115724us) service_pool.cc:224] Handling call
0709 13:12:39.738801 (+1725496us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b540004ef54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.739881 (+  1080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629056256}
I20260709 13:12:39.800709 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:39.825810 29545 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.803501 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1678) took 1117 ms. Trace:
I20260709 13:12:39.804009 29512 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:39.740478 30154 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:12:39.824791 29509 leader_election.cc:336] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.590s (SENT)
I20260709 13:12:39.826404 29543 rpcz_store.cc:276] 0709 13:12:38.686750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.414685 (+727935us) service_pool.cc:224] Handling call
0709 13:12:39.415038 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.747210 (+332172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.747243 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.747294 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:39.747344 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.803254 (+ 55910us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002bc354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:39.803308 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.803437 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480105984}
I20260709 13:12:39.827037 29509 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:39.828514 29360 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:39.829366 29538 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:39.828421 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:39.831020 29509 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.715s (SENT)
I20260709 13:12:39.831085 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:39.831632 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:39.832232 29543 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:39.778460 31356 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.840340 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:39.847635 29389 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:39.777323 31254 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:39.849128 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46131.4us
I20260709 13:12:39.849968 29435 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:39.800159 31171 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:39.799544 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 610) took 1672 ms. Trace:
I20260709 13:12:39.839772 31337 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.830925 31262 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:39.811924 31212 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:12:39.819308 31241 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:39.807331 31285 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:12:39.875499 31086 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:39.857982 31333 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:39.841464 31269 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:39.854023 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:39.812137 31233 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.836149 31336 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.858209 31171 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.787849 30156 rpcz_store.cc:276] 0709 13:12:38.613405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.614382 (+   977us) service_pool.cc:224] Handling call
0709 13:12:39.707281 (+1092899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:39.841619 31137 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:39.896610 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.893653 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:39.898164 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.932001 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.933135 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.934044 29470 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:39.858693 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:39.894600 31262 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:39.848255 31242 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:39.858489 31138 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:39.905835 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 51909.6us
I20260709 13:12:39.893777 29388 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:39.908278 31382 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:12:39.889822 31377 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:39.935561 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:39.935104 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.938763 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:39.940544 29360 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:39.892021 31337 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:39.902545 31291 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.987258 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.987596 31291 consensus_queue.cc:1059] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.988469 31303 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.988545 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.988826 31342 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:39.988677 29363 leader_election.cc:400] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:39.989387 29470 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:39.989470 31342 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:39.904404 31086 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.990167 31086 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.990572 31342 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.921351 31273 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:39.994653 31273 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.995059 31273 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:39.996076 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1671) took 1930 ms. Trace:
I20260709 13:12:39.996470 29540 rpcz_store.cc:276] 0709 13:12:38.066204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.424443 (+1358239us) service_pool.cc:224] Handling call
0709 13:12:39.482870 (+ 58427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.627328 (+144458us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:39.627703 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.701677 (+ 73974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.711782 (+ 10105us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:39.711853 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.994638 (+282785us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b180034e400. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419
0709 13:12:39.995795 (+  1157us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400409a54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:39.995850 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.996005 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3516,"prepare.queue_time_us":937,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":10153,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":9759,"spinlock_wait_cycles":348199680,"thread_start_us":73562,"threads_started":1,"wal-append.queue_time_us":121375}
I20260709 13:12:39.905164 31333 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:39.998690 31333 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.999826 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1673) took 1560 ms. Trace:
I20260709 13:12:39.995059 31262 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.000188 29544 rpcz_store.cc:276] 0709 13:12:38.439876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.535981 (+ 96105us) service_pool.cc:224] Handling call
0709 13:12:39.999612 (+1463631us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540036c254. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:39.999758 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606303104}
I20260709 13:12:40.000895 31262 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:40.001363 31377 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:40.001968 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1618) took 1787 ms. Trace:
I20260709 13:12:40.002409 31377 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.003633 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:39.900269 31329 consensus_queue.cc:1059] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:12:39.937913 29545 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:39.950197 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:39.951581 31222 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:39.951920 31368 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.348s	user 0.001s	sys 0.005s
I20260709 13:12:39.952361 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 612) took 1515 ms. Trace:
W20260709 13:12:39.952706 31384 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:39.956683 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:39.935993 30154 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:39.899267 31261 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:39.927335 31171 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:39.967664 31164 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:39.968837 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:39.903995 31364 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:39.972605 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1679) took 1253 ms. Trace:
I20260709 13:12:40.035848 29537 rpcz_store.cc:276] 0709 13:12:38.719891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.484088 (+764197us) service_pool.cc:224] Handling call
0709 13:12:39.491672 (+  7584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.612904 (+121232us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:39.613308 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.791703 (+178395us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.791763 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:39.791810 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.972340 (+180530us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54001b8854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:39.972390 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.972530 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4573,"prepare.queue_time_us":3315,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":4781,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":278158080,"thread_start_us":173034,"threads_started":1,"wal-append.queue_time_us":292946}
I20260709 13:12:39.975044 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.975215 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:39.975225 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:40.040261 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 65145.9us
I20260709 13:12:39.907764 31344 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:39.979733 29396 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:39.937875 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:40.043097 30126 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:40.043624 29471 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:39.984006 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.984627 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 44176us
I20260709 13:12:39.989470 29363 leader_election.cc:403] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.002365 29468 rpcz_store.cc:276] 0709 13:12:38.214072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.426554 (+1212482us) service_pool.cc:224] Handling call
0709 13:12:39.484991 (+ 58437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.622633 (+137642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.622669 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.622744 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:39.622778 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.001699 (+378921us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54001e5354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:40.001771 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.001896 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316029184}
I20260709 13:12:39.929898 31336 raft_consensus.cc:697] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:40.007637 30157 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:40.008142 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 72732.6us
I20260709 13:12:39.939110 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.019162 31254 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:40.050312 29512 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:40.038844 29539 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
W20260709 13:12:40.010456 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.015939 30156 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.016253 31332 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:12:40.052801 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 64348.2us
I20260709 13:12:40.056159 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.058764 29546 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:40.017586 30152 rpcz_store.cc:276] 0709 13:12:38.437319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.440967 (+  3648us) service_pool.cc:224] Handling call
0709 13:12:38.855332 (+414365us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:38.855642 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.721837 (+866195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.952020 (+230183us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400475c54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:39.952239 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841317888}
W20260709 13:12:40.066599 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 173019us
W20260709 13:12:39.943950 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 89473us
I20260709 13:12:39.961817 31216 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.059028 31164 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:40.070813 31164 raft_consensus.cc:697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:40.070706 31364 consensus_queue.cc:1059] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:40.071380 31337 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.072250 31364 raft_consensus.cc:3055] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:40.071973 31164 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.072738 31364 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:40.073204 31366 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.471s	user 0.001s	sys 0.001s
I20260709 13:12:40.021525 30155 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:12:40.074915 31373 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.475s	user 0.000s	sys 0.004s
I20260709 13:12:40.018082 31358 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.022400 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1611) took 1827 ms. Trace:
I20260709 13:12:40.068320 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:39.987262 31233 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.030045 31099 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.034298 31290 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:40.047766 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:40.069769 31375 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.030256 31356 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.076869 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1608) took 1900 ms. Trace:
I20260709 13:12:40.058555 31161 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:40.055409 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:39.982200 31138 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.114938 31287 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.118255 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 50026.5us
I20260709 13:12:40.118023 31287 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:40.083140 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.082116 29463 rpcz_store.cc:276] 0709 13:12:38.195378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.684617 (+489239us) service_pool.cc:224] Handling call
0709 13:12:38.684987 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.700438 (+ 15451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.700488 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.701187 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.116144 (+414957us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:39.116208 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.116315 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.880216 (+763901us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:12:40.018166 (+137950us) raft_consensus.cc:1685] finished
0709 13:12:40.018191 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.022318 (+  4127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20617,"raft.queue_time_us":10021,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":14480,"spinlock_wait_cycles":111003520,"thread_start_us":374647,"threads_started":1,"wal-append.queue_time_us":857520}
I20260709 13:12:40.073881 31364 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.086862 31377 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.087416 31337 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.087625 31291 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:40.136755 31086 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.137331 31291 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.139600 31291 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.140576 31390 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.135766 31237 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:40.144130 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.144255 29542 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:40.054888 31137 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.144853 31342 consensus_queue.cc:1059] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:40.145756 31342 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:40.146298 31342 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.147799 30155 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.148751 31342 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.149322 31342 raft_consensus.cc:3055] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:40.149614 31342 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:40.094424 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 46747.2us
I20260709 13:12:39.946898 31242 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.150978 31242 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.050990 31344 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:40.078183 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1672) took 1850 ms. Trace:
I20260709 13:12:40.063215 31332 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:40.113121 29390 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:40.159665 29539 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:40.158221 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:40.154932 30126 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:40.116940 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.120386 31287 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.120849 31285 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.084084 31212 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:40.113194 31250 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.124779 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:40.119908 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:40.091473 31233 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.128252 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:40.129503 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.130257 31261 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:40.130741 31364 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:40.131759 31392 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:12:40.132231 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.126272 31138 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.134861 31377 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.135718 31211 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.887982 30151 rpcz_store.cc:276] 0709 13:12:38.127040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.128782 (+  1742us) service_pool.cc:224] Handling call
0709 13:12:38.870020 (+741238us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cf8c 00007f61e587cef6 0000000000375939 00007f61ed8f01e0 00007f61ed9b90c4 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:38.870240 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.870670 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:39.470570 (+599900us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.799137 (+328567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.799194 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:39.799253 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.799322 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.799454 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":720863,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":46955,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":12807552,"thread_start_us":718490,"threads_started":2,"wal-append.queue_time_us":335802}
I20260709 13:12:40.136476 31337 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.258227 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.259359 29466 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:40.260393 31337 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.145140 31137 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.261215 31137 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.264087 31261 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.264613 31261 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.237150 31250 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.111155 29464 rpcz_store.cc:276] 0709 13:12:38.176169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.667043 (+490874us) service_pool.cc:224] Handling call
0709 13:12:38.667427 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.667820 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.667847 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.678369 (+ 10522us) log.cc:844] Serialized 26 byte log entry
0709 13:12:38.733632 (+ 55263us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:38.733668 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.733736 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:38.845188 (+111452us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b180034ae00. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b4557 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:12:40.072474 (+1227286us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:12:40.076625 (+  4151us) raft_consensus.cc:1685] finished
0709 13:12:40.076652 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.076796 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":10721,"spinlock_wait_cycles":147900800,"thread_start_us":49697,"threads_started":1,"wal-append.queue_time_us":860608}
I20260709 13:12:40.157783 29471 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:40.066015 31191 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:40.163448 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:40.267390 31250 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:40.268337 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:40.164760 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:40.166014 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:40.111395 31103 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.179172 31222 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.167222 29540 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:40.156085 29393 rpcz_store.cc:276] 0709 13:12:38.227531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.606390 (+378859us) service_pool.cc:224] Handling call
0709 13:12:38.606705 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.819165 (+212460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.819213 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.831424 (+ 12211us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.394934 (+563510us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:39.395012 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.751767 (+356755us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001725d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:39.751819 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.032285 (+280466us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:12:40.077904 (+ 45619us) raft_consensus.cc:1685] finished
0709 13:12:40.077930 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.078106 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1520,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":64427,"spinlock_wait_cycles":606876800,"thread_start_us":436590,"threads_started":1,"wal-append.queue_time_us":624461}
I20260709 13:12:40.174914 30157 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:40.111922 31268 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.179313 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:40.177605 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.123193 31213 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.227664 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:40.272826 31268 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.274238 31358 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:40.275029 31268 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:40.277361 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:40.270136 29545 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:40.277765 29539 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:40.228051 30155 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:12:40.230538 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 105827us
I20260709 13:12:40.231225 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1529) took 1920 ms. Trace:
I20260709 13:12:40.229296 30159 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
W20260709 13:12:40.231269 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 111427us
I20260709 13:12:40.281556 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:40.270671 31103 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.280494 29435 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:40.235759 31234 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:40.199424 29390 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:12:40.235144 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:40.288365 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53350.7us
I20260709 13:12:40.289441 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:40.236047 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:40.290606 29543 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:40.242185 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.177772 31285 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.162963 31344 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.166390 31342 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.270771 31222 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.280267 29465 rpcz_store.cc:276] 0709 13:12:38.311187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.622855 (+1311668us) service_pool.cc:224] Handling call
0709 13:12:39.623273 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.766998 (+143725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.230858 (+463860us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b540035c854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:40.231137 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142463360}
W20260709 13:12:40.230063 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 73135.7us
I20260709 13:12:40.281800 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:40.325533 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:40.332768 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51036.9us
I20260709 13:12:40.232817 31389 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:40.232993 31233 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.332427 29363 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:40.294889 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:40.280817 31337 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:40.267406 31191 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.280661 31291 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.236637 31273 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.187987 31336 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:40.354750 30126 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.508s (SENT) [suppressed 8 similar messages]
I20260709 13:12:40.285686 31103 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.569497 29360 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:40.559145 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:40.282495 31099 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:12:40.456606 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 124263us
I20260709 13:12:40.299968 31285 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.570957 30154 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:40.441419 31398 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:40.574308 31398 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.495918 29292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 174) took 5033 ms. Trace:
I20260709 13:12:40.616710 29467 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:12:40.617624 31344 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.619273 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:40.619526 29544 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:40.529044 31242 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.620517 31398 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.621026 31191 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.622423 31242 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:40.463857 31393 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:12:40.616533 29292 rpcz_store.cc:276] 0709 13:12:35.462885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.463097 (+   212us) service_pool.cc:224] Handling call
0709 13:12:40.495699 (+5032602us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1500609,"reported_tablets":1}
W20260709 13:12:40.625126 30156 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.550s	user 0.014s	sys 0.002s
I20260709 13:12:40.625752 30156 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:40.513227 31237 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:40.493422 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:40.521791 31216 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.496143 29294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 281) took 5740 ms. Trace:
I20260709 13:12:40.628319 29294 rpcz_store.cc:276] 0709 13:12:34.754218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.754351 (+   133us) service_pool.cc:224] Handling call
0709 13:12:40.494331 (+5739980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:35.658953 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:35.891949 (+232996us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:35.901942 (+  9993us) write_op.cc:435] Acquired schema lock
0709 13:12:35.926648 (+ 24706us) tablet.cc:662] Decoding operations
0709 13:12:36.036135 (+109487us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:36.036281 (+   146us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:36.036325 (+    44us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:12:36.038813 (+  2488us) tablet.cc:701] Row locks acquired
0709 13:12:36.038874 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:12:36.039150 (+   276us) write_op.cc:270] Start()
0709 13:12:36.039379 (+   229us) write_op.cc:276] Timestamp: P: 1783602756039054 usec, L: 0
0709 13:12:36.039424 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:12:36.041808 (+  2384us) log.cc:844] Serialized 1311 byte log entry
0709 13:12:37.517851 (+1476043us) op_driver.cc:464] REPLICATION: finished
0709 13:12:38.027044 (+509193us) write_op.cc:301] APPLY: starting
0709 13:12:38.036770 (+  9726us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:38.076808 (+ 40038us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:38.110632 (+ 33824us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:38.111364 (+   732us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:38.111704 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:12:38.111790 (+    86us) write_op.cc:312] APPLY: finished
0709 13:12:38.112180 (+   390us) log.cc:844] Serialized 35 byte log entry
0709 13:12:38.112428 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:38.112543 (+   115us) write_op.cc:454] Released schema lock
0709 13:12:38.112615 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:38.113152 (+   537us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:38.113187 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1657,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":472074,"apply.run_cpu_time_us":3466,"apply.run_wall_time_us":105087,"num_ops":3,"prepare.queue_time_us":509325,"prepare.run_cpu_time_us":34286,"prepare.run_wall_time_us":855986,"raft.queue_time_us":804954,"raft.run_cpu_time_us":55570,"raft.run_wall_time_us":737684,"replication_time_us":1443953,"spinlock_wait_cycles":164608,"thread_start_us":1318367,"threads_started":4,"wal-append.queue_time_us":466041,"wal-append.run_cpu_time_us":41168,"wal-append.run_wall_time_us":3822785}]]}
I20260709 13:12:40.523808 31356 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:40.491374 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 439533us
I20260709 13:12:40.631933 31079 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:12:40.555373 31157 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.000s
I20260709 13:12:40.381613 31261 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.570362 31291 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:40.569662 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 214965us
I20260709 13:12:40.583740 31137 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.537974 29290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 294) took 5675 ms. Trace:
I20260709 13:12:40.541395 31342 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.533021 31255 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:40.478547 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.393126 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:40.648895 31405 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.658330 30159 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:40.393509 31086 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.489382 31377 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.334925 31213 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:40.334769 31378 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:40.446677 29541 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
W20260709 13:12:40.665028 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 51034us
I20260709 13:12:40.441506 31339 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:40.294055 31125 raft_consensus.cc:2764] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:12:40.393604 31337 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.424571 31212 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.678807 31291 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.295938 31358 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.684319 31337 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.692137 31137 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.286379 31332 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.334520 31333 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.333215 31376 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.242s
I20260709 13:12:40.299682 31201 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.276s
I20260709 13:12:40.333596 31390 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.275s
I20260709 13:12:40.432760 31161 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.702472 31161 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.702944 31161 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.698379 31286 consensus_queue.cc:1059] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:12:40.337910 31222 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.707614 31332 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.438140 31241 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.710737 31241 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.713057 31241 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.329977 31268 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:40.713646 31268 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.714052 31268 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.449329 31250 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:12:40.574110 31375 consensus_queue.cc:1059] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:40.331133 31234 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:40.618667 31171 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.003s
W20260709 13:12:40.506657 31400 log.cc:927] Time spent T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:12:40.638504 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 68959.2us
I20260709 13:12:40.645460 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:40.649151 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 315592us
W20260709 13:12:40.652166 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.652901 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 290047us
I20260709 13:12:40.651103 29512 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:40.649324 31398 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:40.661760 31405 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.664597 29546 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:40.740638 31405 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.723506 31234 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:40.739859 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.666360 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:40.644040 31099 consensus_queue.cc:1059] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:12:40.745219 31099 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.745725 31099 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.513440 31233 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.746559 31398 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.747176 31398 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.748126 31233 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.748742 31233 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:40.749060 31233 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:40.647437 31344 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:40.517730 31138 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.730511 31171 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.753067 31138 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.656711 29290 rpcz_store.cc:276] 0709 13:12:34.862298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.862552 (+   254us) service_pool.cc:224] Handling call
0709 13:12:40.537870 (+5675318us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:36.458457 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:36.463543 (+  5086us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:36.464618 (+  1075us) write_op.cc:435] Acquired schema lock
0709 13:12:36.464658 (+    40us) tablet.cc:662] Decoding operations
0709 13:12:36.465353 (+   695us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:36.465430 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:36.465487 (+    57us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:12:36.537663 (+ 72176us) tablet.cc:701] Row locks acquired
0709 13:12:36.559091 (+ 21428us) write_op.cc:260] PREPARE: finished
0709 13:12:36.600151 (+ 41060us) write_op.cc:270] Start()
0709 13:12:36.610733 (+ 10582us) write_op.cc:276] Timestamp: P: 1783602756591100 usec, L: 0
0709 13:12:36.616622 (+  5889us) op_driver.cc:348] REPLICATION: starting
0709 13:12:36.891749 (+275127us) log.cc:844] Serialized 1380 byte log entry
0709 13:12:37.870994 (+979245us) op_driver.cc:464] REPLICATION: finished
0709 13:12:39.320232 (+1449238us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b180034ccc0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:12:39.320410 (+   178us) write_op.cc:301] APPLY: starting
0709 13:12:39.320502 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:39.320662 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:39.320684 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:39.321297 (+   613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:39.321644 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:12:39.321690 (+    46us) write_op.cc:312] APPLY: finished
0709 13:12:39.321942 (+   252us) log.cc:844] Serialized 35 byte log entry
0709 13:12:39.322136 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:39.322248 (+   112us) write_op.cc:454] Released schema lock
0709 13:12:39.322291 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:39.486300 (+164009us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:39.496027 (+  9727us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":953386,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":231387,"apply.run_cpu_time_us":2360,"apply.run_wall_time_us":61676,"num_ops":3,"prepare.queue_time_us":436306,"prepare.run_cpu_time_us":10896,"prepare.run_wall_time_us":446230,"replication_time_us":1254196,"spinlock_wait_cycles":163697536,"thread_start_us":185209,"threads_started":1}]]}
I20260709 13:12:40.753628 31137 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.754072 31137 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.754449 31137 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.754347 29470 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:40.730664 31364 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.755407 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1609) took 2561 ms. Trace:
I20260709 13:12:40.755678 31364 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.755833 29469 rpcz_store.cc:276] 0709 13:12:38.194611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.682110 (+487499us) service_pool.cc:224] Handling call
0709 13:12:38.717281 (+ 35171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.722219 (+  4938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.722266 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.734879 (+ 12613us) log.cc:844] Serialized 26 byte log entry
0709 13:12:40.076282 (+1341403us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b180020f620. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:12:40.278830 (+202548us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:40.278890 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.278995 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.755041 (+476046us) raft_consensus.cc:1685] finished
0709 13:12:40.755072 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.755328 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13362,"raft.queue_time_us":161,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":8024,"spinlock_wait_cycles":370736896,"thread_start_us":202274,"threads_started":1,"wal-append.queue_time_us":1679266}
I20260709 13:12:40.665191 31378 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.651182 31157 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:40.757707 31378 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.721017 31333 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.665789 31269 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.725262 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 430460us
I20260709 13:12:40.734699 31250 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:40.735538 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:40.736200 31241 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:12:40.736967 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 91663.1us
W20260709 13:12:40.786000 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 119737us
W20260709 13:12:40.788302 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 137288us
I20260709 13:12:40.786386 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:40.792810 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 54993.6us
I20260709 13:12:40.791857 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:40.786331 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:40.797894 31339 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.798372 31339 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.798811 31339 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.763142 31262 raft_consensus.cc:1064] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:40.800653 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:40.796069 29294 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:40.810683 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:40.810580 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:40.813163 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.815024 29391 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 3
I20260709 13:12:40.815502 29391 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:12:40.817004 31377 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.817222 30156 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:40.817497 31377 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.817898 31377 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.808239 31201 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:40.818892 31201 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:40.818926 31409 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.819417 31201 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.819669 31409 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.822504 29391 raft_consensus.cc:2917] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:12:40.822753 31406 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:40.758334 31364 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.779310 31171 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.762794 31337 raft_consensus.cc:3055] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:40.823257 29391 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:40.854921 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 54357us
I20260709 13:12:40.855913 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.809626 29294 catalog_manager.cc:5697] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:12:40.834057 31344 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.834916 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:40.872181 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.873329 29463 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 2: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:40.822279 31409 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.835532 31406 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.749862 31233 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.765997 31157 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.773506 31099 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.773612 31161 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.824836 29546 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:40.814917 29512 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:40.826820 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:40.828900 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:40.891772 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:40.892586 29389 raft_consensus.cc:2376] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3. Re-sending same reply.
I20260709 13:12:40.831087 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:40.894093 29541 raft_consensus.cc:2393] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:40.829566 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:40.834972 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:40.827723 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:40.838485 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:40.845506 30126 leader_election.cc:336] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.937s (SENT)
I20260709 13:12:40.897370 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:40.715915 31191 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:40.857244 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:40.857580 29294 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:12:40.790212 31273 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:40.863232 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.857969 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:40.882078 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.869107 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:40.885180 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.878825 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:40.890148 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 75335.2us
I20260709 13:12:40.838558 31333 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:40.800695 31269 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.032073 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:41.032501 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:41.033658 29388 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:40.899513 29294 catalog_manager.cc:5697] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.860932 31337 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:41.032639 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 163628us
I20260709 13:12:40.899041 30158 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.980912 29396 raft_consensus.cc:2393] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 2: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:40.996640 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:41.013510 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:40.947424 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 45712.1us
I20260709 13:12:40.941850 31237 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:40.900662 29465 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:40.898409 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52947.8us
I20260709 13:12:40.901417 29542 raft_consensus.cc:2368] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3.
I20260709 13:12:40.900738 31191 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:41.041327 31171 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:40.878866 31406 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.068996 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:41.069694 29541 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
W20260709 13:12:40.942361 31286 consensus_queue.cc:1175] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 6 } }
I20260709 13:12:41.039485 31213 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:41.043079 31329 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.057485 29294 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.867569 31376 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.965106 31242 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.009109 31233 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.061721 29463 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:41.065488 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:40.946331 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:41.067754 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:41.067286 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:40.888769 29394 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:41.072685 30160 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:41.066362 29435 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:41.115952 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:41.116417 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 51281.2us
I20260709 13:12:41.074666 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:41.118712 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.118984 31234 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:41.119346 29543 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:41.119516 31234 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:41.120543 31234 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.086160 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:41.123716 29537 raft_consensus.cc:2410] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:12:41.124605 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.125730 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.113122 31329 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.127084 31161 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:41.127758 31161 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:41.129037 29397 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:41.130549 31242 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.132997 31242 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:41.057500 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:41.134750 29388 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.901031 31364 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.964200 31378 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.139336 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.139631 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:41.140074 29546 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.140165 31378 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:41.140344 29396 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:41.106516 31213 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.141324 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:41.141963 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.142679 29396 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.145577 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:41.096084 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:41.097357 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:40.878610 31344 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.148541 31344 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:41.025633 31285 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.103478 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.105125 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:41.104506 29541 raft_consensus.cc:1240] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:12:41.104497 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:41.110700 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:40.964746 31099 consensus_queue.cc:1059] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
W20260709 13:12:41.112960 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 45780us
I20260709 13:12:41.130895 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:41.044188 31356 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:12:41.041600 31333 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:40.990470 31137 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.004645 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:41.049225 31262 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:41.599407 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 258383us
W20260709 13:12:41.154667 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.609679 31250 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:41.609958 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.611090 29471 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:41.610481 31250 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.612071 31358 raft_consensus.cc:3055] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:41.612247 29470 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.612504 31358 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:41.613451 31358 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.614481 31358 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.370496 29396 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:41.616032 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:41.616756 29396 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:41.617708 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:41.094520 31171 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.640241 31171 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.611479 29392 raft_consensus.cc:2410] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:41.099336 29294 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.267726 29465 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:41.111385 31273 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.620219 31137 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:41.620775 29389 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:41.621978 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.288581 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1696) took 1510 ms. Trace:
I20260709 13:12:41.164533 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:41.285537 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:41.500191 29509 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.817s (SENT)
I20260709 13:12:41.335150 30158 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:41.340188 31161 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:41.126363 31339 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.154884 29537 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.614125 31250 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:41.261672 31164 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:12:41.328291 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.363617 31398 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.004s
I20260709 13:12:41.151124 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.117920 29435 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:12:41.359017 31418 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:12:41.339952 31211 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:41.261313 31364 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:41.295727 29543 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:12:41.716089 30159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.021s
W20260709 13:12:41.728358 30159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.011s	sys 0.021s
W20260709 13:12:41.683894 29540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.013s	sys 0.015s
W20260709 13:12:41.733641 29540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.013s	sys 0.017s
I20260709 13:12:41.696192 29541 raft_consensus.cc:2410] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:41.695598 29397 rpcz_store.cc:276] 0709 13:12:39.777989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.780574 (+  2585us) service_pool.cc:224] Handling call
0709 13:12:41.288305 (+1507731us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540031db54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:41.288487 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3098830208}
I20260709 13:12:41.698074 29467 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:41.698074 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:41.698870 29512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.012s	sys 0.030s
W20260709 13:12:41.737962 29512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.013s	sys 0.030s
W20260709 13:12:41.589579 31419 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.544s	user 0.000s	sys 0.001s
W20260709 13:12:41.359795 31421 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.298s	user 0.000s	sys 0.000s
I20260709 13:12:41.702307 31358 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:41.479236 31222 consensus_meta.cc:287] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.772s	user 0.013s	sys 0.000s
I20260709 13:12:41.695472 30160 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:41.709460 31261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.012s	sys 0.021s
W20260709 13:12:41.716542 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.635380 31356 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:41.685266 31103 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.116s	user 0.006s	sys 0.008s
I20260709 13:12:41.725726 29546 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:41.664527 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:41.683948 29542 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:41.758765 31356 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.749954 30151 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:12:41.761759 31356 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:41.702728 31336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.027s
I20260709 13:12:41.711992 31161 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.742403 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:41.764652 29543 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:41.719586 31237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.024s	sys 0.015s
W20260709 13:12:41.768263 31237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.024s	sys 0.016s
I20260709 13:12:41.771804 31237 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:12:41.772845 31420 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:12:41.773499 31255 raft_consensus.cc:3055] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:41.773957 31255 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:41.773308 31237 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:41.727380 31079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.016s	sys 0.026s
W20260709 13:12:41.774678 31079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.017s	sys 0.026s
I20260709 13:12:41.746587 31364 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.776026 31137 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:12:41.747092 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 246968us
I20260709 13:12:41.776988 31137 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.777594 31137 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.780567 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:41.747695 31242 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.781613 31242 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.748219 31191 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:41.782770 31191 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:41.783672 31336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.028s
I20260709 13:12:41.784595 31137 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:41.784897 31191 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:41.785743 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:41.786628 30154 raft_consensus.cc:2393] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 2: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:41.792008 31161 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:41.793489 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:41.794226 30160 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:41.751434 31201 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.005s
I20260709 13:12:41.699666 31273 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:41.713212 31332 consensus_meta.cc:287] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.000s	user 0.013s	sys 0.001s
I20260709 13:12:41.749086 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:41.756487 31261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.012s	sys 0.021s
W20260709 13:12:41.730418 31268 consensus_meta.cc:287] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.016s	user 0.013s	sys 0.000s
I20260709 13:12:41.808771 29470 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:41.730037 31398 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.796916 31285 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:41.795662 29509 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:41.821250 29543 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:41.823205 31406 consensus_meta.cc:287] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.000s
I20260709 13:12:41.824358 29537 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:41.767247 31358 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.743925 31211 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:41.805675 31376 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.661s	user 0.005s	sys 0.005s
I20260709 13:12:41.801638 31079 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:41.834851 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:41.807818 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:41.767825 31222 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.375200 31337 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.842886 29539 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:12:41.837937 30123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.056s
I20260709 13:12:41.799994 31356 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:12:41.770119 31103 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:41.837575 31250 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:41.828071 31242 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:41.841063 31376 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.832098 31268 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:41.836221 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:41.860757 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:41.877954 30158 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:41.805006 31201 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:41.839969 31377 consensus_meta.cc:287] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.022s	user 0.011s	sys 0.004s
I20260709 13:12:41.852914 31333 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:41.852557 31079 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:41.847862 31344 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:41.868930 30157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.021s	sys 0.045s
I20260709 13:12:41.893589 31364 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:41.850404 30123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.008s	sys 0.056s
W20260709 13:12:41.905601 30157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.022s	sys 0.045s
I20260709 13:12:41.865358 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:41.863045 31337 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.861052 31250 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:41.898818 31137 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:41.901381 31201 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:41.894976 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 375) took 1008 ms. Trace:
I20260709 13:12:41.920045 30159 rpcz_store.cc:276] 0709 13:12:40.887065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.887318 (+   253us) service_pool.cc:224] Handling call
0709 13:12:41.079405 (+192087us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:41.079716 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:41.105962 (+ 26246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.106009 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:41.147151 (+ 41142us) log.cc:844] Serialized 572 byte log entry
0709 13:12:41.732238 (+585087us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:41.732315 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.733910 (+  1595us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.894499 (+160589us) raft_consensus.cc:1685] finished
0709 13:12:41.894533 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.894872 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81328512,"thread_start_us":584653,"threads_started":1,"wal-append.queue_time_us":741095}
I20260709 13:12:41.856333 30154 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:41.647696 29294 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:41.532177 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.600164 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.601495 29388 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:42.033136 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1641) took 1039 ms. Trace:
I20260709 13:12:41.988471 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1618) took 1177 ms. Trace:
I20260709 13:12:42.035670 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:42.034612 29393 rpcz_store.cc:276] 0709 13:12:40.810631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.811135 (+   504us) service_pool.cc:224] Handling call
0709 13:12:40.811483 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:40.826574 (+ 15091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.826607 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:40.835284 (+  8677us) log.cc:844] Serialized 26 byte log entry
0709 13:12:40.953153 (+117869us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:40.953219 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.953339 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.987585 (+1034246us) raft_consensus.cc:1685] finished
0709 13:12:41.987672 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.988105 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24159,"raft.queue_time_us":62984,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10298,"thread_start_us":117375,"threads_started":1,"wal-append.queue_time_us":206314}
I20260709 13:12:41.417135 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.046837 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.047960 29394 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:42.049506 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:41.706288 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.051514 29389 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:42.052233 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1637) took 1059 ms. Trace:
I20260709 13:12:41.842087 31255 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:41.991508 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.992434 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1619) took 1181 ms. Trace:
I20260709 13:12:41.992810 29471 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.993705 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:41.995388 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:42.004382 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.006455 29469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.009s
I20260709 13:12:42.007819 29472 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:42.015646 29544 raft_consensus.cc:2393] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:12:42.019656 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 410230us
W20260709 13:12:42.019963 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 111674us
I20260709 13:12:42.023593 30153 raft_consensus.cc:2393] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:12:41.924798 31233 consensus_meta.cc:287] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.813s	user 0.003s	sys 0.010s
I20260709 13:12:41.909891 31344 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:42.142458 31344 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.838145 31406 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:42.146989 31233 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.147903 31233 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:42.149487 31406 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:41.915362 31333 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.151017 31333 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.153754 31333 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:41.907192 31377 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:42.156541 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.156782 31377 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:41.918643 31250 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.876456 31213 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:41.991186 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1620) took 1165 ms. Trace:
I20260709 13:12:42.033777 29388 rpcz_store.cc:276] 0709 13:12:40.993800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.057143 (+ 63343us) service_pool.cc:224] Handling call
0709 13:12:42.032752 (+975609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.038107 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:41.919435 31137 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:42.052723 29389 rpcz_store.cc:276] 0709 13:12:40.992586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.705925 (+713339us) service_pool.cc:224] Handling call
0709 13:12:42.052102 (+346177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.162322 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.163470 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.163975 31211 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.164526 31445 consensus_queue.cc:1059] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:42.164315 31137 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.098997 31161 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.088486 31286 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.165872 31445 raft_consensus.cc:3055] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:42.166428 31445 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:42.166112 31161 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:42.166325 31286 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.168175 31445 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:42.169312 31161 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.169620 31286 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.104302 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 424) took 1143 ms. Trace:
I20260709 13:12:42.170192 31445 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.935850 31364 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:12:42.098063 31099 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:42.170993 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.171259 31273 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.171622 31099 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.170305 30153 rpcz_store.cc:276] 0709 13:12:40.960451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.964297 (+  3846us) service_pool.cc:224] Handling call
0709 13:12:41.748848 (+784551us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:12:42.103727 (+354879us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b5400122ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:42.104065 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173400832}
I20260709 13:12:42.122283 31164 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:42.041172 29294 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 3 to 4, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:42.175660 31164 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:42.176715 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.133586 29394 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:42.124737 31442 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:12:42.135991 29469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.010s	sys 0.009s
I20260709 13:12:42.082721 29391 rpcz_store.cc:276] 0709 13:12:40.811019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.814304 (+  3285us) service_pool.cc:224] Handling call
0709 13:12:40.814763 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:40.856073 (+ 41310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.856107 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:40.856616 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:12:41.011141 (+154525us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:41.174818 (+163677us) log.cc:844] Serialized 14 byte log entry
0709 13:12:41.280596 (+105778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.280693 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.991853 (+711160us) raft_consensus.cc:1685] finished
0709 13:12:41.991898 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.992178 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":784851,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":63,"raft.queue_time_us":125473,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":15867,"thread_start_us":298456,"threads_started":2,"wal-append.queue_time_us":181523}
I20260709 13:12:42.138649 29395 raft_consensus.cc:2410] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:42.138904 31103 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.139786 31329 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.122323 31436 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:42.187870 31436 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.189441 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:42.139803 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.190467 29545 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:42.158406 29390 rpcz_store.cc:276] 0709 13:12:40.825126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.825267 (+   141us) service_pool.cc:224] Handling call
0709 13:12:40.825602 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:40.826007 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.826036 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:40.836057 (+ 10021us) log.cc:844] Serialized 26 byte log entry
0709 13:12:41.099760 (+263703us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:41.099847 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.099977 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.990410 (+890433us) raft_consensus.cc:1685] finished
0709 13:12:41.990475 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.990888 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39035,"raft.queue_time_us":11606,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":15837,"thread_start_us":263168,"threads_started":1,"wal-append.queue_time_us":524134}
I20260709 13:12:42.163523 29388 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:42.165143 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.100152 31408 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.943994 31398 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.172104 29393 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:42.175612 29294 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.131740 31432 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.132458 31269 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.051661 31079 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:42.095815 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.132892 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:42.135462 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 1.01742e+06us
W20260709 13:12:42.122341 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.595784 29545 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:42.597011 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.205391 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.598057 29390 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:42.598156 31364 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:42.217741 31339 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:42.599354 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.195870 29537 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:42.207558 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.210726 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:42.296336 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.242479 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.602424 29471 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:42.224177 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1686) took 1159 ms. Trace:
I20260709 13:12:42.597200 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.604764 29388 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:42.605295 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1633) took 1744 ms. Trace:
I20260709 13:12:42.605654 29388 rpcz_store.cc:276] 0709 13:12:40.860587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.596732 (+1736145us) service_pool.cc:224] Handling call
0709 13:12:42.605199 (+  8467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.599238 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.607718 31222 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.197513 29392 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:42.609722 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.606918 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.196676 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1617) took 1386 ms. Trace:
W20260709 13:12:42.270574 29509 leader_election.cc:336] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.877s (SENT)
I20260709 13:12:42.608201 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:42.612262 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.603503 29391 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:42.603804 29544 rpcz_store.cc:276] 0709 13:12:41.065047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.065191 (+   144us) service_pool.cc:224] Handling call
0709 13:12:42.223729 (+1158538us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540037b4d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:42.224045 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076566912}
I20260709 13:12:42.613173 29390 raft_consensus.cc:2410] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:42.218150 29397 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:42.615604 31378 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:42.615801 29397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1640) took 1622 ms (client timeout 2157 ms). Trace:
W20260709 13:12:42.616390 29397 rpcz_store.cc:269] 0709 13:12:40.993489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.994643 (+1001154us) service_pool.cc:224] Handling call
0709 13:12:42.615727 (+621084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.617743 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:42.594177 31234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.010s	sys 0.014s
I20260709 13:12:42.598464 29470 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:42.610633 29395 rpcz_store.cc:276] 0709 13:12:40.810279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.810460 (+   181us) service_pool.cc:224] Handling call
0709 13:12:42.196366 (+1385906us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000e6fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:42.196583 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2995127552}
I20260709 13:12:42.621743 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.621933 31137 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:42.622769 29463 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:42.625272 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.625754 31237 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.628403 31171 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.987s	user 0.016s	sys 0.003s
I20260709 13:12:42.627651 29468 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 4. Ops: []
I20260709 13:12:42.628755 31103 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.629128 31171 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:42.629506 31103 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:42.630690 29539 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.774s	user 0.015s	sys 0.003s
I20260709 13:12:42.631296 29539 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:42.632505 31103 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:42.633040 30123 leader_election.cc:336] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.781s (SENT)
I20260709 13:12:42.633101 31103 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.633721 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:42.633965 31103 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.635597 31222 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:42.634306 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.636801 31103 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.192440 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:42.613873 29392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1636) took 1621 ms (client timeout 1877 ms). Trace:
I20260709 13:12:42.617892 29467 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:12:42.646328 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 513728us
I20260709 13:12:42.647841 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.648829 31336 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:42.649595 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.649734 31336 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.650662 29397 raft_consensus.cc:2410] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:42.651623 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.652479 31336 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.652541 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.653653 29464 raft_consensus.cc:2410] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:12:42.199688 31099 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:42.602005 31436 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.601962 31233 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.197067 31201 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:42.674633 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.643077 29392 rpcz_store.cc:269] 0709 13:12:40.992197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.699800 (+707603us) service_pool.cc:224] Handling call
0709 13:12:42.610015 (+910215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.652575 29397 raft_consensus.cc:2393] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 2: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:42.646981 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:42.166119 31332 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:42.680176 31332 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.681826 31378 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:42.682654 31436 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.683485 31436 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.686008 31436 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.666124 31432 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.689185 31432 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:42.628659 31237 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:42.690754 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 420354us
I20260709 13:12:42.693200 31237 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:42.693384 29544 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:42.693822 31237 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:42.197840 31441 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:42.669857 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.611692 31408 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:42.671308 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.672127 29388 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:42.524302 31344 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.669167 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1646) took 1537 ms. Trace:
I20260709 13:12:42.678795 31406 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:42.632469 31171 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.808437 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.820729 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.845675 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1701) took 1734 ms. Trace:
I20260709 13:12:42.816967 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:42.720948 31161 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.843959 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.178s	user 0.019s	sys 0.043s
W20260709 13:12:42.855250 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.021s	sys 0.044s
I20260709 13:12:42.719381 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:42.722905 31201 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.198499 30156 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:42.721323 31233 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.847048 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.857920 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1639) took 1864 ms. Trace:
I20260709 13:12:42.862422 29390 rpcz_store.cc:276] 0709 13:12:40.993197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.701442 (+1708245us) service_pool.cc:224] Handling call
0709 13:12:42.857845 (+156403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.718837 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.723654 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:42.796911 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.846222 29539 rpcz_store.cc:276] 0709 13:12:41.111161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.150229 (+ 39068us) service_pool.cc:224] Handling call
0709 13:12:42.845453 (+1695224us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001b7454. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:42.845605 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287409920}
I20260709 13:12:42.205942 31358 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:42.695030 29438 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:42.694181 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:42.842933 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.645308 31339 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.868288 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.682343 31378 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:42.724020 31337 consensus_meta.cc:287] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.004s
I20260709 13:12:42.857489 31424 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:42.874563 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:42.798278 31268 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:42.887744 29467 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:12:42.886233 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 70839.5us
I20260709 13:12:42.891017 29471 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:42.891130 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:42.885946 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:42.889832 29468 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
W20260709 13:12:42.898818 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 175291us
I20260709 13:12:42.899446 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.900203 29391 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
W20260709 13:12:42.903611 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 235053us
I20260709 13:12:42.904454 31161 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:42.904793 31233 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.873572 31332 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:42.904853 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 185695us
I20260709 13:12:42.907215 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.849133 29469 rpcz_store.cc:276] 0709 13:12:41.159091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.159373 (+   282us) service_pool.cc:224] Handling call
0709 13:12:41.340452 (+181079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.340780 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:42.240941 (+900161us) log.cc:844] Serialized 14 byte log entry
0709 13:12:42.576737 (+335796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:42.585112 (+  8375us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:42.602349 (+ 17237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.613311 (+ 10962us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.655804 (+ 42493us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":607295,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":62,"raft.queue_time_us":20835,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":1320,"thread_start_us":1083209,"threads_started":2,"wal-append.queue_time_us":364212}
I20260709 13:12:42.902818 29393 raft_consensus.cc:2376] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3. Re-sending same reply.
I20260709 13:12:42.906773 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.891177 31436 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:42.910756 29397 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:42.907836 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.909204 29392 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:42.916849 31439 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:42.917136 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:42.917551 31439 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:42.918812 31161 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:42.917351 29396 raft_consensus.cc:2410] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:42.918958 31439 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:42.920397 29396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1643) took 1862 ms (client timeout 1769 ms). Trace:
W20260709 13:12:42.920825 29396 rpcz_store.cc:269] 0709 13:12:41.058540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.617471 (+558931us) service_pool.cc:224] Handling call
0709 13:12:42.920128 (+1302657us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002c1fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:42.920286 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2866596608}
I20260709 13:12:42.921996 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.923015 29396 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:42.923295 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:42.923967 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.924135 30151 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.924949 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.925235 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.926913 29391 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:42.928535 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:42.929250 29538 raft_consensus.cc:2368] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:42.929986 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.930954 29466 raft_consensus.cc:2368] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:42.931759 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:42.934527 29389 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:42.941768 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:42.943367 29388 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:42.944478 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:42.898883 31441 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.931305 31171 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:42.938645 30154 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:42.939896 31255 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:42.933975 31424 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.960119 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:42.913093 31406 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:42.971591 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 156382us
I20260709 13:12:42.946723 31164 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:42.957137 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 428) took 1710 ms. Trace:
W20260709 13:12:42.974550 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 61775.7us
I20260709 13:12:42.930734 31339 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:42.969493 29394 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.792s	user 0.012s	sys 0.004s
I20260709 13:12:42.986323 29397 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:42.987545 29392 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:12:42.985967 30159 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:42.962476 30153 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:42.987876 29392 pending_rounds.cc:85] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 5
I20260709 13:12:42.972802 31268 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:42.978327 30157 rpcz_store.cc:276] 0709 13:12:41.138417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.138686 (+   269us) service_pool.cc:224] Handling call
0709 13:12:41.275697 (+137011us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:41.275973 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:41.907847 (+631874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.907899 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:41.919116 (+ 11217us) log.cc:844] Serialized 26 byte log entry
0709 13:12:42.618631 (+699515us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:42.667248 (+ 48617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.667324 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:42.676430 (+  9106us) raft_consensus.cc:1685] finished
0709 13:12:42.676477 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.849030 (+172553us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":637787,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":10377,"spinlock_wait_cycles":27141376,"thread_start_us":699044,"threads_started":2,"wal-append.queue_time_us":91780}
I20260709 13:12:42.999130 29396 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:42.991223 29392 pending_rounds.cc:107] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:12:43.000662 29392 raft_consensus.cc:2889] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:42.991698 31250 consensus_meta.cc:287] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.770s	user 0.016s	sys 0.001s
I20260709 13:12:43.002029 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.003243 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:43.004021 30158 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.004362 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.005553 31329 consensus_queue.cc:1059] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:42.986929 31408 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:43.004403 29393 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:43.006731 31450 raft_consensus.cc:3055] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:43.007182 31450 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:43.007958 31201 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:43.008476 31450 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.011286 31450 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.012785 30160 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:43.010025 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:43.015026 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.016019 29466 raft_consensus.cc:2393] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:43.015908 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:43.016753 30155 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:43.018004 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:43.018798 29512 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:43.021622 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.022610 31103 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:43.022960 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.022751 31268 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.023351 31103 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:43.024436 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:43.024699 31339 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:43.024556 31103 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.025319 31268 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:43.026677 31250 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:42.986915 29394 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:43.051011 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.054180 29466 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:43.068274 31250 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:43.054551 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.070485 30155 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
W20260709 13:12:43.071736 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.071938 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.072605 29466 raft_consensus.cc:2376] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3. Re-sending same reply.
I20260709 13:12:43.072646 29360 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.054847 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.073709 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.073951 29467 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:43.074887 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 382) took 1231 ms. Trace:
I20260709 13:12:43.075018 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.075366 30156 rpcz_store.cc:276] 0709 13:12:41.843795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.847146 (+  3351us) service_pool.cc:224] Handling call
0709 13:12:43.074688 (+1227542us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540025a8d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:43.074813 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556676352}
I20260709 13:12:43.076364 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.075094 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.077034 29466 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:43.077409 29467 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:43.078064 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.078358 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.078624 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1638) took 2085 ms. Trace:
I20260709 13:12:43.077986 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.079080 29393 rpcz_store.cc:276] 0709 13:12:40.992876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.946423 (+1953547us) service_pool.cc:224] Handling call
0709 13:12:42.976405 (+ 29982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:43.007084 (+ 30679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.078268 (+ 71184us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b5400160654. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:43.078521 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39971584}
I20260709 13:12:43.079553 31408 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:43.079668 29468 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:43.080052 31408 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:43.080482 31408 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:43.081314 29468 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:43.026934 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:43.079171 29467 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:43.084656 30159 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.088975 29469 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:43.087596 31436 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:43.096915 29539 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 3. Ops: []
I20260709 13:12:43.097307 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.097636 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.098464 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:43.099105 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 115198us
I20260709 13:12:43.099620 29538 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:43.066237 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.101168 29463 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:43.101541 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1657) took 1012 ms. Trace:
I20260709 13:12:43.066844 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.067348 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.054062 31233 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:43.055102 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.099491 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.108894 29537 raft_consensus.cc:2410] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:12:43.102478 29465 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:43.107975 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.107196 30158 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:12:43.109799 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 112200us
I20260709 13:12:43.101930 29396 rpcz_store.cc:276] 0709 13:12:42.089417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.923663 (+834246us) service_pool.cc:224] Handling call
0709 13:12:43.101329 (+177666us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b54002012d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:43.101462 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171242752}
I20260709 13:12:43.111593 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.064447 29391 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:43.109612 29360 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.118355 30159 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:12:43.120014 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.135054 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:43.138552 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:43.119444 30123 leader_election.cc:336] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.066s (SENT)
I20260709 13:12:43.139267 29392 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:12:43.142568 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.098546 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1650) took 1100 ms. Trace:
I20260709 13:12:43.113834 31344 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:43.151213 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:12:43.154125 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.152562 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:43.153031 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 166219us
I20260709 13:12:43.153424 29545 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:43.119639 31233 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:43.156560 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.153255 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.165488 29538 raft_consensus.cc:2410] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:43.165936 29539 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
W20260709 13:12:43.161329 31451 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.224s	user 0.000s	sys 0.004s
W20260709 13:12:43.168920 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.172860 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:43.173662 30158 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:43.158797 31233 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:43.160431 31424 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:43.161487 31171 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:43.176231 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.147977 29394 rpcz_store.cc:276] 0709 13:12:41.987341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.049075 (+ 61734us) service_pool.cc:224] Handling call
0709 13:12:43.087766 (+1038691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:43.167055 31339 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.181470 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.229537 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.231556 31339 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.235744 31339 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:43.236730 30151 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:43.237303 30154 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:12:43.225181 29397 raft_consensus.cc:1240] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:12:43.176393 31436 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:43.172907 29360 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:43.224859 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52243.9us
I20260709 13:12:43.237784 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:43.239537 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 115469us
I20260709 13:12:43.171675 31406 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:43.218030 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.240690 29438 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:43.249317 30154 pending_rounds.cc:85] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 2
I20260709 13:12:43.176035 31233 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:43.281030 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 116657us
I20260709 13:12:43.281960 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.282998 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.283921 29360 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.286023 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.287004 29537 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:12:43.306870 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 66278.3us
I20260709 13:12:43.308532 29543 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:12:43.308873 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:43.275677 31164 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:43.309861 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.310266 31164 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.310408 31378 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.284907 31408 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.258302 31441 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:43.311221 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:43.414286 29395 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:43.426288 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:43.361598 29388 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:43.360324 29545 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:43.378805 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.314204 29438 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:43.446928 29388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1645) took 2166 ms (client timeout 2844 ms). Trace:
W20260709 13:12:43.447489 29388 rpcz_store.cc:269] 0709 13:12:41.280793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.870650 (+1589857us) service_pool.cc:224] Handling call
0709 13:12:43.446832 (+576182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:43.449965 29395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1646) took 2089 ms (client timeout 2581 ms). Trace:
W20260709 13:12:43.453239 29395 rpcz_store.cc:269] 0709 13:12:41.360893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.633927 (+1273034us) service_pool.cc:224] Handling call
0709 13:12:43.449709 (+815782us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540012f054. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:43.449882 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547878784}
I20260709 13:12:43.455230 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:43.456153 29512 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:43.456204 29395 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.456957 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1626) took 2626 ms. Trace:
I20260709 13:12:43.458253 29539 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.459688 29537 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.460310 29390 rpcz_store.cc:276] 0709 13:12:40.830736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.948000 (+2117264us) service_pool.cc:224] Handling call
0709 13:12:42.989329 (+ 41329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:43.151806 (+162477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.151833 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:43.168324 (+ 16491us) log.cc:844] Serialized 26 byte log entry
0709 13:12:43.441561 (+273237us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:43.441609 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.441685 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:43.456707 (+ 15022us) raft_consensus.cc:1685] finished
0709 13:12:43.456728 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.456868 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7592,"raft.queue_time_us":28646,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":2930,"thread_start_us":127194,"threads_started":1,"wal-append.queue_time_us":268769}
I20260709 13:12:43.436216 29394 raft_consensus.cc:2410] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:43.462342 31103 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:43.466984 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 152947us
I20260709 13:12:43.468974 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.469883 29538 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:43.312631 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.414827 31099 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:43.369571 31329 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:43.313645 31234 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.379420 31406 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:43.472800 29360 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.411589 31450 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:43.312511 31439 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:43.442061 31161 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.477387 29544 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:43.482357 29395 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:43.486704 29393 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:12:43.466248 31436 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:43.466306 31464 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:43.272046 30154 pending_rounds.cc:107] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:12:43.494031 29546 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:12:43.490337 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 48942.9us
I20260709 13:12:43.484755 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.491302 29392 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:43.505654 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:43.471593 31455 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:43.478856 31329 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:43.506556 31456 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:12:43.484177 31450 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.509860 31250 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.475749 31099 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:43.512743 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:43.514467 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 45187.9us
I20260709 13:12:43.484079 31103 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.494150 30154 raft_consensus.cc:2917] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:12:43.410959 31171 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.516326 31378 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:43.575492 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1648) took 1855 ms. Trace:
I20260709 13:12:43.524237 29512 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:43.595518 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.596467 29539 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
W20260709 13:12:43.596459 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 72342.6us
I20260709 13:12:43.522369 31164 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:43.499066 31406 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:43.504099 31234 raft_consensus.cc:697] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:43.599449 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:43.594988 31099 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.598704 31439 raft_consensus.cc:697] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:43.602749 31439 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.605980 31269 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:43.518690 31329 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.606992 29397 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:12:43.604811 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:43.609171 31344 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:43.609690 31344 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.610128 31344 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:43.586414 29389 rpcz_store.cc:276] 0709 13:12:41.720685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.945554 (+1224869us) service_pool.cc:224] Handling call
0709 13:12:42.995161 (+ 49607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:43.014680 (+ 19519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.014723 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:43.015450 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 13:12:43.156151 (+140701us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:43.156196 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.156274 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:43.575231 (+418957us) raft_consensus.cc:1685] finished
0709 13:12:43.575254 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.575420 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24704,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":215,"thread_start_us":140161,"threads_started":1,"wal-append.queue_time_us":175351}
I20260709 13:12:43.515195 31464 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:43.614884 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.616812 31464 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:43.618813 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:43.620373 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.569058 31450 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:43.621583 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.516146 31332 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.524394 31424 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:43.522867 31137 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:43.622694 31358 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:43.626322 31358 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:43.626962 31358 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.626407 31436 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.627454 31268 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:43.628047 31268 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:43.629146 31268 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.630955 31408 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:43.618112 30154 raft_consensus.cc:2889] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.631701 31103 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:43.641202 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:43.644520 29537 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:43.504834 31161 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:43.647810 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 135194us
I20260709 13:12:43.647539 29390 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.654160 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.664184 31455 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:43.666093 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.665875 31455 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:43.669138 30123 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.507s (SENT)
I20260709 13:12:43.635624 31424 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.635455 31137 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.688063 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.621107 31269 consensus_queue.cc:1059] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:12:43.693735 29395 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:43.695878 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47249.9us
I20260709 13:12:43.704262 31376 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:43.705036 31376 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:43.705624 30154 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:43.707383 31201 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:43.648914 31408 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:12:43.717814 31358 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.647799 31332 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:43.736407 31332 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.708806 31201 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:43.713744 31233 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.706223 31376 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:43.714857 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.715274 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.717605 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:43.718847 31406 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.720028 31234 consensus_queue.cc:237] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.705978 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:43.738135 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.690403 31424 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:43.785602 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 166963us
W20260709 13:12:43.786417 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.743399 29397 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:43.795409 30123 leader_election.cc:336] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.628s (SENT)
I20260709 13:12:43.795910 30123 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:43.813568 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 107759us
I20260709 13:12:43.815886 30126 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:43.788573 29395 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:43.690164 31137 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:43.817418 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:43.816131 29537 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:43.818851 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 197889us
I20260709 13:12:43.820466 29512 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:43.821887 29388 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.738111 31201 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:43.836448 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.836748 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:43.789422 31079 raft_consensus.cc:3055] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:43.744031 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:43.839676 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44317.1us
I20260709 13:12:43.841991 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:43.845788 29469 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.822160 31453 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.821596 31436 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:43.850924 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:43.744778 31233 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:43.874373 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.843817 31099 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.036911 29539 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:44.037556 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:44.038340 29397 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:44.038945 31099 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:43.898687 31161 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:43.904701 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 88909.1us
I20260709 13:12:43.841776 31079 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:44.044215 31358 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:44.047909 29294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 283) took 3389 ms. Trace:
W20260709 13:12:44.025566 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.783262 31329 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.837205 31164 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:43.829299 31269 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:12:43.836982 31441 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:44.029479 29388 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
W20260709 13:12:44.030823 30123 leader_election.cc:336] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.692s (SENT)
I20260709 13:12:43.830103 31344 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:43.907480 31201 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.032490 29396 raft_consensus.cc:1240] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:44.041657 31079 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:43.907177 29394 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:44.050302 29539 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:44.064102 29390 raft_consensus.cc:2410] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:44.087153 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:44.087697 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:44.395164 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:44.262445 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 140188us
I20260709 13:12:44.115671 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:44.101610 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.115211 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:44.167950 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 347596us
I20260709 13:12:44.494848 29469 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
W20260709 13:12:44.492218 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.034029 31453 raft_consensus.cc:697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:44.080125 31472 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.267s	user 0.000s	sys 0.014s
W20260709 13:12:44.190388 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 101664us
I20260709 13:12:44.060429 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:44.118768 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:44.120442 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:44.249444 29397 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:44.115005 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:44.102244 29537 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:44.119750 29546 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:12:43.893162 31250 raft_consensus.cc:697] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:44.488425 29467 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:12:44.120424 29544 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:44.489020 29463 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:44.492173 30158 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:44.101438 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:44.497056 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1717) took 1081 ms. Trace:
I20260709 13:12:44.035306 31474 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:44.095556 31436 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.520958 31474 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.522753 31474 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:44.104405 31450 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.525874 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:44.527904 31453 consensus_queue.cc:237] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:44.512920 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:44.499491 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 468725us
W20260709 13:12:44.091743 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.079917 31439 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.504285 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.101023 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:12:44.187192 31337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.008s	sys 0.007s
I20260709 13:12:44.510564 29391 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:12:44.220204 31137 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.189426 31424 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.511629 29396 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:44.517808 31250 consensus_queue.cc:237] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:44.518975 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:44.520229 31344 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:44.542120 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 511008us
I20260709 13:12:44.535811 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:44.557979 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.663980 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:44.665160 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:44.669109 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.669472 29390 rpcz_store.cc:276] 0709 13:12:43.415473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.469346 (+ 53873us) service_pool.cc:224] Handling call
0709 13:12:44.481273 (+1011927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:44.050375 29294 rpcz_store.cc:276] 0709 13:12:40.658925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.659200 (+   275us) service_pool.cc:224] Handling call
0709 13:12:44.047750 (+3388550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:42.999708 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:43.004152 (+  4444us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:43.004207 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:12:43.004242 (+    35us) tablet.cc:662] Decoding operations
0709 13:12:43.017024 (+ 12782us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:43.017140 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:43.017180 (+    40us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:43.020909 (+  3729us) tablet.cc:701] Row locks acquired
0709 13:12:43.020975 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:12:43.021211 (+   236us) write_op.cc:270] Start()
0709 13:12:43.021544 (+   333us) write_op.cc:276] Timestamp: P: 1783602763021125 usec, L: 0
0709 13:12:43.021565 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:12:43.022481 (+   916us) log.cc:844] Serialized 3643 byte log entry
0709 13:12:43.452760 (+430279us) op_driver.cc:464] REPLICATION: finished
0709 13:12:43.654959 (+202199us) write_op.cc:301] APPLY: starting
0709 13:12:43.675776 (+ 20817us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:43.676076 (+   300us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:43.676225 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:43.704390 (+ 28165us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:43.704747 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:12:43.704813 (+    66us) write_op.cc:312] APPLY: finished
0709 13:12:43.705266 (+   453us) log.cc:844] Serialized 71 byte log entry
0709 13:12:43.705522 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:43.705703 (+   181us) write_op.cc:454] Released schema lock
0709 13:12:43.705807 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:43.706285 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:43.706314 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":181811,"apply.run_cpu_time_us":4706,"apply.run_wall_time_us":71335,"num_ops":9,"prepare.queue_time_us":94339,"prepare.run_cpu_time_us":81780,"prepare.run_wall_time_us":168602,"raft.queue_time_us":142152,"raft.run_cpu_time_us":47695,"raft.run_wall_time_us":67253,"replication_time_us":430936,"thread_start_us":414200,"threads_started":4,"wal-append.queue_time_us":284092}]]}
I20260709 13:12:44.554358 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:44.534529 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:44.636977 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.672478 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.490761 31273 consensus_queue.cc:1059] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:12:44.498958 31164 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.531605 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:44.533286 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:44.550019 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:44.493211 31329 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:44.695922 30158 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.586189 30160 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
W20260709 13:12:44.650825 29435 connection.cc:256] RPC call timeout handler was delayed by -1.7361890130000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 13:12:44.673422 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:44.682958 30126 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:44.695901 29397 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:44.671703 29388 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:44.697629 29435 connection.cc:256] RPC call timeout handler was delayed by -1.5111890130001484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 13:12:44.695529 29392 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:44.530928 31450 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:44.508049 31339 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.674310 31337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.010s	sys 0.015s
I20260709 13:12:44.559729 30156 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:44.644490 30154 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:44.775475 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:44.724717 29509 connection.cc:256] RPC call timeout handler was delayed by -1.6191681139998764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 13:12:44.742066 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:44.619513 31464 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:44.540166 31482 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:44.673168 31441 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:44.702633 30151 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.778841 30157 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:44.674176 30152 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:44.760041 31332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.049s	sys 0.066s
W20260709 13:12:44.782361 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 223464us
I20260709 13:12:44.788264 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:44.723654 31406 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.790900 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 108061us
I20260709 13:12:44.790330 29397 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:44.791357 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 265797us
W20260709 13:12:44.795575 30123 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.768s (SENT)
I20260709 13:12:44.796838 30123 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:44.740949 31339 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:44.706787 31439 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:44.842808 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:44.775611 31164 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.844619 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:44.797273 31441 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.845347 31464 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.846621 31406 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:44.850231 30159 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:44.853214 30158 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
W20260709 13:12:44.793913 31332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.050s	sys 0.066s
I20260709 13:12:44.854031 29438 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:44.868045 29388 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:44.873342 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:44.893973 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 151373us
W20260709 13:12:44.895880 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 221694us
W20260709 13:12:44.897229 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 96905.6us
I20260709 13:12:44.898108 30158 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:44.861205 30154 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:44.900343 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:44.903564 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 105418us
I20260709 13:12:44.913300 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:44.914777 31450 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:44.915189 31450 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.915539 31450 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:44.917938 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.918684 31337 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:44.920933 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.923609 29509 connection.cc:256] RPC call timeout handler was delayed by -1.546666162000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2937s for a response
W20260709 13:12:44.924546 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.896524 31482 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:44.930882 29463 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:44.932036 31497 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:44.932530 31497 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.932612 31103 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.932904 31497 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:44.933220 31103 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:44.933873 31406 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:44.935670 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:44.936333 29469 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:44.936797 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 142346us
I20260709 13:12:44.903079 31490 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.919621 31495 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:44.953423 30160 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:44.964300 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:44.959337 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:44.966116 30159 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:44.958397 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 60392.1us
I20260709 13:12:44.927608 31455 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:44.967339 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 171786us
W20260709 13:12:44.970935 30123 leader_election.cc:336] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.837s (SENT)
I20260709 13:12:44.931366 31233 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:44.931049 31436 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:44.976785 29469 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:44.978498 29467 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:44.971449 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:44.980461 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:45.062724 29509 connection.cc:256] RPC call timeout handler was delayed by -1.48140995499989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 13:12:44.939818 31476 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:12:45.076385 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 117179us
W20260709 13:12:45.077033 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 108997us
I20260709 13:12:45.087193 30157 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:45.094782 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.982647 31233 raft_consensus.cc:697] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:45.008342 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52003us
I20260709 13:12:45.029584 31103 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:45.113169 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:45.113238 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:45.114071 29467 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:45.109246 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4473526199999469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:12:45.091666 31474 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.002s
W20260709 13:12:45.116842 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3867447620000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29500000000000004s for a response
I20260709 13:12:45.021654 31498 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:45.028559 31439 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.028600 30156 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:45.087939 31137 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:45.029500 31344 consensus_queue.cc:1059] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:12:45.106889 29512 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:45.137053 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 443) took 1326 ms. Trace:
I20260709 13:12:45.149369 30156 rpcz_store.cc:276] 0709 13:12:43.810656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.829082 (+ 18426us) service_pool.cc:224] Handling call
0709 13:12:45.136950 (+1307868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:45.137575 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:45.027693 31455 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:12:44.954725 31490 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:45.030154 31376 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:12:44.978926 31482 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
W20260709 13:12:45.160951 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3186526199999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:12:45.165767 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 59091.1us
I20260709 13:12:45.137562 31233 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.166935 29512 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:45.146914 31441 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:45.168015 31441 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.173730 31164 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.164166 31498 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:45.175362 31496 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:12:45.175002 31498 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.177673 31498 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:45.183271 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 215821us
W20260709 13:12:45.164837 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2930503039999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:12:45.186424 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.186806 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0778859079998711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:12:45.187146 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0140503039999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 13:12:45.147747 31339 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.147261 31504 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.154230 31439 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:45.192627 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0014503039999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:12:45.132089 31171 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:12:45.165525 31464 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.145717 31474 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.162784 31499 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:45.211083 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.185798 31475 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:45.189211 31137 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:45.221860 31490 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.201468 31103 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:45.194329 31495 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:45.239780 31171 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:45.240242 31171 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:45.241117 31171 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.242630 31506 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.226910 31137 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:45.243592 31506 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.242380 31171 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:45.244096 31137 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:45.245913 29467 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:12:45.249156 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.249735 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.250587 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:45.251852 31499 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:45.252939 31499 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:45.254020 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:45.215838 31475 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:12:45.318070 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 82966.3us
W20260709 13:12:45.277055 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 78334.6us
I20260709 13:12:45.233173 31476 consensus_queue.cc:1059] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:12:45.338922 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:45.339670 29390 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:45.318686 30126 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:45.270608 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.317620 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93705.2us
I20260709 13:12:45.323370 31516 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:45.324501 31424 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:45.324599 31495 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:45.331591 30160 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:12:45.341993 31516 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.344508 31079 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:45.345218 29388 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:45.345577 29389 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:45.332387 31511 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:45.347007 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:45.347703 29397 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
W20260709 13:12:45.348630 31507 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.318s	user 0.016s	sys 0.016s
I20260709 13:12:45.350178 31464 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:45.350795 31464 raft_consensus.cc:697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:45.351872 31464 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.352406 29360 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:45.359265 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1715) took 1988 ms. Trace:
I20260709 13:12:45.359781 29391 rpcz_store.cc:276] 0709 13:12:43.370970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.412139 (+ 41169us) service_pool.cc:224] Handling call
0709 13:12:43.435655 (+ 23516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.674628 (+1238973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.358915 (+684287us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000a69d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:45.359178 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470615808}
W20260709 13:12:45.362360 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44390.4us
I20260709 13:12:45.225716 31103 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.203971 31504 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:45.336685 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.378883 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.385842 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.388826 29396 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:12:45.388810 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 417880us
I20260709 13:12:45.391996 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:45.392892 29391 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:45.393124 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 139190us
I20260709 13:12:45.394184 29363 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:45.389961 30123 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.902s (SENT) [suppressed 31 similar messages]
W20260709 13:12:45.398646 30123 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.987s (SENT)
I20260709 13:12:45.404392 30123 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:45.384372 31233 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:45.390511 29394 consensus_meta.cc:287] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.006s
I20260709 13:12:45.385095 31103 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:45.419711 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 72287.7us
I20260709 13:12:45.423983 29390 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:45.428763 31515 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:45.434899 31499 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:45.428969 29394 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:45.429941 31482 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:45.435838 29394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1721) took 1926 ms (client timeout 2085 ms). Trace:
I20260709 13:12:45.436131 31482 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:45.436564 31482 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:45.436299 29394 rpcz_store.cc:269] 0709 13:12:43.509574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.566971 (+ 57397us) service_pool.cc:224] Handling call
0709 13:12:43.743813 (+176842us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:12:45.435762 (+1691949us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755328}
I20260709 13:12:45.431901 31498 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:12:45.440080 31486 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.168s	user 0.000s	sys 0.005s
I20260709 13:12:45.433228 29509 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:45.434396 29363 leader_election.cc:400] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:45.443061 29363 leader_election.cc:403] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:45.423208 31450 consensus_meta.cc:287] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.004s
I20260709 13:12:45.427739 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:45.434923 31233 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:45.471472 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.472705 29537 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:12:45.281517 31376 consensus_queue.cc:1175] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 3 index: 6 } }
W20260709 13:12:45.475198 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 76600.4us
W20260709 13:12:45.492404 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.009s (SENT)
I20260709 13:12:45.492884 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:45.445866 31497 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:12:45.487468 29542 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:45.487792 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.487423 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.496862 29546 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:45.446868 31358 raft_consensus.cc:2764] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:12:45.493537 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.506606 29545 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:45.453971 31450 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.453286 31499 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
W20260709 13:12:45.542315 29509 leader_election.cc:336] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.527s (SENT)
W20260709 13:12:45.537901 30154 consensus_meta.cc:287] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.005s
W20260709 13:12:45.558254 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.557974 31518 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:45.561146 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:45.561882 30156 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:12:45.562038 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:45.562992 31475 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:45.563931 30160 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:45.564361 31475 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:45.568487 31378 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:45.568905 31378 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:45.569090 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.569958 29541 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:12:45.571638 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.572403 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.573159 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 122452us
I20260709 13:12:45.574427 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:45.577731 29467 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:45.577926 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:45.578403 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:45.578785 29469 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:45.580055 31233 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.540623 31474 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:45.569794 31378 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.601398 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:45.602110 30160 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:45.581386 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:45.599685 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 107297us
I20260709 13:12:45.503638 31339 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:12:45.610682 29464 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:45.581614 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:45.503928 31497 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.606689 30156 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:45.618569 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 76340.7us
I20260709 13:12:45.581517 31506 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:45.599901 31450 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:45.624956 30123 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.202s (SENT)
W20260709 13:12:45.627408 30123 leader_election.cc:336] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.245s (SENT)
I20260709 13:12:45.628283 30123 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:45.571786 30154 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:12:45.634069 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.635778 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:45.635651 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:45.619724 30151 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.004s
I20260709 13:12:45.633230 31436 raft_consensus.cc:2764] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:12:45.645871 29360 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:45.647112 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:45.615187 31358 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.650705 31497 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:45.652637 31523 log.cc:927] Time spent T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:12:45.631960 30152 consensus_meta.cc:287] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.747s	user 0.013s	sys 0.003s
W20260709 13:12:45.664649 29509 leader_election.cc:336] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.640s (SENT)
I20260709 13:12:45.644556 31103 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:45.665843 31515 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:45.640930 31378 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:45.690775 29363 leader_election.cc:400] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3.
I20260709 13:12:45.691146 29363 leader_election.cc:403] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:12:45.693737 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:45.640570 31164 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:45.678364 31528 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:45.695187 31164 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.679489 31439 raft_consensus.cc:3055] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:45.679986 31103 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:45.680415 29509 leader_election.cc:336] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.735s (SENT)
I20260709 13:12:45.696442 31439 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:45.696748 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:45.697638 31164 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.697481 31439 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:45.698146 29509 leader_election.cc:336] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.755s (SENT)
I20260709 13:12:45.698410 31515 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:45.698846 31439 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:45.699959 31358 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:45.700544 31358 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:45.700838 31344 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:45.641108 30151 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:45.701574 31358 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:45.702303 30151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 444) took 1888 ms (client timeout 1910 ms). Trace:
I20260709 13:12:45.698863 31515 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:45.702783 30151 rpcz_store.cc:269] 0709 13:12:43.813684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.828925 (+ 15241us) service_pool.cc:224] Handling call
0709 13:12:44.100832 (+271907us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:12:45.702212 (+1601380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65742208}
I20260709 13:12:45.664222 30152 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:45.703574 31515 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.704452 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 447) took 1196 ms. Trace:
I20260709 13:12:45.704902 30152 rpcz_store.cc:276] 0709 13:12:44.513508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.518678 (+  5170us) service_pool.cc:224] Handling call
0709 13:12:45.704370 (+1185692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:45.706131 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:45.707309 31464 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:45.700181 29509 leader_election.cc:336] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.809s (SENT)
W20260709 13:12:45.708729 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4465244089999487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:12:45.684741 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.709712 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.710949 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:45.713088 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:45.714669 31339 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3.
I20260709 13:12:45.715520 31482 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:45.704908 31515 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:45.731115 31406 raft_consensus.cc:1064] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:12:45.731621 31406 raft_consensus.cc:1068] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:45.717494 29543 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:12:45.717787 31489 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.958s	user 0.002s	sys 0.001s
I20260709 13:12:45.715593 31339 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.719199 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:45.719919 31488 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.849s	user 0.001s	sys 0.000s
I20260709 13:12:45.714357 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:45.720638 29545 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:12:45.721590 29509 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.964s (SENT)
I20260709 13:12:45.721649 29541 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:45.724829 30160 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:45.728856 31516 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.741392 31526 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:45.743005 29546 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:45.750036 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:45.751523 31525 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.754235 29544 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:45.755108 29542 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:45.756433 29363 leader_election.cc:400] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:45.757472 29438 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:45.765820 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44262.4us
I20260709 13:12:45.765676 31454 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:45.766753 29509 leader_election.cc:336] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.978s (SENT)
I20260709 13:12:45.767210 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:45.768500 29509 leader_election.cc:336] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.993s (SENT)
I20260709 13:12:45.775743 31103 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:45.780258 31482 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:45.780368 31492 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:12:45.784813 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.784983 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:45.785710 29539 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:45.789747 31201 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:45.795559 31233 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.747390 31476 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:12:45.797641 31358 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.798955 31358 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.799561 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.800333 29538 raft_consensus.cc:2368] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4.
I20260709 13:12:45.801249 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:45.770421 31234 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:45.802956 31234 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.803457 31234 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:45.804207 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1732) took 1211 ms. Trace:
I20260709 13:12:45.762535 31526 raft_consensus.cc:697] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:45.809311 29542 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:45.809440 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:45.810662 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.811982 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4103081410000868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25179999999999997s for a response
I20260709 13:12:45.811992 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:45.804728 29393 rpcz_store.cc:276] 0709 13:12:44.592398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.592574 (+   176us) service_pool.cc:224] Handling call
0709 13:12:44.659164 (+ 66590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:44.873782 (+214618us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:45.149616 (+275834us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.451191 (+301575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:45.451281 (+    90us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:45.451347 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.803873 (+352526us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001725d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:45.803949 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.804122 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7080,"prepare.queue_time_us":368924,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":27541,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":6156,"spinlock_wait_cycles":327349632,"thread_start_us":515700,"threads_started":2,"wal-append.queue_time_us":403001}
W20260709 13:12:45.812628 29509 connection.cc:256] RPC call timeout handler was delayed by -1.379924408999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 13:12:45.818809 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 113504us
I20260709 13:12:45.822331 29360 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:45.823241 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:45.815282 31453 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.829685 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:45.826220 31233 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:45.866808 31525 raft_consensus.cc:2764] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:12:45.867053 31233 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:45.868284 31233 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:45.869268 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 59910.7us
I20260709 13:12:45.871587 30151 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:45.824760 31482 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:45.827457 31339 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:45.888512 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 58873.2us
I20260709 13:12:45.889607 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:45.829294 31439 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.894946 29542 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:45.895228 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:45.882579 31358 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:45.836231 31453 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:45.866885 31514 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 13:12:45.964026 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 66595.1us
W20260709 13:12:45.983240 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 93760.5us
I20260709 13:12:45.931421 31339 raft_consensus.cc:697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:45.891553 31499 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:12:45.809388 31526 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:45.990252 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.983963 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:45.986469 29545 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:45.978062 31525 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.996942 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:46.011742 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:46.013033 29509 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:46.014106 31344 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.016312 31492 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:46.018519 31137 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:46.019429 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.025203 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 143123us
I20260709 13:12:46.026099 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:46.015177 31171 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:46.022707 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.024011 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.031795 29469 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.021026 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.023054 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.032882 29464 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:45.991182 31454 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.057232 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.057993 29468 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:46.055492 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 70801.8us
I20260709 13:12:46.060750 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:46.060906 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:46.061556 30160 raft_consensus.cc:2376] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2. Re-sending same reply.
I20260709 13:12:46.024370 31079 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:46.073953 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:46.064303 31527 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:12:46.071197 31504 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:46.020517 31339 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:46.081020 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 55000.3us
W20260709 13:12:46.082876 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 69926.8us
I20260709 13:12:46.086004 29469 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:46.067268 31490 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.102087 31515 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.102355 31542 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:46.102726 31515 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.099413 31344 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:46.107107 31344 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.114080 31273 consensus_queue.cc:1059] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:12:46.115113 31510 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:46.117910 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44053.6us
I20260709 13:12:46.083669 31454 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:46.078038 31234 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:46.083910 31406 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:46.085574 31500 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:46.144274 31541 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:12:46.146008 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.149493 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.150336 31482 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:46.152719 31484 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 1.118s	user 0.003s	sys 0.014s
I20260709 13:12:46.152571 31079 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:46.120229 31527 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:46.161758 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:46.162696 29538 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:46.134174 31453 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:46.137879 31510 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:46.135174 31378 consensus_queue.cc:1059] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:12:46.163671 31510 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:46.138638 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 109584us
I20260709 13:12:46.136523 31547 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:46.141522 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:46.087446 31358 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.161895 31454 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:46.167196 29512 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:46.139187 31518 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:46.168406 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.177349 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.174880 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.178977 29469 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:46.179970 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:46.182613 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 86480.6us
I20260709 13:12:46.183553 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:46.199111 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 98499.3us
I20260709 13:12:46.123623 31490 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:46.212245 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 70879.8us
I20260709 13:12:46.215730 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:46.185374 31518 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.219602 29470 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:46.224474 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.224908 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.246066 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:46.206286 31504 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:46.248021 30126 leader_election.cc:400] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4.
I20260709 13:12:46.252343 30126 leader_election.cc:403] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.248003 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:46.203097 31482 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:46.250893 30159 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:46.255254 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:46.229435 31495 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.266506 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.266985 31482 raft_consensus.cc:697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:46.267756 29467 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:46.268110 31482 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:46.270452 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.270658 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.164678 31510 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.252094 31504 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.233469 31464 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:12:46.306943 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.306926 29435 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:46.261010 31164 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4.
I20260709 13:12:46.317658 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.291471 31273 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:12:46.308034 31358 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:46.319439 31234 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:46.323990 31519 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.753s	user 0.000s	sys 0.002s
I20260709 13:12:46.254796 31514 consensus_queue.cc:1059] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:12:46.329895 31490 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:46.304088 31492 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:46.333380 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.346499 31358 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.347463 31508 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:46.344077 31464 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:12:46.349695 31273 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:46.351770 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.352722 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.353302 31514 raft_consensus.cc:3055] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:46.353592 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.353680 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.402786 29466 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:46.353957 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:46.354893 31544 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:12:46.319607 31543 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:12:46.408154 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.355724 31450 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:46.356813 31551 log.cc:927] Time spent T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:12:46.312917 31504 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.357724 31505 raft_consensus.cc:3055] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:46.420696 29469 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:46.420075 29545 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:46.372689 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:46.376754 29464 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:46.421667 29544 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:46.334560 31475 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.400931 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:46.375506 31527 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:46.418462 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.314054 31495 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.319512 31546 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.492468 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:46.493232 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67727.7us
I20260709 13:12:46.422609 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:46.399392 31273 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:46.402052 31514 raft_consensus.cc:740] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:46.519378 31538 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:12:46.367503 29509 leader_election.cc:336] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.545s (SENT)
W20260709 13:12:46.527495 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 220692us
W20260709 13:12:46.420575 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 253447us
I20260709 13:12:46.416782 31450 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:46.544087 30158 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:12:46.522836 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.548327 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:46.538763 31475 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:46.549027 31527 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:46.603065 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.566550 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.602849 31492 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:46.604197 31450 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:46.604728 31555 log.cc:927] Time spent T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 13:12:46.627771 31562 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:46.545223 31546 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:46.424787 31406 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:46.664413 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.425163 31505 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:46.687783 31475 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:46.686939 31505 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.689283 31505 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.628007 29435 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:46.700580 29544 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:12:46.703907 29472 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:12:46.706401 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.738134 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 370642us
W20260709 13:12:46.741576 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 73451.3us
I20260709 13:12:46.715456 31450 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.722972 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 457) took 1542 ms. Trace:
I20260709 13:12:46.751973 31455 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:46.776335 31455 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:46.776895 31455 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.777526 31527 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:46.708658 31269 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:46.737051 31273 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.755803 31453 raft_consensus.cc:3055] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:46.779721 31453 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:46.756172 31518 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.002s
W20260709 13:12:46.762580 31557 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:12:46.763994 29466 raft_consensus.cc:3055] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:46.768256 31546 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.788257 29466 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:46.747509 31526 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:46.717490 31406 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:46.746933 31528 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:46.781153 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:46.773941 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 225256us
I20260709 13:12:46.830243 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:46.750530 31482 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.832206 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:46.806674 31514 consensus_queue.cc:260] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:46.810150 31515 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:46.810518 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67864.9us
I20260709 13:12:46.825805 29463 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:46.831192 31552 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.843763 31552 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.836784 31508 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:46.793486 31518 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.837361 31566 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:46.837881 31171 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:46.825870 31453 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.839268 31514 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.850750 31453 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.774909 30153 rpcz_store.cc:276] 0709 13:12:45.180834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.181026 (+   192us) service_pool.cc:224] Handling call
0709 13:12:45.181486 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.181943 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.181978 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.182631 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.449991 (+267360us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:45.475663 (+ 25672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.475779 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.323325 (+847546us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:12:46.527536 (+204211us) raft_consensus.cc:1685] finished
0709 13:12:46.538667 (+ 11131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.706494 (+167827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8868,"raft.queue_time_us":5454,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9107,"spinlock_wait_cycles":6295808,"thread_start_us":238868,"threads_started":1,"wal-append.queue_time_us":310535}
I20260709 13:12:46.857879 31273 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.829685 31526 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:46.859170 31552 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:46.862673 31528 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.834239 29466 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:46.868098 29466 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.841024 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:46.847465 31566 raft_consensus.cc:697] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:46.839896 31476 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:46.860704 31526 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:46.861335 31510 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:46.839668 29472 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:12:46.884075 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 144943us
W20260709 13:12:46.888759 29509 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.752s (SENT)
I20260709 13:12:46.889340 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:46.870357 29360 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:46.901934 31441 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:46.902650 31441 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:46.904047 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.903844 31441 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:46.904567 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.905215 31441 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:46.912603 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1678) took 1980 ms. Trace:
I20260709 13:12:46.892681 31406 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:46.913208 29470 rpcz_store.cc:276] 0709 13:12:44.940050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.940662 (+   612us) service_pool.cc:224] Handling call
0709 13:12:44.967888 (+ 27226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:46.229092 (+1261204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.912204 (+683112us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400412b54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:46.912488 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2847631744}
W20260709 13:12:46.933319 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44605.8us
I20260709 13:12:46.932009 31344 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.939350 31518 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:46.941934 29509 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.095s (SENT)
I20260709 13:12:46.891757 31526 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:46.942617 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:46.944290 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.878247 31482 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:46.959399 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 118449us
I20260709 13:12:46.931437 31439 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:46.960441 29435 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:46.978845 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:46.983536 29465 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:12:46.987524 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52767.4us
I20260709 13:12:46.958680 31476 consensus_queue.cc:1243] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer 88760af579b54a6393c6251aa3c6b870 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:46.958995 31526 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:46.969244 31358 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:46.969417 31137 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:46.978293 31454 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:46.984983 31518 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.023229 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:47.018061 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:47.018414 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:47.025992 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:46.992072 31511 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:46.994861 30151 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:47.035404 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:47.039211 29537 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:46.981631 31269 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:12:47.044868 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:47.037742 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 50089.8us
I20260709 13:12:46.973120 31439 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.042363 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:47.007217 31137 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.981446 31552 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:47.010210 31454 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.986819 31475 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:12:47.077827 29546 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:12:47.071429 29540 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:47.062405 29509 leader_election.cc:336] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.145s (SENT)
I20260709 13:12:47.090245 29509 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:47.093577 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51327.5us
I20260709 13:12:46.985169 31566 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:47.022639 31103 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:12:47.035293 31476 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:12:47.087209 31454 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.115053 29466 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:47.036420 31518 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.098217 31515 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:47.120616 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58272.1us
W20260709 13:12:47.122993 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.142385 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.103615 31500 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.125468 29390 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:47.109951 31474 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:47.191152 30156 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:12:47.191640 30156 pending_rounds.cc:85] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 6
I20260709 13:12:47.191941 30156 pending_rounds.cc:107] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:12:47.192181 30156 raft_consensus.cc:2889] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:47.166327 31571 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:12:47.165453 31273 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.190310 31492 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.188467 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:47.287762 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.301620 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:47.302938 30151 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:12:47.304350 31573 log.cc:927] Time spent T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:12:47.305850 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1744) took 1146 ms. Trace:
W20260709 13:12:47.306047 31580 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
W20260709 13:12:47.307077 31579 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:12:47.306270 29541 rpcz_store.cc:276] 0709 13:12:46.159529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.165186 (+  5657us) service_pool.cc:224] Handling call
0709 13:12:46.169735 (+  4549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.706010 (+536275us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b1800354760. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61e8999060 00007f61e8999bfb 00007f61e89a464b
0709 13:12:46.729460 (+ 23450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.729496 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.743814 (+ 14318us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.968297 (+224483us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:46.968354 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.968498 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.305478 (+336980us) raft_consensus.cc:1685] finished
0709 13:12:47.305504 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.305763 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115601,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":9950,"spinlock_wait_cycles":25948416,"thread_start_us":340542,"threads_started":2,"wal-append.queue_time_us":325668}
W20260709 13:12:47.308251 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.308771 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.309365 30151 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:47.313020 30151 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:12:47.314404 30151 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:47.228174 31582 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:12:47.227272 31581 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:12:47.314414 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 631) took 1971 ms. Trace:
W20260709 13:12:47.323179 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.292192 31588 raft_consensus.cc:1064] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:47.367823 30158 rpcz_store.cc:276] 0709 13:12:45.342908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.385091 (+ 42183us) service_pool.cc:224] Handling call
0709 13:12:46.543697 (+1158606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.651709 (+108012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.314182 (+662473us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540025b550. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:47.314343 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636910336}
I20260709 13:12:47.362149 31515 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.374294 31515 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.376786 31515 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:47.378988 31576 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 13:12:47.379218 30151 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:47.361606 31358 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.379689 31592 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.380036 31358 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.380403 31592 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.381927 31137 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.388000 29397 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:47.391695 30158 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.395845 31495 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:47.239041 31511 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:47.396520 31518 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.191552 31500 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.402010 31584 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:47.403008 31584 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.362897 31482 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.111063 31526 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:47.407538 31588 raft_consensus.cc:1068] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:12:47.402093 31583 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:12:47.414311 31453 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.006s
I20260709 13:12:47.414767 31592 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:47.415997 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:47.413542 31450 consensus_meta.cc:287] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.003s
I20260709 13:12:47.416570 31511 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.406258 31584 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.383644 31561 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.382417 31358 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:47.292516 31273 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:47.438462 29363 connection.cc:256] RPC call timeout handler was delayed by -2.1772354379997978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 13:12:47.446858 30158 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:12:47.447364 30158 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 4
I20260709 13:12:47.447664 30158 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:12:47.447999 30158 raft_consensus.cc:2917] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 13:12:47.448485 30158 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:47.449997 31584 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.455027 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 406) took 1087 ms. Trace:
W20260709 13:12:47.457607 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.322799 31492 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.461975 29543 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:12:47.462527 29543 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 4
I20260709 13:12:47.455590 30160 rpcz_store.cc:276] 0709 13:12:46.367289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.369248 (+  1959us) service_pool.cc:224] Handling call
0709 13:12:46.369625 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.369996 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.370022 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.370505 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.735946 (+365441us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:46.736009 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.736215 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.454736 (+718521us) raft_consensus.cc:1685] finished
0709 13:12:47.454763 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.454943 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1044,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":23285,"thread_start_us":364970,"threads_started":1,"wal-append.queue_time_us":417955}
I20260709 13:12:47.462814 29543 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:12:47.463245 29543 raft_consensus.cc:2917] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 13:12:47.463948 29543 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:47.464779 31455 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.005s
I20260709 13:12:47.429510 31561 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.465301 31455 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.467489 31455 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.468355 29468 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:47.467483 31561 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:47.470813 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.420398 31439 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:47.483990 31492 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:47.491290 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 403042us
W20260709 13:12:47.486953 29363 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:47726 dropped due to backpressure: service queue is full with 50 items
I20260709 13:12:47.439038 31450 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:47.486332 31559 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.886s	user 0.004s	sys 0.012s
I20260709 13:12:47.487190 31273 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:47.494660 31561 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:47.575261 31510 consensus_meta.cc:287] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.629s	user 0.004s	sys 0.008s
W20260709 13:12:47.694621 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 202344us
W20260709 13:12:47.618646 31406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.022s	sys 0.025s
W20260709 13:12:47.696283 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.679826 31515 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.728801 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:47.729667 29390 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:47.725155 29467 raft_consensus.cc:2410] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:47.576668 31492 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.457209 31584 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.744841 30158 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:47.680929 31591 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:47.723443 31406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.022s	sys 0.026s
I20260709 13:12:47.632747 31450 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.765100 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:47.764674 29397 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:47.776618 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.777262 30160 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:47.748023 31482 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:47.786319 31606 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
I20260709 13:12:47.735623 31515 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.793699 30152 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:47.795147 31515 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:47.734335 31561 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.797364 31561 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:47.797760 31504 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.278s	user 0.011s	sys 0.005s
I20260709 13:12:47.763125 31591 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:47.810685 29390 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:12:47.492504 29363 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:47726 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1670)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 242)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 243)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1753)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1669)
W20260709 13:12:47.798828 31441 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.893s	user 0.015s	sys 0.001s
I20260709 13:12:47.752512 31492 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.815536 31600 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.816394 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:47.818648 31578 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:12:47.820775 31234 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:47.820880 29465 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:47.826570 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:47.834187 29390 raft_consensus.cc:2368] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
W20260709 13:12:47.835953 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.838912 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.791049 31482 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.830623 31171 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.829253 31137 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:47.833636 31234 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:47.854125 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:47.813659 31504 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.865849 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:47.845340 31611 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:47.833238 31600 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.854306 31406 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:12:47.866053 31454 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.004s
I20260709 13:12:47.878677 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:47.879598 31492 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:47.880059 31595 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:12:47.883185 31591 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.884173 31584 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.876225 31611 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:47.873369 31570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.026s	sys 0.035s
W20260709 13:12:47.886729 31570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.027s	sys 0.035s
I20260709 13:12:47.887866 31603 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:47.888671 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:47.888468 31603 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.889266 31611 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.855764 31171 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.889323 31600 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.890691 31234 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.892640 31234 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.893842 31504 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:47.904670 31500 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:47.907244 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.908408 31454 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:47.911736 31454 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.912529 29471 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:47.914312 29472 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:12:47.917243 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.918124 31441 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.918695 31441 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.918936 31563 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:47.920275 31594 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.920948 31441 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.920835 31594 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.924535 31594 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:47.926466 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.927316 29395 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:47.928260 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.928954 29395 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:47.929656 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.930473 31602 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:47.921507 31441 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.931525 31441 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.933846 31441 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:47.906033 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.936591 29389 raft_consensus.cc:2410] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:47.937567 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.937924 29391 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:12:47.939714 31527 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.940325 31527 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:47.943601 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:47.945178 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.947373 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.948096 29389 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:47.930796 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:47.960031 29395 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:47.946584 31171 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:47.995690 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:48.026770 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 191504us
I20260709 13:12:48.024479 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.025833 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.027742 29391 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:48.029137 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.034353 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.037020 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.027630 29360 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:48.040704 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.041535 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.042174 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.044129 29391 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:48.044992 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.046483 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.047920 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.048753 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.040355 31233 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:48.051100 31233 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.051669 31233 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:48.047777 31378 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.054965 31378 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:48.057477 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.058912 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:48.059350 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.060598 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.061717 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.059478 29464 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:48.063032 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.065055 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.066318 29391 raft_consensus.cc:2410] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:48.068161 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:48.070281 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.084031 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.085186 29463 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:48.048034 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:48.140336 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:48.252540 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 179021us
I20260709 13:12:48.632058 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 239) took 1156 ms. Trace:
W20260709 13:12:48.632701 29465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.116s	sys 0.231s
W20260709 13:12:48.633260 29465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.116s	sys 0.231s
I20260709 13:12:48.377523 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:48.514631 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.416143 29464 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
W20260709 13:12:48.253063 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.636580 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.637493 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.177443 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.047786 31527 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:48.651809 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.249989 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:48.286720 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.632649 29391 rpcz_store.cc:276] 0709 13:12:47.475356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.139719 (+664363us) service_pool.cc:224] Handling call
0709 13:12:48.631976 (+492257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.660760 30160 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:12:48.660985 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 227) took 1188 ms. Trace:
I20260709 13:12:48.661573 29389 rpcz_store.cc:276] 0709 13:12:47.472185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.068060 (+595875us) service_pool.cc:224] Handling call
0709 13:12:48.660903 (+592843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.661033 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.661953 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.284739 31591 raft_consensus.cc:1064] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:12:48.287874 31614 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
W20260709 13:12:48.406246 31619 log.cc:927] Time spent T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:12:48.253172 31441 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.251955 31615 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.287153 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:48.249363 31566 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:48.639402 31504 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:48.685395 31566 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:48.699337 31566 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:48.361797 31171 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.677321 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:48.700562 29294 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:48.702129 31526 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:48.677786 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1749) took 1384 ms. Trace:
I20260709 13:12:48.703413 29294 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 3 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:48.704365 29388 rpcz_store.cc:276] 0709 13:12:47.293308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.293474 (+   166us) service_pool.cc:224] Handling call
0709 13:12:48.677034 (+1383560us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:48.677265 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.677451 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.677479 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:48.677520 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:48.677548 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.677603 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.677720 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105036672}
W20260709 13:12:48.692544 29467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1563) took 2422 ms (client timeout 3050 ms). Trace:
I20260709 13:12:48.670240 31615 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:48.678637 31441 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:48.680907 31378 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:48.672401 31234 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.779s	user 0.010s	sys 0.010s
W20260709 13:12:48.682598 30123 connection.cc:256] RPC call timeout handler was delayed by -1.497034450000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:12:48.713737 30123 connection.cc:256] RPC call timeout handler was delayed by -1.3611344500000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 13:12:48.714264 30123 connection.cc:256] RPC call timeout handler was delayed by -1.3035344500001429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:12:48.714644 30123 connection.cc:256] RPC call timeout handler was delayed by -1.2684344500000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 13:12:48.688475 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 409) took 1619 ms. Trace:
I20260709 13:12:48.715175 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.715399 30156 rpcz_store.cc:276] 0709 13:12:47.068784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.069179 (+   395us) service_pool.cc:224] Handling call
0709 13:12:47.080905 (+ 11726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.192678 (+111773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.688110 (+1495432us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400690354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:48.688385 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252545408}
I20260709 13:12:48.689806 29393 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:48.717144 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1740) took 1604 ms. Trace:
I20260709 13:12:48.717517 29393 rpcz_store.cc:276] 0709 13:12:47.112625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.112821 (+   196us) service_pool.cc:224] Handling call
0709 13:12:48.689255 (+1576434us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:48.689550 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.716870 (+ 27320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.717083 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11063552}
I20260709 13:12:48.718655 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.719344 29393 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:48.692469 29394 consensus_meta.cc:287] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.002s
I20260709 13:12:48.695248 31450 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:48.706610 29294 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 5, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 5 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.673305 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.724363 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1667) took 1246 ms. Trace:
I20260709 13:12:48.710664 30152 raft_consensus.cc:2410] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:12:48.682511 31591 raft_consensus.cc:1068] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:12:48.705659 29467 rpcz_store.cc:269] 0709 13:12:46.269743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.270083 (+   340us) service_pool.cc:224] Handling call
0709 13:12:48.692228 (+2422145us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400215554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:48.692427 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3265727744}
I20260709 13:12:48.720314 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.724375 29389 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:48.730054 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1666) took 1252 ms. Trace:
I20260709 13:12:48.730545 29389 rpcz_store.cc:276] 0709 13:12:47.478022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.662280 (+1184258us) service_pool.cc:224] Handling call
0709 13:12:48.729969 (+ 67689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.724833 29393 rpcz_store.cc:276] 0709 13:12:47.478244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.718356 (+1240112us) service_pool.cc:224] Handling call
0709 13:12:48.724298 (+  5942us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.726311 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:48.724746 29391 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:48.685664 31504 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:48.383260 31600 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.724851 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.727353 29294 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 3 to 4, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 4 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.703118 31528 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:48.732120 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:48.730376 30126 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.014s	sys 0.013s
W20260709 13:12:48.736304 30126 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.014s	sys 0.013s
W20260709 13:12:48.737233 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.733947 29294 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:12:48.711309 30151 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:48.734584 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.739918 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 224) took 1269 ms. Trace:
W20260709 13:12:48.740399 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 661541us
I20260709 13:12:48.741462 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:48.748297 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.749058 29389 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
W20260709 13:12:48.749393 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.889s (SENT)
I20260709 13:12:48.749650 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 235) took 1275 ms. Trace:
I20260709 13:12:48.749892 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:48.750065 29389 rpcz_store.cc:276] 0709 13:12:47.474273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.731405 (+1257132us) service_pool.cc:224] Handling call
0709 13:12:48.749572 (+ 18167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:48.751151 30126 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.020s (SENT)
I20260709 13:12:48.748205 29393 rpcz_store.cc:276] 0709 13:12:47.471340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.731861 (+1260521us) service_pool.cc:224] Handling call
0709 13:12:48.739865 (+  8004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.724031 29394 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:48.710853 31171 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:48.752554 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:48.791922 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1668) took 1313 ms. Trace:
I20260709 13:12:48.792411 29393 rpcz_store.cc:276] 0709 13:12:47.482288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.752149 (+1269861us) service_pool.cc:224] Handling call
0709 13:12:48.791831 (+ 39682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.726979 31358 consensus_queue.cc:1059] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:12:48.801095 29470 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:12:48.801626 29470 pending_rounds.cc:85] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 5
I20260709 13:12:48.801930 29470 pending_rounds.cc:107] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:12:48.802218 29470 raft_consensus.cc:2889] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:48.803704 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.742856 31528 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:48.810094 29363 connection.cc:256] RPC call timeout handler was delayed by -1.0881736930000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:12:48.810544 29363 connection.cc:256] RPC call timeout handler was delayed by -1.0881736930000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:12:48.810914 29363 connection.cc:256] RPC call timeout handler was delayed by -1.0629736930000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:12:48.812749 29363 connection.cc:256] RPC call timeout handler was delayed by -1.0629736930000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:12:48.813184 29363 connection.cc:256] RPC call timeout handler was delayed by -1.0089736929999162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:12:48.739732 31600 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:48.833132 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 225) took 1361 ms. Trace:
I20260709 13:12:48.753822 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.754585 29294 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:12:48.834722 29467 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:48.811273 31597 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:48.789582 29472 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:48.793592 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:48.753258 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.796634 31627 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:48.849998 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:48.807134 30123 connection.cc:256] RPC call timeout handler was delayed by -1.1673282159999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 13:12:48.851373 30123 connection.cc:256] RPC call timeout handler was delayed by -1.1340282159999333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:12:48.808763 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.834939 29294 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 4, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 4 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:48.851805 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 190933us
I20260709 13:12:48.836536 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1694) took 2143 ms. Trace:
I20260709 13:12:48.732702 31591 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.833630 29389 rpcz_store.cc:276] 0709 13:12:47.471657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.750828 (+1279171us) service_pool.cc:224] Handling call
0709 13:12:48.833048 (+ 82220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:48.800392 29394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 218) took 1336 ms (client timeout 1692 ms). Trace:
I20260709 13:12:48.842060 29395 raft_consensus.cc:2376] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4. Re-sending same reply.
W20260709 13:12:48.816852 31620 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:12:48.851194 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:48.930948 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 79831.2us
W20260709 13:12:48.808013 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 71979.5us
I20260709 13:12:48.753827 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.857406 29468 rpcz_store.cc:276] 0709 13:12:46.693186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.850933 (+157747us) service_pool.cc:224] Handling call
0709 13:12:46.851263 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.468762 (+617499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.836263 (+1367501us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54002c5954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:48.836461 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418692352}
W20260709 13:12:48.852943 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.851830 30123 connection.cc:256] RPC call timeout handler was delayed by -1.128934450000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:12:48.937546 30123 connection.cc:256] RPC call timeout handler was delayed by -1.0570533009997689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 13:12:48.852555 29393 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:48.939705 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.811198 31450 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.855479 29438 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:48.926254 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:48.938465 30123 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.683s (SENT)
I20260709 13:12:48.946848 30123 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:48.948683 30123 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.751s (SENT)
W20260709 13:12:48.951835 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 96511.4us
I20260709 13:12:48.817687 31528 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:48.953786 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:48.954159 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1673) took 1468 ms. Trace:
I20260709 13:12:48.940512 29393 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:48.964468 29472 raft_consensus.cc:2410] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:48.964767 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 238) took 1489 ms. Trace:
W20260709 13:12:48.928303 31616 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:12:48.964497 29389 rpcz_store.cc:276] 0709 13:12:47.486198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.925868 (+1439670us) service_pool.cc:224] Handling call
0709 13:12:48.954085 (+ 28217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.920825 31624 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.965188 29393 rpcz_store.cc:276] 0709 13:12:47.475114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.939344 (+1464230us) service_pool.cc:224] Handling call
0709 13:12:48.964702 (+ 25358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.969568 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:48.970378 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:48.950232 30123 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.902s (SENT)
I20260709 13:12:48.971836 30123 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:48.970175 29389 raft_consensus.cc:2376] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3. Re-sending same reply.
I20260709 13:12:48.975871 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1710) took 1029 ms. Trace:
I20260709 13:12:48.976280 29465 rpcz_store.cc:276] 0709 13:12:47.946828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.946995 (+   167us) service_pool.cc:224] Handling call
0709 13:12:47.947451 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:47.954119 (+  6668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:47.954179 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:48.024433 (+ 70254us) log.cc:844] Serialized 52 byte log entry
0709 13:12:48.633826 (+609393us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:48.633905 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.634017 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.975622 (+341605us) raft_consensus.cc:1685] finished
0709 13:12:48.975645 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.975802 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":377,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"thread_start_us":595516,"threads_started":1,"wal-append.queue_time_us":631583}
I20260709 13:12:48.979287 31441 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:48.979907 31441 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:48.953805 31450 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:48.982566 31624 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:48.984272 31450 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:48.966919 31234 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:48.985173 31234 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:48.986182 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.987026 29393 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:48.987963 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.916417 31597 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:48.990316 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.991024 29389 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:48.992839 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 243) took 1516 ms. Trace:
I20260709 13:12:48.993368 29393 rpcz_store.cc:276] 0709 13:12:47.476318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.987666 (+1511348us) service_pool.cc:224] Handling call
0709 13:12:48.992785 (+  5119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.994208 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:48.996569 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:48.961702 31627 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEARNER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:48.926976 29394 rpcz_store.cc:269] 0709 13:12:47.457539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.888305 (+430766us) service_pool.cc:224] Handling call
0709 13:12:48.794154 (+905849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.996078 31450 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:12:48.997851 31630 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:49.004123 31630 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.004463 31630 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:49.007246 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49205.7us
I20260709 13:12:49.016518 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:49.017668 29389 raft_consensus.cc:2410] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:12:48.998013 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 147045us
I20260709 13:12:49.022631 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:49.024574 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:49.029842 31631 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:12:49.029992 31624 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:49.031383 31504 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:49.037065 31234 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:49.041412 29395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 237) took 1566 ms (client timeout 2070 ms). Trace:
W20260709 13:12:49.041849 29395 rpcz_store.cc:269] 0709 13:12:47.474845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.274207 (+799362us) service_pool.cc:224] Handling call
0709 13:12:49.041235 (+767028us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540042d1d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:49.041348 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477435776}
I20260709 13:12:49.043093 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.043185 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:49.043874 29395 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:49.044265 29472 raft_consensus.cc:2393] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:49.044737 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.046211 29468 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:12:49.046599 29468 pending_rounds.cc:85] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 6
I20260709 13:12:49.046846 29468 pending_rounds.cc:107] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:12:49.047062 29468 raft_consensus.cc:2889] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:48.963037 31591 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:49.003388 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:49.021976 31607 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.152s	user 0.003s	sys 0.012s
W20260709 13:12:49.055433 31623 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:12:49.055974 29469 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:49.003620 31600 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.053683 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.066407 29389 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:12:49.077196 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:49.080402 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:49.080866 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.081099 29389 raft_consensus.cc:2376] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4. Re-sending same reply.
I20260709 13:12:49.083596 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.064818 31508 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:49.065392 31171 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.086778 29389 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:12:49.076033 31633 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:12:49.066040 29394 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:49.093744 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.074595 31079 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:49.095444 29389 raft_consensus.cc:2410] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:49.101677 31641 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.096345 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1762) took 1673 ms. Trace:
I20260709 13:12:49.102408 29541 rpcz_store.cc:276] 0709 13:12:47.423450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.423592 (+   142us) service_pool.cc:224] Handling call
0709 13:12:47.425891 (+  2299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:47.495031 (+ 69140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:47.495080 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:47.577403 (+ 82323us) log.cc:844] Serialized 26 byte log entry
0709 13:12:47.810139 (+232736us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:47.810189 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.088104 (+1277915us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b540036cc54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:49.088177 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.088245 (+    68us) raft_consensus.cc:1685] finished
0709 13:12:49.088262 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.096266 (+  8004us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6849,"raft.queue_time_us":6985,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":125576,"spinlock_wait_cycles":141729664,"thread_start_us":77929,"threads_started":1,"wal-append.queue_time_us":161370,"wal-append.run_cpu_time_us":6506,"wal-append.run_wall_time_us":1061059}
I20260709 13:12:49.104707 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.105376 29396 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:49.107821 29389 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:12:49.109126 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 158932us
W20260709 13:12:49.112854 30123 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.944s (SENT)
I20260709 13:12:49.114516 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 479) took 1050 ms. Trace:
I20260709 13:12:49.115576 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1752) took 1704 ms. Trace:
I20260709 13:12:49.102617 31635 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:49.096220 31508 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.130667 31635 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:49.126111 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.127579 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1753) took 1722 ms. Trace:
W20260709 13:12:49.129084 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 172890us
I20260709 13:12:49.132164 29396 rpcz_store.cc:276] 0709 13:12:47.404834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.105993 (+1701159us) service_pool.cc:224] Handling call
0709 13:12:49.126821 (+ 20828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.127082 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.127120 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:49.127268 (+   148us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:49.127315 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.127392 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.127515 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:49.134874 29389 rpcz_store.cc:276] 0709 13:12:47.404479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.104166 (+1699687us) service_pool.cc:224] Handling call
0709 13:12:49.107578 (+  3412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.108232 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.108434 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:49.132175 30123 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:49.129377 31632 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:49.130223 30158 rpcz_store.cc:276] 0709 13:12:48.063814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.064174 (+   360us) service_pool.cc:224] Handling call
0709 13:12:48.064617 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.065153 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.065195 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.095752 (+ 30557us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.713917 (+618165us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:48.713962 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.714048 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.114276 (+400228us) raft_consensus.cc:1685] finished
0709 13:12:49.114296 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.114430 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":742,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":180699,"thread_start_us":351192,"threads_started":1,"wal-append.queue_time_us":405946}
W20260709 13:12:49.140627 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.149214 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.106913 31615 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:49.153872 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.157904 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.136296 31234 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.162474 31234 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:49.157861 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 45046.8us
I20260709 13:12:49.151508 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1755) took 1746 ms. Trace:
I20260709 13:12:49.173099 29390 rpcz_store.cc:276] 0709 13:12:47.405439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.150363 (+1744924us) service_pool.cc:224] Handling call
0709 13:12:49.150793 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.151039 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.151077 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:49.151154 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:49.151203 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.151272 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.151431 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:49.154271 31504 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:49.114867 31597 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:49.175871 29390 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:12:49.176631 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.966s (SENT)
W20260709 13:12:49.159015 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 150701us
I20260709 13:12:49.185314 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:49.189817 30155 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:12:49.190634 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1757) took 1784 ms. Trace:
W20260709 13:12:49.181418 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 227400us
I20260709 13:12:49.191246 29390 rpcz_store.cc:276] 0709 13:12:47.406017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.174958 (+1768941us) service_pool.cc:224] Handling call
0709 13:12:49.175398 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.189416 (+ 14018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.190543 (+  1127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:49.184230 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1751) took 1785 ms. Trace:
I20260709 13:12:49.194937 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:49.195577 30160 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:49.196684 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:49.186467 29391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1675) took 1326 ms (client timeout 1687 ms). Trace:
I20260709 13:12:49.193030 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:49.197674 29391 rpcz_store.cc:269] 0709 13:12:47.860164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.661656 (+801492us) service_pool.cc:224] Handling call
0709 13:12:49.186205 (+524549us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b540042ccd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:49.186364 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142671616}
I20260709 13:12:49.107085 31079 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.195218 29397 rpcz_store.cc:276] 0709 13:12:47.399374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.422916 (+ 23542us) service_pool.cc:224] Handling call
0709 13:12:47.450806 (+ 27890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.777603 (+326797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.183889 (+1406286us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b540031e554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:49.184139 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721122176}
I20260709 13:12:49.198215 30159 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:49.197372 30156 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:49.192306 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:49.207312 31441 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:49.219241 29391 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:49.220395 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1758) took 1814 ms. Trace:
I20260709 13:12:49.221084 29391 rpcz_store.cc:276] 0709 13:12:47.406328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.198764 (+1792436us) service_pool.cc:224] Handling call
0709 13:12:49.218738 (+ 19974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.220031 (+  1293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.220318 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:49.157610 31600 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:12:49.266034 29541 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:49.253705 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:49.271906 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 95328.3us
W20260709 13:12:49.273144 30123 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.020s (SENT)
I20260709 13:12:49.273730 30123 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:49.276484 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 98778.2us
I20260709 13:12:49.128721 31641 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:49.180934 31597 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:12:49.298637 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.299610 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:49.297696 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:49.289603 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:49.307329 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:49.324213 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 51095.6us
W20260709 13:12:49.325584 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.033s (SENT)
I20260709 13:12:49.281864 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:49.336422 31652 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:49.337045 31652 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:49.339357 31508 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.339406 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:49.340896 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.342258 29540 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:49.343909 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:49.345083 30123 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.070s (SENT)
I20260709 13:12:49.344925 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.163954 31632 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:49.287195 31638 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.350797 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.346760 29538 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:49.350493 31137 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:12:49.298103 31630 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:49.344805 30154 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:49.336490 30151 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:49.354179 31566 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:49.342025 31441 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.353652 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:49.387355 30123 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.625s (SENT)
W20260709 13:12:49.389053 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 99578.1us
I20260709 13:12:49.390552 30123 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:49.390547 29546 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
W20260709 13:12:49.508407 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 83424us
W20260709 13:12:49.509330 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.511814 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 353744us
I20260709 13:12:49.351110 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1754) took 1943 ms. Trace:
W20260709 13:12:49.513283 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 125999us
I20260709 13:12:49.517809 29393 raft_consensus.cc:2368] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
I20260709 13:12:49.362141 31528 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:49.363252 31591 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:49.338054 31652 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:49.385293 31653 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.385730 31634 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:49.528489 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 338513us
W20260709 13:12:49.532126 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 140314us
I20260709 13:12:49.513321 31635 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:49.520612 31627 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:49.515256 31651 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:49.560681 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.569114 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:49.544922 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:49.554093 31233 consensus_meta.cc:287] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.502s	user 0.013s	sys 0.005s
W20260709 13:12:49.571166 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.581797 31644 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:12:49.569923 31441 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.515951 29394 rpcz_store.cc:276] 0709 13:12:47.405169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.127048 (+1721879us) service_pool.cc:224] Handling call
0709 13:12:49.210485 (+ 83437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.275331 (+ 64846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.286974 (+ 11643us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:49.297888 (+ 10914us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:49.309736 (+ 11848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.341237 (+ 31501us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.348973 (+  7736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:49.562922 31657 raft_consensus.cc:3055] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:12:49.585587 29392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 216) took 2144 ms (client timeout 1507 ms). Trace:
I20260709 13:12:49.545423 31597 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:12:49.567046 31234 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:49.620798 29392 rpcz_store.cc:269] 0709 13:12:47.440941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.585290 (+2144349us) service_pool.cc:211] Skipping call since client already timed out
0709 13:12:49.585466 (+   176us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:12:49.662366 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.554931 31591 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:12:49.660944 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 396653us
I20260709 13:12:49.553604 31634 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:49.559628 31600 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:12:49.589442 31652 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:49.668579 29360 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:49.534789 31653 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.606596 31627 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:49.675505 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 118934us
I20260709 13:12:49.661931 30154 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.661335 31528 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:49.686276 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 154365us
I20260709 13:12:49.620882 31657 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:49.567642 31645 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:12:49.667032 31171 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.689514 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:49.696388 29360 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:49.592166 31655 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:12:49.698138 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.697682 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.698647 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:49.715919 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.620990 31441 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.589685 31233 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.730026 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:49.730914 29546 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.732499 29540 raft_consensus.cc:2410] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:49.669837 31659 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.733544 29544 raft_consensus.cc:2410] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:12:49.745570 29538 raft_consensus.cc:2410] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:49.770887 29388 raft_consensus.cc:2368] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
I20260709 13:12:49.791587 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.799288 29541 raft_consensus.cc:2410] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:49.781010 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.799923 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.800854 29539 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:49.800628 29540 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:49.785650 31592 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:49.804773 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.789961 31482 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.758159 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.801396 30151 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:49.839352 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.840054 29543 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:49.840621 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:49.840953 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.841291 29538 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:49.841619 29543 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:49.843179 31603 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.845302 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.846076 29540 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:49.847153 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.847268 31079 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.847787 29540 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:49.844565 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.763757 31632 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:49.808436 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.697014 31643 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:12:49.812486 31474 raft_consensus.cc:3055] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:49.800776 31659 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.807309 29542 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:49.787635 31630 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:49.813287 31441 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:49.737429 31171 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.829250 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.829653 31233 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.825291 31668 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:12:49.830813 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.831596 31653 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.832166 31376 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.865593 29539 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:49.834815 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:49.866771 29545 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.837548 30152 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:49.850013 29541 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:49.850581 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:49.857019 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.869894 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.771076 31662 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:49.843734 31666 log.cc:927] Time spent T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:49.719514 31528 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.852524 31638 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:12:49.875564 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.876528 29539 raft_consensus.cc:2410] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:12:49.877027 31528 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:49.853346 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.877609 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 245) took 2400 ms. Trace:
I20260709 13:12:49.877795 29540 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:49.878835 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.878049 29391 rpcz_store.cc:276] 0709 13:12:47.476764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.222160 (+1745396us) service_pool.cc:224] Handling call
0709 13:12:49.222615 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.223074 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.223115 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.223749 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.623148 (+399399us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:49.754203 (+131055us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.794782 (+ 40579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.794873 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.877378 (+ 82505us) raft_consensus.cc:1685] finished
0709 13:12:49.877401 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.877537 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40115,"prepare.queue_time_us":138289,"prepare.run_cpu_time_us":401,"prepare.run_wall_time_us":9214,"raft.queue_time_us":149689,"raft.run_cpu_time_us":504,"raft.run_wall_time_us":4509,"thread_start_us":406507,"threads_started":2,"wal-append.queue_time_us":402483}
I20260709 13:12:49.879875 31171 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:49.880486 29540 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:49.880841 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:49.853281 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.782346 31641 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:49.887178 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 190908us
I20260709 13:12:49.888391 29360 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:49.796011 31656 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:49.688616 31627 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:49.833796 30158 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:49.852712 31474 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:49.820333 29546 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:49.870891 29537 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:12:49.696787 31590 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 2.323s	user 0.015s	sys 0.032s
I20260709 13:12:49.869959 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.803680 31657 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:49.872480 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.881698 29544 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:49.882709 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.882300 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:49.855100 29509 connection.cc:256] RPC call timeout handler was delayed by -2.6376967949997834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:12:50.002826 29509 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.652s (SENT)
I20260709 13:12:50.003417 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:49.872788 31376 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:49.937040 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 217127us
I20260709 13:12:49.897624 30151 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:49.937920 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:49.873461 31662 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:49.938975 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:49.945808 31667 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
I20260709 13:12:49.939684 29395 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:49.897506 29394 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:49.941462 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1687) took 1269 ms. Trace:
I20260709 13:12:49.941169 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:49.952875 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 64606.8us
W20260709 13:12:49.956473 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.957212 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 237243us
W20260709 13:12:49.958067 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 110342us
W20260709 13:12:49.995256 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.999207 29540 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:12:50.003834 29546 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:12:50.001637 29542 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:50.004711 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:49.942709 29545 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:50.007288 29393 rpcz_store.cc:276] 0709 13:12:48.671663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.994043 (+322380us) service_pool.cc:224] Handling call
0709 13:12:49.898586 (+904543us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54002c1fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:49.941377 (+ 42791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198696832}
I20260709 13:12:50.008692 31657 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.021840 29438 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:50.009333 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 632) took 2981 ms. Trace:
I20260709 13:12:50.015657 29546 pending_rounds.cc:85] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 2
I20260709 13:12:50.022686 29537 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:50.017028 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.015695 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:50.020566 31653 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:50.022771 29546 pending_rounds.cc:107] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:12:50.025264 29546 raft_consensus.cc:2917] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:12:50.002521 31233 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:50.030831 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.023777 29393 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:50.023810 29392 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.031932 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.026340 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.028822 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:50.026585 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1678) took 2032 ms. Trace:
W20260709 13:12:50.027060 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.027002 30158 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:50.028780 29438 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:50.000072 31634 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:49.938357 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:50.035061 30160 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:50.034575 29395 rpcz_store.cc:276] 0709 13:12:47.995803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.044475 (+1048672us) service_pool.cc:224] Handling call
0709 13:12:50.026374 (+981899us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540031db54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:50.026516 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956451200}
I20260709 13:12:50.036073 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:50.036681 30160 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:50.040316 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.039049 31665 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:50.021194 31508 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
W20260709 13:12:50.135255 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:50.152961 31670 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:12:50.025383 30153 rpcz_store.cc:276] 0709 13:12:47.027981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.036226 (+  8245us) service_pool.cc:224] Handling call
0709 13:12:49.209377 (+2173151us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:50.008344 (+798967us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:50.008576 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.008803 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:50.008844 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.008981 (+   137us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:50.009030 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.009098 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.009220 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53242496}
I20260709 13:12:50.153065 31474 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:50.154704 31474 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:50.156873 31667 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:12:50.024955 31526 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:12:50.024876 30152 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:50.163123 31627 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:50.152014 29391 raft_consensus.cc:2410] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:50.048993 29546 raft_consensus.cc:2889] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.010999 31662 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:50.183758 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 161494us
I20260709 13:12:50.189424 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:50.190502 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 187731us
I20260709 13:12:50.184063 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.194519 31671 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:50.194712 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1759) took 2770 ms. Trace:
I20260709 13:12:50.195098 31671 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.195552 31671 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:50.195304 29397 rpcz_store.cc:276] 0709 13:12:47.424834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.199914 (+1775080us) service_pool.cc:224] Handling call
0709 13:12:49.879019 (+679105us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:49.879232 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.879630 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.879661 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.880189 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:12:50.010979 (+130790us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:50.011028 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.011103 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.194288 (+183185us) raft_consensus.cc:1685] finished
0709 13:12:50.194317 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.194620 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1469,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":13545,"spinlock_wait_cycles":12344192,"thread_start_us":130331,"threads_started":1,"wal-append.queue_time_us":309765}
W20260709 13:12:50.198241 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 169523us
I20260709 13:12:50.198469 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.019043 30154 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:12:50.199572 30154 pending_rounds.cc:85] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 3
I20260709 13:12:50.199981 30154 pending_rounds.cc:107] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:12:50.200400 30154 raft_consensus.cc:2917] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:12:50.201431 30154 raft_consensus.cc:2889] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.034031 31630 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:12:50.202673 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.203163 31508 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:50.203708 31508 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.204056 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.204281 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 646) took 1034 ms. Trace:
I20260709 13:12:50.205539 30154 rpcz_store.cc:276] 0709 13:12:49.169531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.565156 (+395625us) service_pool.cc:224] Handling call
0709 13:12:49.608457 (+ 43301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.203492 (+595035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.204132 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.210086 29390 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:50.034380 31233 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.210736 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 240) took 2735 ms. Trace:
I20260709 13:12:50.211782 29545 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:50.214061 29390 rpcz_store.cc:276] 0709 13:12:47.475606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.214634 (+1739028us) service_pool.cc:224] Handling call
0709 13:12:50.209571 (+994937us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:50.209767 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.210477 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.210678 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20672256}
I20260709 13:12:50.204123 31508 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.216856 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:50.217483 31652 consensus_meta.cc:287] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
I20260709 13:12:50.218472 31527 raft_consensus.cc:1064] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:50.218472 29542 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:12:50.219168 29542 pending_rounds.cc:85] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 3
I20260709 13:12:50.219379 29542 pending_rounds.cc:107] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:12:50.219619 29542 raft_consensus.cc:2917] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:12:50.220082 29542 raft_consensus.cc:2889] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.214565 31171 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:50.217634 29543 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:50.220878 31527 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:50.003237 31656 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:50.224455 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:50.205494 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:50.265311 29392 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:50.227757 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.267741 29545 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:50.228778 29539 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:50.270289 30123 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.272073 31627 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:50.229013 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.246938 29393 raft_consensus.cc:2410] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:50.273200 29472 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:50.274572 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:50.275310 29472 raft_consensus.cc:2376] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4. Re-sending same reply.
I20260709 13:12:50.276374 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.277695 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.225481 29538 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:12:50.209992 31674 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:12:50.215438 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:50.266776 30160 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:50.282593 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.286871 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.033826 31482 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.191s
I20260709 13:12:50.284263 29360 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:50.294749 29390 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:12:50.301982 29390 pending_rounds.cc:85] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 5
I20260709 13:12:50.302307 29390 pending_rounds.cc:107] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:12:50.302659 29390 raft_consensus.cc:2889] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.303611 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1674) took 2456 ms. Trace:
I20260709 13:12:50.304006 29390 rpcz_store.cc:276] 0709 13:12:47.847674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.293865 (+2446191us) service_pool.cc:224] Handling call
0709 13:12:50.294252 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.303249 (+  8997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.303536 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.297688 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.305521 29471 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:50.029764 31490 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.196s
I20260709 13:12:50.307497 29390 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:50.308708 29397 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:50.315861 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1664) took 2838 ms. Trace:
I20260709 13:12:50.316212 29397 rpcz_store.cc:276] 0709 13:12:47.477610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.248699 (+2771089us) service_pool.cc:224] Handling call
0709 13:12:50.308507 (+ 59808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.315569 (+  7062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.315791 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.225594 31233 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:50.032177 31603 consensus_queue.cc:1059] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.224s
I20260709 13:12:50.319990 29392 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:50.320578 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:50.320812 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1669) took 2838 ms. Trace:
I20260709 13:12:50.278368 29472 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:50.318092 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.321185 29471 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:50.300213 29394 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:50.321314 29392 rpcz_store.cc:276] 0709 13:12:47.482673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.267775 (+2785102us) service_pool.cc:224] Handling call
0709 13:12:50.268170 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.320543 (+ 52373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.320753 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.329550 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.299329 31659 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:50.335357 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.336835 29472 raft_consensus.cc:2393] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:50.337916 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1696) took 1661 ms. Trace:
I20260709 13:12:50.338466 29390 rpcz_store.cc:276] 0709 13:12:48.676706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.306703 (+1629997us) service_pool.cc:224] Handling call
0709 13:12:50.307069 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.324826 (+ 17757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.337817 (+ 12991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.310444 31676 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:50.254652 31653 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:12:50.320043 31627 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:50.350987 29397 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:50.356105 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1765) took 1075 ms. Trace:
I20260709 13:12:50.358609 29397 rpcz_store.cc:276] 0709 13:12:49.280601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.322227 (+1041626us) service_pool.cc:224] Handling call
0709 13:12:50.348884 (+ 26657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.355728 (+  6844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.356023 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.350271 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.354075 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.322693 31652 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:50.407678 29472 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:50.422832 31671 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:50.426529 31600 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:50.426993 31671 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:50.427089 31600 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:50.429095 31600 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:50.431021 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1586) took 1726 ms. Trace:
I20260709 13:12:50.430960 31600 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:50.431459 29467 rpcz_store.cc:276] 0709 13:12:48.704906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.738933 (+ 34027us) service_pool.cc:224] Handling call
0709 13:12:48.739174 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.835154 (+ 95980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.430740 (+1595586us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b54001e5854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:50.430948 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218738432}
W20260709 13:12:50.379477 31679 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:12:50.406831 29465 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:50.446550 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.451572 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.450104 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.457363 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:50.458724 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:50.447399 29467 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:50.444137 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.461971 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.442975 29471 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:12:50.465088 29470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1592) took 1655 ms (client timeout 2091 ms). Trace:
I20260709 13:12:50.465307 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:50.465531 29470 rpcz_store.cc:269] 0709 13:12:48.809670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.443718 (+1634048us) service_pool.cc:224] Handling call
0709 13:12:50.465016 (+ 21298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.432209 31652 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:50.331705 31678 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
W20260709 13:12:50.470755 29466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1593) took 1551 ms (client timeout 1755 ms). Trace:
W20260709 13:12:50.471850 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 280517us
W20260709 13:12:50.478278 29509 connection.cc:256] RPC call timeout handler was delayed by -2.6205967949999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 13:12:50.475559 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:50.479252 29464 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
W20260709 13:12:50.477313 29466 rpcz_store.cc:269] 0709 13:12:48.919609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.461680 (+1542071us) service_pool.cc:224] Handling call
0709 13:12:50.470671 (+  8991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:50.467535 31627 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:50.481864 29509 connection.cc:256] RPC call timeout handler was delayed by -2.5377967949998492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
I20260709 13:12:50.472959 29471 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:12:50.357234 31676 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:50.486883 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.481783 31627 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:50.488381 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:50.490105 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 265759us
W20260709 13:12:50.494313 29509 connection.cc:256] RPC call timeout handler was delayed by -2.1936720449998575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:12:50.494757 29509 connection.cc:256] RPC call timeout handler was delayed by -2.140572044999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:12:50.495085 29509 connection.cc:256] RPC call timeout handler was delayed by -2.1243720449999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:12:50.495525 29509 connection.cc:256] RPC call timeout handler was delayed by -2.0748720449998928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 13:12:50.499197 29509 connection.cc:256] RPC call timeout handler was delayed by -2.0415720449998389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:12:50.500523 29509 connection.cc:256] RPC call timeout handler was delayed by -2.0370720449998316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 13:12:50.502056 29509 connection.cc:256] RPC call timeout handler was delayed by -1.9950967949998812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2658s for a response
W20260709 13:12:50.503234 29509 connection.cc:256] RPC call timeout handler was delayed by -1.9209720449998713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:12:50.504652 29509 connection.cc:256] RPC call timeout handler was delayed by -1.7400720449998062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:12:50.506035 29509 connection.cc:256] RPC call timeout handler was delayed by -1.6878720449999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260709 13:12:50.498611 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 211707us
W20260709 13:12:50.508126 29363 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.573s (SENT) [suppressed 50 similar messages]
W20260709 13:12:50.511296 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4622967949999293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.325s for a response
I20260709 13:12:50.512674 29438 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:50.515693 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3062720450000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2581s for a response
W20260709 13:12:50.517306 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0695720449998589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2844s for a response
I20260709 13:12:50.520202 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.521358 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.525287 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.526202 29544 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:50.528764 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.533165 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.497654 31627 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:50.550283 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.529731 29544 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:50.552583 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:50.557072 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.559576 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.562016 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.563869 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.564736 29544 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:50.565798 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:50.566509 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.517072 31665 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.562932 29539 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:50.574983 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.568944 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.576782 29546 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:50.569801 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.577997 29542 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:50.576081 29539 raft_consensus.cc:2410] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:50.580596 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:50.510916 31653 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:12:50.558473 31671 raft_consensus.cc:2764] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:50.521082 31625 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:12:50.593263 31683 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:12:50.593062 31656 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:50.613370 31653 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.588455 31665 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:50.619488 31665 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:50.606323 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:50.600404 31680 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:12:50.630796 29509 leader_election.cc:336] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.654s (SENT)
I20260709 13:12:50.608695 31508 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:50.634325 29509 leader_election.cc:336] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.672s (SENT)
I20260709 13:12:50.636040 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.636549 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1716) took 1266 ms. Trace:
I20260709 13:12:50.639123 29467 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:12:50.644301 29509 leader_election.cc:336] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.764s (SENT)
I20260709 13:12:50.644881 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:50.646293 29509 leader_election.cc:336] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.769s (SENT)
I20260709 13:12:50.660238 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.639211 31675 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:50.639678 31678 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:50.640645 31665 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:50.661517 31474 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:50.747042 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 234438us
W20260709 13:12:50.748361 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 102088us
W20260709 13:12:50.751344 29509 leader_election.cc:336] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.898s (SENT)
W20260709 13:12:50.766121 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 307478us
I20260709 13:12:50.732070 31563 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:50.767035 29509 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.963s (SENT)
I20260709 13:12:50.770978 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.601387 31652 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:50.769785 30126 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:50.781126 29509 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.099s (SENT)
W20260709 13:12:50.778525 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 250705us
W20260709 13:12:50.787971 29509 leader_election.cc:336] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.157s (SENT)
I20260709 13:12:50.788627 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.797763 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1711) took 2118 ms. Trace:
I20260709 13:12:50.775431 31474 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:50.825400 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.766450 31690 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:12:50.848170 31675 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:50.849010 31675 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:50.827718 31629 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:50.830456 31441 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:50.837996 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50092.3us
W20260709 13:12:50.864005 29509 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.581s (SENT)
I20260709 13:12:50.864624 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:50.834481 31676 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:50.873536 31474 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:50.865711 31233 consensus_meta.cc:287] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.529s	user 0.020s	sys 0.000s
W20260709 13:12:50.876603 29509 leader_election.cc:336] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.658s (SENT)
I20260709 13:12:50.865460 31441 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:50.920526 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 150831us
I20260709 13:12:50.912748 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:50.936854 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.948956 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:50.887180 31508 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:50.952666 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:50.944453 31441 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.953724 29470 raft_consensus.cc:606] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:50.954119 29470 raft_consensus.cc:614] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:50.954862 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.952769 31474 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:50.886992 31683 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:50.888568 31678 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:50.968605 31441 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:50.974993 31689 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 13:12:50.958616 31710 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:12:50.986963 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 110635us
W20260709 13:12:51.005932 29509 leader_election.cc:336] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.844s (SENT)
I20260709 13:12:50.892957 31233 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:51.010419 29509 leader_election.cc:336] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.950s (SENT)
I20260709 13:12:51.013969 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:50.976060 31717 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:51.022616 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.997792 31706 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:51.027668 29509 leader_election.cc:336] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.974s (SENT)
I20260709 13:12:51.054665 31706 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.055177 31706 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:51.057556 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:51.058624 29541 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:51.058771 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:51.059893 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:51.060552 29545 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:51.023667 31474 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:51.031651 31441 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:51.028458 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1756) took 3622 ms. Trace:
I20260709 13:12:51.038838 29391 raft_consensus.cc:2368] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5.
I20260709 13:12:51.061866 29396 rpcz_store.cc:276] 0709 13:12:47.405749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.160644 (+1754895us) service_pool.cc:224] Handling call
0709 13:12:50.793508 (+1632864us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:50.793715 (+   207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.837390 (+ 43675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:50.837431 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:50.838059 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:12:50.912759 (+ 74700us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:51.007674 (+ 94915us) log.cc:844] Serialized 14 byte log entry
0709 13:12:51.008051 (+   377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.008147 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:51.008214 (+    67us) raft_consensus.cc:1685] finished
0709 13:12:51.028086 (+ 19872us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.028353 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3368,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":8854,"spinlock_wait_cycles":11343104,"thread_start_us":132726,"threads_started":2,"wal-append.queue_time_us":85157}
I20260709 13:12:51.063953 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:51.064390 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 256) took 1493 ms. Trace:
I20260709 13:12:51.057700 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:51.064780 29391 rpcz_store.cc:276] 0709 13:12:49.570650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.198107 (+627457us) service_pool.cc:224] Handling call
0709 13:12:51.064220 (+866113us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400161054. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:51.064333 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930048896}
I20260709 13:12:51.065277 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:51.065627 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:51.066147 29541 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:51.066377 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:51.067034 29544 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:51.049124 31675 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.038005 31233 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:51.072178 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:51.073148 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 118402us
I20260709 13:12:51.078167 30126 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:51.080777 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:51.077279 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 251976us
I20260709 13:12:51.084870 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:51.086004 29394 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.003s
I20260709 13:12:51.086374 29394 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:51.086957 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1764) took 1806 ms. Trace:
I20260709 13:12:51.087216 29394 rpcz_store.cc:276] 0709 13:12:49.280310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.205231 (+924921us) service_pool.cc:224] Handling call
0709 13:12:51.086904 (+881673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:51.024034 31717 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:51.089792 29543 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:51.027442 31713 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:51.096928 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:51.209316 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:51.170320 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 85982.6us
W20260709 13:12:51.212504 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 126030us
I20260709 13:12:51.213440 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:51.115586 29544 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:51.088689 31441 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:51.206130 31657 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.179s	user 0.016s	sys 0.000s
I20260709 13:12:51.091570 31233 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.231980 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:51.211155 31713 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.185189 31378 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:51.235325 29388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1680) took 3170 ms (client timeout 1652 ms). Trace:
W20260709 13:12:51.236267 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.088445 31629 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.151s
I20260709 13:12:51.085006 31474 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:51.207804 31717 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:51.082901 31634 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:12:51.248164 29545 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
W20260709 13:12:51.253921 30126 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.739s (SENT)
I20260709 13:12:51.269531 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:51.091359 31665 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:51.256685 29388 rpcz_store.cc:269] 0709 13:12:48.049578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.732234 (+682656us) service_pool.cc:224] Handling call
0709 13:12:51.219662 (+2487428us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000e6fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:51.219856 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349865856}
I20260709 13:12:51.184286 31727 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:51.091025 31566 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.152s
I20260709 13:12:51.185153 31137 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:12:51.090623 31563 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.159s
I20260709 13:12:51.235174 31441 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:51.264964 31474 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:51.270318 31731 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.289650 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1612) took 1450 ms. Trace:
I20260709 13:12:51.280761 31718 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:12:51.291909 29537 rpcz_store.cc:276] 0709 13:12:49.838890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.004952 (+166062us) service_pool.cc:224] Handling call
0709 13:12:50.018185 (+ 13233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.023182 (+  4997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.289341 (+1266159us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5400251f50. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:51.289557 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3560192}
I20260709 13:12:51.255439 31719 consensus_queue.cc:1059] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:12:51.256896 31233 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:51.290764 29435 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:51.262861 31657 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:51.256572 31378 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:51.167865 31678 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.256676 31713 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:51.284845 31662 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.062s	user 0.013s	sys 0.004s
W20260709 13:12:51.278359 31727 raft_consensus.cc:670] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } [suppressed 1 similar messages]
I20260709 13:12:51.287227 31441 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.314548 31662 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.324273 31662 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:51.293668 31675 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:51.313643 31625 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:12:51.291703 31733 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:12:51.294582 31731 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:51.335958 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:51.319690 31727 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:51.339522 29393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1760) took 2060 ms (client timeout 2244 ms). Trace:
W20260709 13:12:51.340049 29393 rpcz_store.cc:269] 0709 13:12:49.279112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.031684 (+752572us) service_pool.cc:224] Handling call
0709 13:12:51.339294 (+1307610us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001720d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:51.339453 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442668928}
I20260709 13:12:51.297791 31657 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:51.341550 31657 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:51.341980 31376 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:51.283047 31728 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:12:51.342268 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.345292 30155 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:51.358119 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:51.358717 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.360002 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1609) took 1046 ms. Trace:
I20260709 13:12:51.352461 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1718) took 1841 ms. Trace:
I20260709 13:12:51.360500 29467 rpcz_store.cc:276] 0709 13:12:50.313684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.514340 (+200656us) service_pool.cc:224] Handling call
0709 13:12:50.556831 (+ 42491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.639652 (+ 82821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.359719 (+720067us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b540035cd54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:51.359935 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188566272}
I20260709 13:12:51.361720 31596 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:51.312050 31664 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:51.362484 31596 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:51.344509 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1610) took 1021 ms. Trace:
I20260709 13:12:51.364312 31654 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.364907 31654 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:51.353690 31378 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.366650 31652 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:51.363866 29470 rpcz_store.cc:276] 0709 13:12:50.323124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.955033 (+631909us) service_pool.cc:224] Handling call
0709 13:12:50.955368 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.009990 (+ 54622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.010025 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.010670 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:12:51.206501 (+195831us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:51.206560 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.206665 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:51.344304 (+137639us) raft_consensus.cc:1685] finished
0709 13:12:51.344325 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.344445 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77788,"raft.queue_time_us":55160,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":13045,"thread_start_us":120954,"threads_started":1,"wal-append.queue_time_us":185759}
I20260709 13:12:51.360642 29468 rpcz_store.cc:276] 0709 13:12:49.511568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.511714 (+   146us) service_pool.cc:224] Handling call
0709 13:12:49.518056 (+  6342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.518301 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:50.679309 (+1161008us) log.cc:844] Serialized 14 byte log entry
0709 13:12:51.351925 (+672616us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18002ce1e0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61e8999060 00007f61e89ab716 00007f61e89bc287
0709 13:12:51.352045 (+   120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.352099 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:51.352164 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.352241 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.352385 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":940333,"prepare.queue_time_us":1064183,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3992,"raft.queue_time_us":50563,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4912,"spinlock_wait_cycles":2744064,"thread_start_us":507862,"threads_started":3,"wal-append.queue_time_us":280495}
I20260709 13:12:51.372493 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:51.353008 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 495) took 1177 ms. Trace:
I20260709 13:12:51.373385 30151 rpcz_store.cc:276] 0709 13:12:50.175636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.208615 (+ 32979us) service_pool.cc:224] Handling call
0709 13:12:51.058239 (+849624us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:51.058498 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.058938 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.058971 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.078409 (+ 19438us) log.cc:844] Serialized 26 byte log entry
0709 13:12:51.265783 (+187374us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:51.265919 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.271350 (+  5431us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:51.352676 (+ 81326us) raft_consensus.cc:1685] finished
0709 13:12:51.352709 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.352940 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3013,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":198,"spinlock_wait_cycles":22995712,"thread_start_us":77227,"threads_started":1,"wal-append.queue_time_us":228595}
I20260709 13:12:51.342772 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1611) took 1006 ms. Trace:
I20260709 13:12:51.376462 29470 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:51.344965 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:51.337667 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:51.362130 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:51.376132 29464 rpcz_store.cc:276] 0709 13:12:50.336609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.983190 (+646581us) service_pool.cc:224] Handling call
0709 13:12:51.006133 (+ 22943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.070505 (+ 64372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.070540 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.076239 (+  5699us) log.cc:844] Serialized 26 byte log entry
0709 13:12:51.263919 (+187680us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:51.263951 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.264045 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:51.342506 (+ 78461us) raft_consensus.cc:1685] finished
0709 13:12:51.342528 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.342680 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151687,"raft.queue_time_us":65477,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":10521,"thread_start_us":95189,"threads_started":1,"wal-append.queue_time_us":196641}
I20260709 13:12:51.382683 31596 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:51.385478 29466 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:51.372565 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:51.294905 31474 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:51.398126 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:51.404657 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 150627us
I20260709 13:12:51.405036 29544 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:51.412456 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:51.407793 30152 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:51.414353 31732 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.429864 31233 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:51.430101 31732 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.413887 31652 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:51.432621 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 156511us
I20260709 13:12:51.452266 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:51.456705 31664 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:51.460690 29543 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:51.461687 31664 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:51.464269 31732 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:51.441205 31662 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:51.473047 29541 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:51.492501 31441 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.465296 31654 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:51.457309 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:51.499583 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:51.568435 29543 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:51.500286 31627 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.926s	user 0.010s	sys 0.006s
I20260709 13:12:51.454420 31718 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:51.504906 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:51.511191 31717 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.513784 31662 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:51.471279 31652 raft_consensus.cc:697] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:51.586946 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.618907 29544 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:50.637189 29469 rpcz_store.cc:276] 0709 13:12:49.370494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.370668 (+   174us) service_pool.cc:224] Handling call
0709 13:12:49.512961 (+142293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.513183 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:50.448089 (+934906us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.636036 (+187947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.636122 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:50.636193 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.636305 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.636478 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":968085,"prepare.queue_time_us":1001771,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":114,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4146,"thread_start_us":187501,"threads_started":1}
I20260709 13:12:51.620487 30151 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.638808 30154 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:51.592876 31662 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.621626 31718 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.669423 31652 consensus_queue.cc:237] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:51.598728 31706 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.607439 31627 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:51.681412 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80445.5us
W20260709 13:12:51.689743 30123 leader_election.cc:336] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.160s (SENT)
I20260709 13:12:51.714112 30123 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:51.728549 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 304336us
W20260709 13:12:51.743789 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 338210us
W20260709 13:12:51.744691 30126 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.531s (SENT)
I20260709 13:12:51.745143 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:51.753845 29438 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:51.765360 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:51.763250 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 457271us
I20260709 13:12:51.770196 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:12:51.770226 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.777751 31716 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:51.779589 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:51.780423 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:51.759953 31732 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:51.756906 31596 consensus_queue.cc:1059] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:51.803848 31728 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:51.768208 31718 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:51.774180 31678 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEARNER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:51.806525 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:51.775518 31675 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:51.774470 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 420) took 1219 ms. Trace:
I20260709 13:12:51.809520 31732 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.814659 31716 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:51.801788 30152 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:51.817480 30153 rpcz_store.cc:276] 0709 13:12:50.554917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.786509 (+231592us) service_pool.cc:224] Handling call
0709 13:12:50.836645 (+ 50136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.883792 (+ 47147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:50.883863 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:50.960986 (+ 77123us) log.cc:844] Serialized 26 byte log entry
0709 13:12:51.209920 (+248934us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:51.265304 (+ 55384us) log.cc:844] Serialized 14 byte log entry
0709 13:12:51.695282 (+429978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.704559 (+  9277us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:51.709946 (+  5387us) raft_consensus.cc:1685] finished
0709 13:12:51.745250 (+ 35304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.768836 (+ 23586us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37961,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":134493,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":21220,"thread_start_us":567490,"threads_started":2,"wal-append.queue_time_us":258860}
I20260709 13:12:51.816749 31675 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:51.823199 31675 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.824373 30126 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:51.829005 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:51.826501 29512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.003s	sys 0.020s
W20260709 13:12:51.830470 29512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.003s	sys 0.020s
W20260709 13:12:51.830971 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 531161us
I20260709 13:12:51.838409 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:51.839854 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.508s (SENT)
I20260709 13:12:51.811869 31697 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:51.825552 31740 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:51.883411 29543 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:51.820255 31732 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:51.836941 31678 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:51.921404 31743 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:51.843779 31727 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:51.915939 30123 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.531s (SENT)
I20260709 13:12:51.835752 31728 raft_consensus.cc:697] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:51.905618 31697 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.963299 31627 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:51.921394 31742 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:51.906414 31474 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:51.940282 31741 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:12:51.941035 31441 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:51.981148 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.022s	sys 0.032s
W20260709 13:12:51.991571 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.022s	sys 0.032s
W20260709 13:12:51.992203 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 579810us
W20260709 13:12:51.993515 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:51.966377 31713 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.007s
I20260709 13:12:51.993353 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:51.939412 31678 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:51.991608 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 212757us
W20260709 13:12:51.992081 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 212582us
I20260709 13:12:51.997306 31751 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.972373 31706 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:52.000802 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:51.986572 31697 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:51.943593 31137 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:12:51.998849 29438 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:51.978005 31717 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:52.018016 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:52.005846 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:52.008415 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:52.009244 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:52.001721 29545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.002s	sys 0.014s
I20260709 13:12:52.007133 29360 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:52.014199 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:52.020788 29545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.002s	sys 0.014s
I20260709 13:12:52.021246 30157 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:52.002887 31678 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:52.029394 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:52.029768 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:52.030009 29389 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.030400 30157 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:52.029486 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:52.031174 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:52.021279 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:52.031977 29397 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:52.033000 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:52.034096 29438 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:52.003361 31664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.020s	sys 0.028s
I20260709 13:12:52.040704 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:52.046537 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:52.047501 29395 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
W20260709 13:12:52.051626 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 44602.8us
I20260709 13:12:52.005512 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:52.059800 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:52.052702 31664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.021s	sys 0.028s
I20260709 13:12:52.068009 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:52.075868 30157 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:52.078449 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:52.082166 31756 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.057605 31747 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:52.082789 31756 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.003542 31713 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.064213 31717 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:52.063383 30151 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
W20260709 13:12:52.103493 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.084405 30153 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:52.110766 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:52.013151 31751 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:52.093201 31758 raft_consensus.cc:3055] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.074668 31757 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.119009 29360 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:52.116719 31657 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.775s	user 0.017s	sys 0.000s
I20260709 13:12:52.113423 31706 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:52.120973 31233 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.127961 31675 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:52.119496 31747 raft_consensus.cc:697] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:52.118969 31758 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:52.105517 31717 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.127120 31762 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:52.132865 31757 raft_consensus.cc:697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:52.154191 31762 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:52.074828 31728 consensus_queue.cc:237] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:52.143872 31752 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:52.155829 31474 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:52.155980 31747 consensus_queue.cc:237] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:52.157634 31713 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:52.132083 31657 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.177589 31758 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.178941 31657 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:52.179811 31751 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:52.183274 31717 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:52.184541 31757 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:52.172042 31761 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:12:52.172387 31750 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:52.175429 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1604) took 2334 ms. Trace:
I20260709 13:12:52.166306 31762 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.139760 31233 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:52.243129 31662 consensus_meta.cc:287] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.594s	user 0.015s	sys 0.000s
I20260709 13:12:52.145269 31675 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:52.244899 31233 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:52.245739 31233 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:52.322072 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:52.194141 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.471602 31697 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.492653 31697 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:52.245741 31662 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:52.138924 31706 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.178220 31570 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.176128 31756 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:52.209599 29540 rpcz_store.cc:276] 0709 13:12:49.836522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.889381 (+ 52859us) service_pool.cc:224] Handling call
0709 13:12:49.998834 (+109453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.016230 (+ 17396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.170410 (+2154180us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400061b50. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:52.170612 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250708736}
W20260709 13:12:52.501506 30123 leader_election.cc:336] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.835s (SENT)
I20260709 13:12:52.568043 31706 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:52.249343 31678 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.568961 31570 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:52.570679 30151 raft_consensus.cc:1240] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:52.570214 31570 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:52.570849 31678 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:52.139294 29397 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:52.567900 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:52.572500 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71049.7us
I20260709 13:12:52.506805 31732 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.574343 31732 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:52.727385 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.509402 31762 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:52.736588 31762 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:52.739254 31762 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:52.739876 31762 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:54.029960 31769 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.031960 31769 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.035228 31770 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:54.036624 31770 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:54.080543 29396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.997s	user 0.026s	sys 0.044s
W20260709 13:12:54.081321 29396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.998s	user 0.026s	sys 0.044s
W20260709 13:12:53.651583 29361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.603s	user 0.005s	sys 0.013s
W20260709 13:12:53.778779 29438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.728s	user 0.005s	sys 0.023s
W20260709 13:12:53.651583 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.656s	user 0.005s	sys 0.021s
W20260709 13:12:53.754379 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.678s	user 0.018s	sys 0.025s
W20260709 13:12:53.769531 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.004s	sys 0.006s
W20260709 13:12:54.094605 29361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.046s	user 0.007s	sys 0.028s
I20260709 13:12:52.740146 31662 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:54.100471 29391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.970s	user 0.018s	sys 0.015s
W20260709 13:12:54.101104 29391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.974s	user 0.018s	sys 0.015s
I20260709 13:12:54.104044 31732 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:53.830351 29544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.711s	user 0.001s	sys 0.010s
W20260709 13:12:53.674329 29389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.593s	user 0.003s	sys 0.008s
W20260709 13:12:53.652613 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.107293 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.112s	user 0.005s	sys 0.041s
W20260709 13:12:53.830358 29546 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.738s	user 0.000s	sys 0.010s
W20260709 13:12:54.105813 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.040s	user 0.012s	sys 0.010s
W20260709 13:12:53.868728 30152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.708s	user 0.009s	sys 0.004s
W20260709 13:12:53.105351 30155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.263s	user 0.007s	sys 0.039s
W20260709 13:12:54.106629 29438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.056s	user 0.007s	sys 0.034s
W20260709 13:12:54.106606 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.030s	user 0.029s	sys 0.026s
W20260709 13:12:52.869910 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.117633 29544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.998s	user 0.014s	sys 0.013s
W20260709 13:12:52.876248 30126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.015s	sys 0.027s
W20260709 13:12:52.886574 29509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.009s	sys 0.037s
W20260709 13:12:54.116389 29389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.036s	user 0.011s	sys 0.020s
W20260709 13:12:53.487613 31527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.008s	sys 0.004s
W20260709 13:12:54.122328 29546 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.030s	user 0.006s	sys 0.017s
W20260709 13:12:53.487087 31728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.005s	sys 0.009s
W20260709 13:12:53.402530 31757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.007s	sys 0.021s
W20260709 13:12:53.105827 31171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.016s	sys 0.012s
W20260709 13:12:53.424226 31566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.493s	user 0.015s	sys 0.023s
W20260709 13:12:53.487224 31747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.005s	sys 0.008s
W20260709 13:12:53.486737 31764 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.376s	user 0.000s	sys 0.013s
W20260709 13:12:53.438009 31752 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.010s	sys 0.019s
I20260709 13:12:52.816212 31762 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:54.130417 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 2.13695e+06us
W20260709 13:12:54.125227 30152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.965s	user 0.009s	sys 0.017s
W20260709 13:12:54.127954 29395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.947s	user 0.001s	sys 0.018s
W20260709 13:12:54.137992 29394 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.986s	user 0.013s	sys 0.005s
W20260709 13:12:54.133708 29393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.023s	user 0.008s	sys 0.016s
W20260709 13:12:54.139911 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.140486 29509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.103s	user 0.012s	sys 0.053s
W20260709 13:12:54.141090 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 2.11643e+06us
W20260709 13:12:54.138500 29394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.041s	user 0.013s	sys 0.012s
W20260709 13:12:54.143206 29395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.007s	user 0.001s	sys 0.018s
W20260709 13:12:54.142875 29393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.046s	user 0.008s	sys 0.017s
W20260709 13:12:52.757853 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.958s (SENT)
I20260709 13:12:53.109624 31657 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:52.724512 31678 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:54.154336 31728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.890s	user 0.005s	sys 0.011s
W20260709 13:12:54.156206 29360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.995s	user 0.015s	sys 0.030s
W20260709 13:12:54.156703 29360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.018s	user 0.015s	sys 0.030s
W20260709 13:12:54.139659 31566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.222s	user 0.016s	sys 0.038s
W20260709 13:12:54.158852 30155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.284s	user 0.011s	sys 0.046s
I20260709 13:12:54.160213 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 422) took 2373 ms. Trace:
I20260709 13:12:54.160668 30155 rpcz_store.cc:276] 0709 13:12:51.786480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.786780 (+   300us) service_pool.cc:224] Handling call
0709 13:12:51.787357 (+   577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.787906 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.787948 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.805500 (+ 17552us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.159475 (+2353975us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:54.159594 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.159730 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.159779 (+    49us) raft_consensus.cc:1685] finished
0709 13:12:54.159790 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.160080 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734,"raft.queue_time_us":2997,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12004,"thread_start_us":2316498,"threads_started":1,"wal-append.queue_time_us":2195120}
W20260709 13:12:54.162621 30126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.241s	user 0.015s	sys 0.044s
W20260709 13:12:54.150789 29388 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.034s	user 0.021s	sys 0.013s
W20260709 13:12:54.170615 29388 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.078s	user 0.022s	sys 0.013s
W20260709 13:12:54.166750 31171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.132s	user 0.023s	sys 0.019s
W20260709 13:12:54.168468 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 2.02988e+06us
W20260709 13:12:54.171816 29390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.036s	user 0.041s	sys 0.065s
W20260709 13:12:54.179055 29390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.082s	user 0.041s	sys 0.065s
W20260709 13:12:54.179857 31527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.958s	user 0.011s	sys 0.012s
I20260709 13:12:54.146783 31797 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:54.186185 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1782) took 2105 ms. Trace:
I20260709 13:12:54.186769 29396 rpcz_store.cc:276] 0709 13:12:52.065081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.065258 (+   177us) service_pool.cc:224] Handling call
0709 13:12:52.082199 (+ 16941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.082501 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.082536 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.083120 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.082267 (+1999147us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:54.126523 (+ 44256us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.135203 (+  8680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.138726 (+  3523us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.143383 (+  4657us) raft_consensus.cc:1685] finished
0709 13:12:54.143409 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.170373 (+ 26964us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8762,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":90,"raft.queue_time_us":8937,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":32560,"thread_start_us":1998248,"threads_started":1,"wal-append.queue_time_us":1997408}
W20260709 13:12:54.191226 31747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.006s	sys 0.008s
W20260709 13:12:54.194792 31764 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.026s	user 0.000s	sys 0.014s
W20260709 13:12:54.197846 31757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.944s	user 0.009s	sys 0.025s
W20260709 13:12:54.188134 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 1.43005e+06us
W20260709 13:12:54.205768 31752 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.964s	user 0.012s	sys 0.021s
I20260709 13:12:54.209161 31752 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:54.212662 31752 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.217181 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:54.258594 31769 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:54.280450 31732 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:54.280817 30123 connection.cc:256] RPC call timeout handler was delayed by -1.225805279000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:12:54.281600 31782 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:12:54.281944 31678 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.282774 31678 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.282716 31797 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.281602 31732 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:54.287886 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.288035 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 120163us
W20260709 13:12:54.288760 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.289652 31732 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:54.289803 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:54.290791 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 655) took 2280 ms. Trace:
I20260709 13:12:54.291461 31678 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:54.291253 30152 rpcz_store.cc:276] 0709 13:12:52.010539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.117272 (+106733us) service_pool.cc:224] Handling call
0709 13:12:52.146147 (+ 28875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.159351 (+ 13204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.159397 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.159931 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.183775 (+2023844us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:54.206288 (+ 22513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.247091 (+ 40803us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.257942 (+ 10851us) raft_consensus.cc:1685] finished
0709 13:12:54.257967 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.290675 (+ 32708us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5287,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":3241,"thread_start_us":1976517,"threads_started":1,"wal-append.queue_time_us":1894097}
I20260709 13:12:54.283154 31657 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:54.294903 31757 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:54.295360 31770 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:54.296566 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1786) took 2201 ms. Trace:
I20260709 13:12:54.298098 30160 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:12:54.276505 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1785) took 2195 ms. Trace:
I20260709 13:12:54.307678 29393 rpcz_store.cc:276] 0709 13:12:52.095439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.095637 (+   198us) service_pool.cc:224] Handling call
0709 13:12:52.096051 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.189049 (+2092998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.189142 (+    93us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.190394 (+  1252us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.261816 (+ 71422us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:54.281968 (+ 20152us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.282258 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.282379 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.296228 (+ 13849us) raft_consensus.cc:1685] finished
0709 13:12:54.296261 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.296488 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9660,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":78,"raft.queue_time_us":85060,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":265,"thread_start_us":2125706,"threads_started":2,"wal-append.queue_time_us":74970}
I20260709 13:12:54.312898 31657 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:54.313707 31657 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:54.314828 31757 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:54.315442 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:54.316606 29469 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:54.318040 31806 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:54.318051 31757 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:54.290333 31732 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:54.318982 31806 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:54.319548 31732 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.321748 31806 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:54.322065 31732 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:54.322296 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 2.48381e+06us
I20260709 13:12:54.322773 31657 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.324348 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:54.325285 29538 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:54.325917 31657 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:54.327803 31802 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:54.330955 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 498) took 4117 ms. Trace:
I20260709 13:12:54.333644 30160 rpcz_store.cc:276] 0709 13:12:50.213683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.280156 (+ 66473us) service_pool.cc:224] Handling call
0709 13:12:54.296675 (+4016519us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:54.297218 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.308065 (+ 10847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.330853 (+ 22788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16259456}
I20260709 13:12:54.339949 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1819) took 2296 ms. Trace:
I20260709 13:12:54.342598 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1788) took 2246 ms. Trace:
I20260709 13:12:54.340757 29546 rpcz_store.cc:276] 0709 13:12:52.043659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.045412 (+  1753us) service_pool.cc:224] Handling call
0709 13:12:52.045773 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.046016 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:54.144164 (+2098148us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.339235 (+195071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:54.339398 (+   163us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:54.339539 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.339644 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.339871 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19343,"prepare.queue_time_us":829007,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":116597,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":15494,"thread_start_us":2186927,"threads_started":3,"wal-append.queue_time_us":129556}
I20260709 13:12:54.343226 29390 rpcz_store.cc:276] 0709 13:12:52.096261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.096443 (+   182us) service_pool.cc:224] Handling call
0709 13:12:52.096829 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.198311 (+2101482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.198375 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.199288 (+   913us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.329312 (+130024us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:54.329368 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.333013 (+  3645us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.342262 (+  9249us) raft_consensus.cc:1685] finished
0709 13:12:54.342290 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.342516 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173,"raft.queue_time_us":80609,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":57,"thread_start_us":2212257,"threads_started":2,"wal-append.queue_time_us":140066}
I20260709 13:12:54.345794 31597 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:54.352514 29509 connection.cc:256] RPC call timeout handler was delayed by -2.58942650400013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 13:12:54.338796 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1818) took 2291 ms. Trace:
I20260709 13:12:54.364578 31778 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:54.366067 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 76511us
I20260709 13:12:54.367127 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:54.367784 29541 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:54.370265 31802 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:54.376030 29435 connection.cc:256] RPC call timeout handler was delayed by -1.3793974669999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:12:54.376622 29435 connection.cc:256] RPC call timeout handler was delayed by -1.3793974669999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:12:54.376318 31662 consensus_queue.cc:1059] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:54.376946 29435 connection.cc:256] RPC call timeout handler was delayed by -1.3487974670001677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:12:54.377393 29435 connection.cc:256] RPC call timeout handler was delayed by -1.3154974670001138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 13:12:54.377959 29545 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:54.331079 31769 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:54.308207 29395 rpcz_store.cc:276] 0709 13:12:52.084323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.091901 (+  7578us) service_pool.cc:224] Handling call
0709 13:12:52.111366 (+ 19465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.118844 (+  7478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.118881 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.119404 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.157973 (+2038569us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:54.206728 (+ 48755us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.218816 (+ 12088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.246968 (+ 28152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.252692 (+  5724us) raft_consensus.cc:1685] finished
0709 13:12:54.252716 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.276399 (+ 23683us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7003,"prepare.queue_time_us":36454,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":68848,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":251,"thread_start_us":2017457,"threads_started":1,"wal-append.queue_time_us":2004543}
I20260709 13:12:54.378396 29435 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:54.378011 31662 raft_consensus.cc:3055] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:54.408617 31662 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:54.410275 31662 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.411808 31659 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.412773 31659 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.420579 31765 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:54.421470 31765 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:54.423877 31659 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:54.422319 29538 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:12:54.379168 31797 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:54.380012 31769 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:54.438467 31662 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:54.356304 29544 rpcz_store.cc:276] 0709 13:12:52.043314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.044494 (+  1180us) service_pool.cc:224] Handling call
0709 13:12:52.044881 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.045174 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:52.115261 (+ 70087us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.268164 (+2152903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:54.268308 (+   144us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:54.268476 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.268641 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.334456 (+ 65815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6354,"prepare.queue_time_us":829456,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":133391,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":20066,"thread_start_us":2175543,"threads_started":3,"wal-append.queue_time_us":1932436}
I20260709 13:12:54.447834 31234 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:54.448457 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 70300.2us
W20260709 13:12:54.446830 30126 connection.cc:256] RPC call timeout handler was delayed by -1.1754933150000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:12:54.453526 30126 connection.cc:256] RPC call timeout handler was delayed by -1.1754933150000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:12:54.453186 31234 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.464792 31234 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:54.466056 31693 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 3.621s	user 0.024s	sys 0.036s
I20260709 13:12:54.467428 31769 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:54.468827 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 101941us
I20260709 13:12:54.470144 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:54.470630 31668 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:54.471501 31668 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:54.472870 31527 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:54.475643 31731 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:54.476936 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:54.477734 30160 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:54.481171 31664 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:54.486269 31805 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.487272 31805 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.490701 31778 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:54.491393 31778 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:54.491928 31778 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:54.493489 30157 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:50.798228 29463 rpcz_store.cc:276] 0709 13:12:48.665020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.665172 (+   152us) service_pool.cc:224] Handling call
0709 13:12:48.665555 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.665880 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:48.792865 (+126985us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.428719 (+1635854us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b1800233680. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61ec3993c7 00007f61e89ab9a7 00007f61e89bb0bf 00007f61e89bb038
0709 13:12:50.641035 (+212316us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.782942 (+141907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.783018 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:50.783123 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.783220 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.783353 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74373,"prepare.queue_time_us":1756987,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":20851,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":34497,"spinlock_wait_cycles":11941760,"thread_start_us":459808,"threads_started":3}
I20260709 13:12:54.494323 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 423) took 2472 ms. Trace:
I20260709 13:12:54.474349 31668 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:54.503018 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:54.503660 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1779) took 2456 ms. Trace:
I20260709 13:12:54.490090 31762 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:54.506547 30157 rpcz_store.cc:276] 0709 13:12:52.022185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.124567 (+102382us) service_pool.cc:224] Handling call
0709 13:12:54.492530 (+2367963us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:54.492988 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.493965 (+   977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.494254 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4374272}
I20260709 13:12:54.507202 29389 rpcz_store.cc:276] 0709 13:12:52.048208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.057300 (+  9092us) service_pool.cc:224] Handling call
0709 13:12:52.073736 (+ 16436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.171754 (+2098018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.173802 (+  2048us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.257333 (+ 83531us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.357225 (+ 99892us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:54.357267 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.404606 (+ 47339us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.503317 (+ 98711us) raft_consensus.cc:1685] finished
0709 13:12:54.503349 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.503557 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6359,"raft.queue_time_us":101695,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":2117880,"threads_started":2,"wal-append.queue_time_us":207422}
W20260709 13:12:54.522231 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.547607 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.505695 31805 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:54.550228 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1783) took 2481 ms. Trace:
I20260709 13:12:54.550787 29388 rpcz_store.cc:276] 0709 13:12:52.068990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.069358 (+   368us) service_pool.cc:224] Handling call
0709 13:12:52.075052 (+  5694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.075280 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:54.243419 (+2168139us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.508232 (+264813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:54.521445 (+ 13213us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:54.549820 (+ 28375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.549946 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.550152 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239,"prepare.queue_time_us":1971670,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":115,"raft.queue_time_us":9137,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":203,"thread_start_us":2194601,"threads_started":2}
W20260709 13:12:54.553900 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 79469.2us
I20260709 13:12:54.556500 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:54.558645 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:54.559629 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:54.560056 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 51009.7us
I20260709 13:12:54.561100 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:54.525228 31234 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.564993 31234 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:54.569126 29469 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:12:54.568591 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1787) took 2472 ms. Trace:
W20260709 13:12:54.576779 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 125537us
I20260709 13:12:54.576995 29394 rpcz_store.cc:276] 0709 13:12:52.095890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.096019 (+   129us) service_pool.cc:224] Handling call
0709 13:12:52.096342 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.249406 (+2153064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.255123 (+  5717us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.277498 (+ 22375us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.407980 (+130482us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:54.452364 (+ 44384us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.454760 (+  2396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.458814 (+  4054us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.566704 (+107890us) raft_consensus.cc:1685] finished
0709 13:12:54.566727 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.568502 (+  1775us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11229,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":91596,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":50566,"thread_start_us":2179597,"threads_started":2,"wal-append.queue_time_us":283367}
I20260709 13:12:54.596735 31802 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:54.598805 31234 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:54.599581 31812 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:54.600231 31812 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:54.600577 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 510) took 2500 ms. Trace:
I20260709 13:12:54.600674 31812 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:54.601068 30151 rpcz_store.cc:276] 0709 13:12:52.099682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.238167 (+138485us) service_pool.cc:224] Handling call
0709 13:12:52.238797 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.571211 (+332414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.600069 (+2028858us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540025a8d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:54.600387 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762688256}
I20260709 13:12:54.604060 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:54.606101 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:54.607198 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:54.610045 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:54.610412 31762 consensus_queue.cc:1059] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:54.612681 31762 raft_consensus.cc:3055] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:54.613118 31762 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:54.613941 29466 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:54.614415 31762 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.616272 31762 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:54.535605 31747 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:12:54.622008 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:54.624011 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:54.625034 31662 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:54.625957 31662 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:54.633033 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1784) took 2557 ms. Trace:
I20260709 13:12:54.634979 30160 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:54.641341 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50425.7us
W20260709 13:12:54.641608 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 106372us
I20260709 13:12:54.644392 29438 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:54.648967 31747 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:54.646045 30123 leader_election.cc:336] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.965s (SENT)
W20260709 13:12:54.663584 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 310406us
I20260709 13:12:54.662101 31747 raft_consensus.cc:697] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:54.692777 31747 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:12:54.717408 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71399.9us
I20260709 13:12:54.727596 31778 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:54.730052 31526 raft_consensus.cc:3055] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:54.730640 31526 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:54.730690 31778 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:54.731777 30159 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:54.732612 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 506) took 3323 ms. Trace:
I20260709 13:12:54.732170 31526 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.733683 31526 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:54.752002 31812 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:54.724144 31701 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 3.870s	user 0.028s	sys 0.064s
W20260709 13:12:54.754186 31701 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 3.910s	user 0.028s	sys 0.065s
I20260709 13:12:54.768172 31812 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:54.778776 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1724) took 3536 ms. Trace:
I20260709 13:12:54.779367 29468 rpcz_store.cc:276] 0709 13:12:51.242221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.373217 (+130996us) service_pool.cc:224] Handling call
0709 13:12:51.373676 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.466072 (+ 92396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.466112 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.720814 (+3254702us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b2c000d7278. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e729aa11 00007f61e72aa372 00007f61e89dca01 00007f61e89a143a 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2
0709 13:12:54.721435 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.761552 (+ 40117us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:54.761607 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.761746 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.778240 (+ 16494us) raft_consensus.cc:1685] finished
0709 13:12:54.778266 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.778544 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110237,"raft.queue_time_us":83637,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":31667,"spinlock_wait_cycles":3806976,"thread_start_us":39296,"threads_started":1,"wal-append.queue_time_us":45849}
W20260709 13:12:54.801285 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 127426us
I20260709 13:12:54.802767 31736 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:54.803766 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.804032 31736 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:54.804518 31736 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:54.807613 31736 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:54.947788 31758 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:54.633632 29391 rpcz_store.cc:276] 0709 13:12:52.075213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.075402 (+   189us) service_pool.cc:224] Handling call
0709 13:12:52.086248 (+ 10846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.097631 (+ 11383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.097676 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.106013 (+  8337us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.101862 (+1995849us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:54.103251 (+  1389us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.104112 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.104506 (+   394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.504535 (+400029us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b1800385240. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b4522 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:12:54.590131 (+ 85596us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b240011e1a8. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e573a9c4 00007f61e5738acb 00007f61e58f3dc9 00007f61e58f3a55 00007f61e58f2fb0 00007f61e8569488 00007f61e8569be8 00007f61e8541398 00007f61e853c76a 00007f61e853bbb6
0709 13:12:54.632633 (+ 42502us) raft_consensus.cc:1685] finished
0709 13:12:54.632663 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.632915 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":285,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":94,"raft.queue_time_us":91077,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":24706,"spinlock_wait_cycles":59652608,"thread_start_us":1974052,"threads_started":1,"wal-append.queue_time_us":2019413}
W20260709 13:12:54.960373 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.962427 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.962913 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.978976 31718 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:54.991753 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 500) took 3650 ms. Trace:
I20260709 13:12:54.992285 30154 rpcz_store.cc:276] 0709 13:12:51.341165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.342892 (+  1727us) service_pool.cc:224] Handling call
0709 13:12:51.343294 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.639515 (+296221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.991301 (+3351786us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400271354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:54.991597 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678820608}
W20260709 13:12:55.023422 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.038570 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.041651 31810 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.042413 31810 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:55.045509 31810 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:55.061678 31597 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:55.064798 31597 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:55.081578 30158 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:55.082594 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 653) took 3073 ms. Trace:
I20260709 13:12:55.082930 30158 rpcz_store.cc:276] 0709 13:12:52.009500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.010428 (+   928us) service_pool.cc:224] Handling call
0709 13:12:55.080860 (+3070432us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:55.081209 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:55.082228 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.082522 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29071744}
I20260709 13:12:55.096016 31597 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:55.101014 31597 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:55.162518 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1807) took 3730 ms. Trace:
I20260709 13:12:55.163172 29537 rpcz_store.cc:276] 0709 13:12:51.432032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.434320 (+  2288us) service_pool.cc:224] Handling call
0709 13:12:51.434835 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.435314 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.435358 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.436009 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.098298 (+3662289us) spinlock_profiling.cc:243] Waited 983 us on lock 0x7b180037ee80. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:12:55.128493 (+ 30195us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:55.128622 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.128784 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.128837 (+    53us) raft_consensus.cc:1685] finished
0709 13:12:55.128873 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.162249 (+ 33376us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":15645,"spinlock_wait_cycles":2260224,"thread_start_us":29758,"threads_started":1,"wal-append.queue_time_us":3675133}
W20260709 13:12:55.165163 29509 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.687s (SENT)
W20260709 13:12:55.175537 29509 connection.cc:256] RPC call timeout handler was delayed by -2.4823265040001843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:12:55.176455 29509 connection.cc:256] RPC call timeout handler was delayed by -2.3491265040001963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 13:12:55.177438 29509 connection.cc:256] RPC call timeout handler was delayed by -2.2906265040001017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 13:12:55.177802 29509 connection.cc:256] RPC call timeout handler was delayed by -2.2744265040000755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22519999999999998s for a response
W20260709 13:12:55.178103 29509 connection.cc:256] RPC call timeout handler was delayed by -2.2054069880000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:12:55.178400 29509 connection.cc:256] RPC call timeout handler was delayed by -2.0350265040001432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25179999999999997s for a response
W20260709 13:12:55.178743 29509 connection.cc:256] RPC call timeout handler was delayed by -1.9801265040002818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2579s for a response
W20260709 13:12:55.179049 29509 connection.cc:256] RPC call timeout handler was delayed by -1.7074265040000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2882s for a response
I20260709 13:12:55.182616 31737 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:55.183495 31737 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:55.186890 29537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48414
I20260709 13:12:55.187858 29537 raft_consensus.cc:606] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:12:55.188190 29537 raft_consensus.cc:614] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:55.188520 31810 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:55.189265 31810 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:55.192673 31733 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:55.193400 31733 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:55.194227 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 136256us
W20260709 13:12:55.204524 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.205158 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.210945 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.212908 29539 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:55.186192 31737 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:55.278301 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.279335 29469 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:55.279335 29463 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:12:55.280992 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:55.281416 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:55.281680 29463 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:55.282074 29469 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:55.286370 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.287427 31508 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:55.287863 31508 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:55.289103 31508 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:55.290138 31508 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:55.291329 30155 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:55.293002 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1607) took 5026 ms. Trace:
I20260709 13:12:55.293408 29471 rpcz_store.cc:276] 0709 13:12:50.266225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.488212 (+221987us) service_pool.cc:224] Handling call
0709 13:12:50.489296 (+  1084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.524410 (+ 35114us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:50.770981 (+246571us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.921584 (+150603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.921738 (+   154us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:50.921869 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.333522 (+411653us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180031bc40. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:12:55.292470 (+3958948us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b54003b5e54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:12:55.292546 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.292777 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83085,"prepare.queue_time_us":82782,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":27080,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":49374,"spinlock_wait_cycles":105901696,"thread_start_us":339579,"threads_started":3,"wal-append.queue_time_us":178049,"wal-append.run_cpu_time_us":1166,"wal-append.run_wall_time_us":1036207}
I20260709 13:12:55.295159 30158 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:55.295538 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.296497 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:55.297596 30154 raft_consensus.cc:2410] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:55.298885 31740 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.299547 31740 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:55.302660 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.303117 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:55.302271 31740 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:55.303966 30156 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:55.303901 31740 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:55.304471 31740 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.306922 31740 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:55.307407 31740 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:12:55.304489 30156 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 658) took 3265 ms (client timeout 1810 ms). Trace:
W20260709 13:12:55.308826 30156 rpcz_store.cc:269] 0709 13:12:52.039588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.040097 (+   509us) service_pool.cc:224] Handling call
0709 13:12:55.302767 (+3262670us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:12:55.304394 (+  1627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32259840}
I20260709 13:12:55.302376 30152 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:55.307911 31740 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.318266 29537 raft_consensus.cc:1275] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:12:55.322811 29537 pending_rounds.cc:85] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 1
I20260709 13:12:55.323143 29537 pending_rounds.cc:107] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:12:55.323446 29537 raft_consensus.cc:2889] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:55.319514 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:55.351511 29463 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
W20260709 13:12:55.365175 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.483693 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.537573 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.563218 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:55.432520 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:55.431923 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:55.583848 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:55.588094 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.356698 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:55.591557 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.592202 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.352006 29469 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:12:55.559181 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:55.588425 30123 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.662s (SENT) [suppressed 36 similar messages]
I20260709 13:12:55.431013 31780 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 13:12:55.378603 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:55.603432 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.604235 29465 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:55.604943 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:55.605626 29466 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:12:55.605953 31740 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:55.505081 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 93590.4us
I20260709 13:12:55.608515 29467 raft_consensus.cc:2393] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:55.602662 31678 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:55.404189 31615 consensus_queue.cc:1059] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 13:12:55.602671 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:55.618984 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.431274 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:55.623880 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.528995 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.502851 31733 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:55.606526 31740 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.403668 31570 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.225s
I20260709 13:12:55.628448 31740 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.629635 31570 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:55.621927 29463 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:55.630402 31570 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:55.631557 31570 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.639120 29468 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:55.639834 29470 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:55.652817 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:55.654452 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4239265040000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31970000000000004s for a response
W20260709 13:12:55.654999 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2464070539999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:12:55.655444 29509 connection.cc:256] RPC call timeout handler was delayed by -1.1276070540000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 13:12:55.655818 29509 connection.cc:256] RPC call timeout handler was delayed by -1.111407053999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 13:12:55.607967 31810 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:55.647553 31805 consensus_queue.cc:1059] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:12:55.657938 31805 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.711437 29537 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:55.730630 29470 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:12:55.733672 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.655891 31570 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:55.658819 31805 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:55.752478 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51894us
W20260709 13:12:55.753665 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 322588us
I20260709 13:12:55.732117 31615 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:55.741863 31740 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:55.770614 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.772267 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:55.758630 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.651448 31678 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.760076 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:55.761207 30151 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:55.761006 31490 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:12:55.761803 31596 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:12:55.762511 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.771016 31740 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:55.796952 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 208574us
I20260709 13:12:55.765861 31756 raft_consensus.cc:3055] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:55.757685 31838 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:54.733057 30159 rpcz_store.cc:276] 0709 13:12:51.409495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.414228 (+  4733us) service_pool.cc:224] Handling call
0709 13:12:54.730929 (+3316701us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:12:54.731243 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:54.732291 (+  1048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.732547 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8124800}
I20260709 13:12:55.791815 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:55.795156 29537 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:55.800853 29463 raft_consensus.cc:2410] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:12:55.798334 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 193536us
W20260709 13:12:55.771054 29326 debug-util.cc:398] Leaking SignalData structure 0x7b0800038560 after lost signal to thread 28253
W20260709 13:12:55.803169 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08000385e0 after lost signal to thread 29329
I20260709 13:12:55.811779 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.799249 31756 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:55.819553 31756 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.820859 31756 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:55.821019 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.799443 31740 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:55.824945 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:55.825657 29544 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:55.805487 31838 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:55.822880 31596 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:12:55.827512 31838 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.829083 31838 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:55.829350 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.832633 31718 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:55.833039 31718 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:55.834075 31718 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:55.835412 31718 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:55.840906 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49190us
W20260709 13:12:55.841742 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.843706 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.845062 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:55.848205 30126 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:55.850533 31490 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:12:55.854683 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.823515 31526 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:55.822825 31740 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:55.898939 29543 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:12:55.905262 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45577.4us
I20260709 13:12:55.863489 31526 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:55.906358 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:55.911298 29538 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:55.910508 31526 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:55.929657 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 103985us
I20260709 13:12:55.933041 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.933856 29468 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:12:55.933955 29543 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:55.948199 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:55.924537 31805 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:55.924355 31765 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:55.948572 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:55.969308 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.972222 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:55.983067 31596 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:55.983600 31596 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:55.983973 31596 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:55.986918 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:55.987990 29545 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:55.989084 31834 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 13:12:55.991293 31832 log.cc:927] Time spent T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:12:55.995127 29538 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
W20260709 13:12:55.996587 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.001673 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.006388 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:56.007350 29538 raft_consensus.cc:2393] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:12:56.014101 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 105144us
I20260709 13:12:55.978485 31678 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:56.023316 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.005364 31850 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:56.034756 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 125211us
I20260709 13:12:56.033555 31678 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.039820 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:56.032742 31834 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:56.048520 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.033952 31850 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:56.050962 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 83023.2us
I20260709 13:12:56.049995 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:56.054309 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:56.054656 29326 debug-util.cc:398] Leaking SignalData structure 0x7b0800039020 after lost signal to thread 29421
W20260709 13:12:56.046083 31842 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:12:56.057042 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08003adac0 after lost signal to thread 29496
W20260709 13:12:56.059362 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.065102 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad9e0 after lost signal to thread 29497
I20260709 13:12:56.073251 29537 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:12:56.075330 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:56.036629 31678 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.075927 29512 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:56.082924 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:56.056612 31570 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:56.084694 31841 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:56.096444 31841 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:56.098253 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:56.057555 31834 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:56.085243 31852 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:56.102906 31852 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:56.102736 31834 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.103595 31852 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:56.104247 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:56.105806 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:56.085657 31776 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:12:56.087757 31830 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:12:56.087137 31839 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:12:56.097821 31841 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.111017 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:56.111742 29545 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 1.
I20260709 13:12:56.112717 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:56.113554 29545 raft_consensus.cc:2410] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:56.057070 31850 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:56.080672 31596 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:56.118938 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.557s	user 0.024s	sys 0.037s
I20260709 13:12:56.136631 31847 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:56.138370 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 62521.4us
I20260709 13:12:56.158771 31596 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:56.159866 31737 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:56.160398 31737 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.160772 31737 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:56.161969 31678 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:56.162796 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 57128us
I20260709 13:12:56.163851 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:56.164683 31570 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:56.165606 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.166047 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.166647 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 104181us
I20260709 13:12:56.167791 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:56.168526 31847 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.171000 31678 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:56.175318 29544 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
W20260709 13:12:56.179263 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.171706 31678 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:56.194778 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.633s	user 0.025s	sys 0.037s
I20260709 13:12:56.196558 29537 raft_consensus.cc:1240] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:56.189307 31756 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:56.189306 31765 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:56.203806 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:56.205802 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:56.207880 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.213791 29463 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
W20260709 13:12:56.216687 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.216897 30126 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:56.222898 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:56.224817 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:56.202585 31756 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.219344 29469 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
W20260709 13:12:56.226979 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 1.66601e+06us
I20260709 13:12:56.195055 31850 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:56.238299 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 74569.3us
I20260709 13:12:56.219391 31596 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:56.249251 31678 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.235836 31756 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:56.253746 29540 raft_consensus.cc:2410] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:56.286769 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:56.286708 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 74732.4us
I20260709 13:12:56.293032 31765 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:56.324352 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.327083 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.540s (SENT)
I20260709 13:12:56.330084 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:56.325116 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 107900us
I20260709 13:12:56.329216 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:56.331674 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.332319 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.289804 31596 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:56.331964 31847 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:56.366641 31860 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:12:56.367169 31866 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:12:56.367488 31829 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
W20260709 13:12:56.371030 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 128082us
W20260709 13:12:56.371274 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.375253 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 50445.2us
W20260709 13:12:56.375865 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 48845.1us
I20260709 13:12:56.326576 31526 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:56.398603 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 69369.2us
I20260709 13:12:56.399554 31847 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.400570 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:56.404027 31853 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:12:56.362304 31859 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:56.405642 31596 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:56.406059 31859 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:56.406333 31596 raft_consensus.cc:2764] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:12:56.330991 31765 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.368875 31829 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:56.431571 31829 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:56.431732 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:56.432746 31829 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.433758 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:56.420079 31850 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:56.421061 29394 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:56.421995 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.422684 31642 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:56.422829 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.423300 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:56.423650 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.462652 29393 raft_consensus.cc:2410] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:56.424116 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:56.424940 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.430950 31378 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:56.387363 31836 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:56.468559 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:56.469437 29469 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:56.468611 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:56.471220 29389 raft_consensus.cc:2393] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:56.473097 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:56.473834 29390 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:56.474659 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:56.475517 30154 raft_consensus.cc:2393] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:56.406653 31859 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.438169 31855 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:56.437754 31740 consensus_meta.cc:287] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:12:56.434259 31829 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:56.478679 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65501.6us
I20260709 13:12:56.439961 31526 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:56.499372 30123 leader_election.cc:336] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.630s (SENT)
W20260709 13:12:56.501873 30126 leader_election.cc:336] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.995s (SENT)
I20260709 13:12:56.477535 31765 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:56.496683 31642 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:56.515885 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.445256 31852 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.437716 31737 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:56.500315 31836 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:56.520018 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:56.520855 30157 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:56.526420 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2440 after lost signal to thread 29570
W20260709 13:12:56.526827 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08003930a0 after lost signal to thread 29571
W20260709 13:12:56.528290 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08003814e0 after lost signal to thread 30184
W20260709 13:12:56.528607 29326 debug-util.cc:398] Leaking SignalData structure 0x7b0800381420 after lost signal to thread 30185
I20260709 13:12:56.501058 31740 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.518519 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:56.534917 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:56.517699 31642 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:56.539988 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.541805 31736 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.541496 31836 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.546707 30154 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:56.548063 30159 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:56.549355 31740 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:56.552240 31737 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:12:56.554005 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.537928 30126 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:56.555300 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:56.556165 29463 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:56.557696 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:56.564446 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:56.566337 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 132696us
I20260709 13:12:56.570016 30126 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:56.573556 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.573770 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58393.1us
I20260709 13:12:56.579896 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.558377 31642 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:56.567771 31740 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:56.584789 29509 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.595s (SENT)
I20260709 13:12:56.571847 31765 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:56.572300 31678 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:56.614063 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:56.626199 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.587039 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.629083 29390 raft_consensus.cc:2393] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:56.630584 30123 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.748s (SENT)
I20260709 13:12:56.576438 31875 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:56.618712 31850 consensus_queue.cc:1059] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:56.613353 31765 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.665879 31765 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.621516 29394 raft_consensus.cc:2410] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:56.667313 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.667999 29394 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:56.668967 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.669703 29394 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:56.672505 31883 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:56.673331 31883 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:56.621697 29395 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:56.622399 29389 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:56.624264 31852 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:56.624410 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.675776 29396 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:56.627316 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:12:56.614379 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.586416 31740 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:56.632607 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:56.677050 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 49815.3us
I20260709 13:12:56.639217 31570 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:56.639726 29294 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 175) took 11704 ms (client timeout 15000 ms). Trace:
I20260709 13:12:56.581341 31508 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:12:56.694803 31850 raft_consensus.cc:3055] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:56.695397 31850 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:56.680166 31740 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:56.696471 31850 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.697887 31850 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.703495 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.704632 29390 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:56.705782 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.631405 31878 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:56.655835 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.658869 29463 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:12:56.676709 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.629705 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:56.678782 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:56.681946 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:56.711032 29390 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:56.678202 30126 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:56.683279 29397 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:12:56.684487 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:56.714011 29512 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:56.714608 29394 raft_consensus.cc:2368] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 5.
I20260709 13:12:56.713316 29392 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:56.641670 31875 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:12:56.718613 31875 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.719553 31642 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.722091 31642 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:56.716272 29391 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:12:56.712771 29397 pending_rounds.cc:85] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 3
I20260709 13:12:56.723038 29397 pending_rounds.cc:107] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:12:56.723039 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:56.715613 31834 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:56.724695 31834 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:56.727053 31834 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:56.727639 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:56.728260 29464 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:56.682747 29294 rpcz_store.cc:269] 0709 13:12:44.935020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.936096 (+  1076us) service_pool.cc:224] Handling call
0709 13:12:56.639467 (+11703371us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:49.053491 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:49.158284 (+104793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:49.161159 (+  2875us) write_op.cc:435] Acquired schema lock
0709 13:12:49.164965 (+  3806us) tablet.cc:662] Decoding operations
0709 13:12:49.555807 (+390842us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:49.559601 (+  3794us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:49.567848 (+  8247us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:12:49.786993 (+219145us) tablet.cc:701] Row locks acquired
0709 13:12:49.788585 (+  1592us) write_op.cc:260] PREPARE: finished
0709 13:12:49.797524 (+  8939us) write_op.cc:270] Start()
0709 13:12:49.804214 (+  6690us) write_op.cc:276] Timestamp: P: 1783602769796042 usec, L: 0
0709 13:12:49.807353 (+  3139us) op_driver.cc:348] REPLICATION: starting
0709 13:12:49.891870 (+ 84517us) log.cc:844] Serialized 2920 byte log entry
0709 13:12:50.844049 (+952179us) op_driver.cc:464] REPLICATION: finished
0709 13:12:54.566941 (+3722892us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e58970ac 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61ec3d7ef0
0709 13:12:54.759146 (+192205us) write_op.cc:301] APPLY: starting
0709 13:12:54.759330 (+   184us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:54.759769 (+   439us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:54.759811 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:54.761603 (+  1792us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:54.762039 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:12:54.762097 (+    58us) write_op.cc:312] APPLY: finished
0709 13:12:54.762858 (+   761us) log.cc:844] Serialized 59 byte log entry
0709 13:12:54.769740 (+  6882us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:54.770068 (+   328us) write_op.cc:454] Released schema lock
0709 13:12:54.770154 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:54.775123 (+  4969us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:54.775171 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1037,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":3914711,"apply.run_cpu_time_us":10902,"apply.run_wall_time_us":15944,"num_ops":7,"prepare.queue_time_us":97703,"prepare.run_cpu_time_us":20704,"prepare.run_wall_time_us":1009497,"raft.queue_time_us":327584,"raft.run_cpu_time_us":93211,"raft.run_wall_time_us":3912502,"replication_time_us":1036496,"spinlock_wait_cycles":46934912,"thread_start_us":4247075,"threads_started":5,"wal-append.queue_time_us":244934,"wal-append.run_cpu_time_us":31565,"wal-append.run_wall_time_us":2634212}]]}
I20260709 13:12:56.723377 29397 raft_consensus.cc:2889] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:56.731110 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 149958us
W20260709 13:12:56.731980 29509 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.727s (SENT)
I20260709 13:12:56.732419 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:56.733054 29509 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.745s (SENT)
I20260709 13:12:56.733269 29397 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:12:56.733526 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:56.717939 31836 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:56.674789 31810 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.725196 29465 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:56.735108 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:56.735103 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 50773.4us
I20260709 13:12:56.736119 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1746) took 1146 ms. Trace:
W20260709 13:12:56.739297 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.717875 31629 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:56.747130 31566 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.747689 31566 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:56.726552 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.730731 31883 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:56.741626 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.741791 31736 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:56.708932 31878 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.734934 31810 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.736534 29465 rpcz_store.cc:276] 0709 13:12:55.589784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.724615 (+1134831us) service_pool.cc:224] Handling call
0709 13:12:56.724991 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.735874 (+ 10883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.736057 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:56.763149 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:56.711532 31876 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:56.744885 31756 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:56.745775 31859 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:56.750193 30123 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.901s (SENT)
W20260709 13:12:56.768980 30123 leader_election.cc:336] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.963s (SENT)
I20260709 13:12:56.752259 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:56.744457 31863 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.514s	user 0.005s	sys 0.000s
W20260709 13:12:56.763899 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.763980 29463 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:56.765389 29388 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:56.766685 29397 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.771032 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.768047 29470 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:56.769794 30123 leader_election.cc:336] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.966s (SENT)
I20260709 13:12:56.776451 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:56.776674 30123 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.020s (SENT)
I20260709 13:12:56.777683 31883 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:56.780314 31566 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:56.782042 31611 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:56.782511 31611 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:56.783561 31611 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.786247 31847 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:56.786791 31736 consensus_queue.cc:1059] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:56.787714 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:56.787943 31736 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:56.788375 31736 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:56.788877 31837 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:56.789310 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:56.789299 31837 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.789987 31837 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.790216 29543 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:56.766083 31878 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:56.791993 31859 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:56.755612 31629 raft_consensus.cc:697] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:56.792729 30160 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:56.794456 29392 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:56.797209 29394 raft_consensus.cc:2410] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:56.799978 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.800586 29391 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:56.805178 29393 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:56.805806 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.065s (SENT)
I20260709 13:12:56.807972 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.808605 29392 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:12:56.809541 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 76498.2us
W20260709 13:12:56.811534 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 56510.8us
I20260709 13:12:56.811892 31668 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:56.812413 31668 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.812754 31668 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.840685 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:56.842010 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.843266 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:56.844292 31810 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:56.844537 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.806321 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:56.797740 31629 consensus_queue.cc:237] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:56.776106 31870 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:56.853780 29396 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:56.847282 31615 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:12:56.854954 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:56.849864 29388 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:56.847855 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46807.4us
I20260709 13:12:56.867594 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.869933 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.870749 29394 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:56.868317 29391 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:56.875339 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.875499 29464 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:56.876444 29397 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:56.845772 31740 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.903049 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.906363 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.919804 29396 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:56.924639 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49735.1us
I20260709 13:12:56.925956 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:56.923877 29509 leader_election.cc:336] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.902s (SENT)
I20260709 13:12:56.924028 29472 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:56.926843 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.924064 29393 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:12:56.928728 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 122952us
I20260709 13:12:56.929714 29391 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:56.789302 31736 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.931892 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.932701 30156 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:56.935604 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:56.936148 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.936327 29463 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.936652 29392 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:56.933434 29470 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:12:56.938508 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 69791.5us
I20260709 13:12:56.938944 29396 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:12:56.944092 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.945591 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:56.940508 31690 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:56.946998 29467 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:56.947647 29388 raft_consensus.cc:2393] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:56.948309 29509 leader_election.cc:336] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.944s (SENT)
W20260709 13:12:56.949515 29509 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.021s (SENT)
I20260709 13:12:56.949898 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:56.943502 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:56.930791 31891 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:12:56.960047 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.937983 31611 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:56.980254 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.963131 31718 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.983189 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.982636 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.986096 29392 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:56.988371 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:56.989568 29396 raft_consensus.cc:2410] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:56.970782 31876 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:56.992884 29463 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:56.935571 31834 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:56.973315 31737 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:57.001740 30123 leader_election.cc:336] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.248s (SENT)
I20260709 13:12:57.002481 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.002260 30123 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:57.003201 29396 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:12:57.004985 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.008314 29392 raft_consensus.cc:2410] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:57.007220 30126 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:57.015017 29388 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:57.017630 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 68141.1us
I20260709 13:12:57.025419 29392 raft_consensus.cc:1240] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:56.996179 31780 consensus_queue.cc:1059] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:57.026700 31780 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:57.027092 31780 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:57.028012 31780 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.029428 31780 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:57.030948 29509 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.055s (SENT)
I20260709 13:12:57.031435 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:57.033741 29509 leader_election.cc:336] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.252s (SENT)
I20260709 13:12:56.997815 31859 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:12:57.034629 31629 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:57.007675 31756 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:56.997748 31678 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:12:57.017252 31668 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.037564 31668 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:57.037276 31837 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.038916 29392 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:57.041525 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.042538 31837 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:57.043303 29543 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:12:57.043706 29394 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:12:57.044770 31690 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:57.034179 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:57.079805 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 46114.5us
W20260709 13:12:57.080502 29509 connection.cc:256] RPC call timeout handler was delayed by -2.0090885479999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.325s for a response
W20260709 13:12:57.081214 29509 leader_election.cc:336] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.518s (SENT)
I20260709 13:12:57.081322 31690 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.052580 29393 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:57.082499 31837 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.052250 29392 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:57.083034 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.083801 29393 raft_consensus.cc:1275] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:12:57.083806 29391 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:57.084429 29392 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:57.085134 29391 raft_consensus.cc:3055] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:57.085316 29393 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:57.085513 29391 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:57.085618 29392 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:57.086387 29391 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:57.067775 31834 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:57.019975 31891 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.024410 31841 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:57.087144 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.088721 31841 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:57.055938 29388 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:57.089799 31841 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.090961 31875 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.091779 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.092944 30152 raft_consensus.cc:1240] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:57.029071 31765 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.081766 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.083834 31878 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.096256 31765 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:57.096695 29509 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.579s (SENT)
I20260709 13:12:57.097160 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.000475 31718 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:57.100157 31718 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:57.101131 29396 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:57.101935 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:57.102356 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.102595 29464 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.102703 31740 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:57.103528 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.096369 31837 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:57.107139 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:57.100013 31570 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:57.108408 29389 raft_consensus.cc:2368] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
W20260709 13:12:57.087018 29435 connection.cc:256] RPC call timeout handler was delayed by -3.6237222849999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 13:12:57.098366 29391 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.110924 29393 raft_consensus.cc:3055] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:57.118095 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:57.119700 29435 connection.cc:256] RPC call timeout handler was delayed by -3.6219222849999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:12:57.120090 29435 connection.cc:256] RPC call timeout handler was delayed by -3.5535222849998718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:12:57.120481 29435 connection.cc:256] RPC call timeout handler was delayed by -3.392422285000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 13:12:57.120574 29393 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:57.120865 29435 connection.cc:256] RPC call timeout handler was delayed by -3.3618222850000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:12:57.121233 29435 connection.cc:256] RPC call timeout handler was delayed by -3.3150222849999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:12:57.121560 29435 connection.cc:256] RPC call timeout handler was delayed by -3.293422284999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:12:57.126904 29435 connection.cc:256] RPC call timeout handler was delayed by -3.0837222850000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 13:12:57.127311 29435 connection.cc:256] RPC call timeout handler was delayed by -2.997322284999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 13:12:57.128582 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.134941 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:57.135913 30154 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:57.137456 31765 consensus_queue.cc:1059] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:57.139846 29396 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:12:57.140468 29392 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:57.090222 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.152418 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:57.153146 30160 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.152540 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:57.102358 31895 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:12:57.155750 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:57.156836 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.160060 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.138757 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:12:57.162670 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 55642.4us
I20260709 13:12:57.160929 30159 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:12:57.139861 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:57.168543 30151 raft_consensus.cc:2410] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:12:57.170708 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74072.9us
I20260709 13:12:57.152694 31883 raft_consensus.cc:3055] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:57.171661 31883 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:57.172663 31883 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.175097 29464 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:57.176702 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:57.177407 30158 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:57.177608 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:57.178918 31733 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:57.179348 31733 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.179693 31733 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:57.119122 31570 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:57.183728 31570 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.185297 31570 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.170727 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.187701 31668 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.188323 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.190248 31772 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.194236 29394 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:57.170933 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:57.198315 29463 raft_consensus.cc:606] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.198181 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.198952 29463 raft_consensus.cc:614] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:57.199779 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.200191 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:57.172676 29509 leader_election.cc:336] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 3.197s (SENT)
I20260709 13:12:57.206139 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.207998 29509 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:57.209254 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.174108 31883 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.214334 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.215840 29388 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:57.216696 29397 raft_consensus.cc:2410] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:57.217859 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.154512 31629 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:57.218806 29397 raft_consensus.cc:2376] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6. Re-sending same reply.
I20260709 13:12:57.222349 30159 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.223385 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.224407 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.224622 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.225603 29388 raft_consensus.cc:2410] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:12:57.227901 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.237255 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.243922 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.247862 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.220238 31490 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:57.252781 30160 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:57.215608 31876 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:57.257315 29388 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:12:57.259464 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:57.231030 31867 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:57.241164 31837 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.231462 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:57.263123 29388 pending_rounds.cc:85] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 4
W20260709 13:12:57.268137 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 95497.3us
I20260709 13:12:57.258620 30151 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:12:57.269979 29388 pending_rounds.cc:107] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:12:57.261446 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.270368 29388 raft_consensus.cc:2889] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.274209 31870 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.276384 29396 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:57.278694 31733 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.281618 31733 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:57.283246 31876 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.285447 29391 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:12:57.285844 29391 pending_rounds.cc:85] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 1
I20260709 13:12:57.286109 29391 pending_rounds.cc:107] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:57.286347 29391 raft_consensus.cc:2889] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.286792 30152 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:12:57.266953 31611 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:57.289714 31611 raft_consensus.cc:697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:57.290753 31611 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.293464 31772 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.296452 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.271195 31837 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.298913 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.299273 31837 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:57.300108 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.300752 29395 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:57.301730 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.303547 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.304840 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.305720 29388 raft_consensus.cc:2410] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:12:57.310716 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.313310 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.313491 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.313964 29397 raft_consensus.cc:2376] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5. Re-sending same reply.
I20260709 13:12:57.314301 29391 raft_consensus.cc:2410] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:57.314893 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.315047 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:57.316039 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:57.316295 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.316705 29540 raft_consensus.cc:2376] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6. Re-sending same reply.
I20260709 13:12:57.316998 29388 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:12:57.317826 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:12:57.318248 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 56942us
I20260709 13:12:57.319280 29388 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:57.320315 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.320933 29396 raft_consensus.cc:2376] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3. Re-sending same reply.
I20260709 13:12:57.318279 29389 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:57.317840 29393 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.338958 29393 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.339663 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.340458 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:12:57.332151 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.341295 29391 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:12:57.322407 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.316018 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.342888 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.344259 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.344988 29394 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:57.348315 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:57.348963 29546 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:12:57.353544 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.349249 29395 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:12:57.356266 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:57.358003 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:57.358882 29545 raft_consensus.cc:2368] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6.
I20260709 13:12:57.359982 31629 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:57.360333 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.360554 31629 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:57.361863 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:57.361644 31629 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.355561 31686 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:12:57.362854 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:57.361193 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:57.363875 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:57.363072 29292 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 5 to 6, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 6 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.364786 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.363070 29543 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:57.367707 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.365025 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:57.366170 29541 raft_consensus.cc:2376] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4. Re-sending same reply.
I20260709 13:12:57.375726 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:57.376358 29539 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:57.376603 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:57.377202 29463 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:57.379349 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:57.379946 29539 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:57.379814 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:57.380529 29464 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:57.382896 30156 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:57.387058 29464 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:57.386842 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:57.388191 29541 raft_consensus.cc:2376] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5. Re-sending same reply.
I20260709 13:12:57.390714 29512 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:57.391247 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:57.394181 31878 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:57.394222 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:57.396958 30157 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.397646 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:57.400117 29539 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:12:57.401854 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:57.406567 29394 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:57.407766 29389 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
W20260709 13:12:57.409943 29509 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 3.250s (SENT)
I20260709 13:12:57.410637 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:57.411413 29546 raft_consensus.cc:2410] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:12:57.415781 29343 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7c2e8d3e55c649e2b3acedef25d81e16 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:12:57.416326 29343 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:12:57.416637 29343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:12:57.416469 31837 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:57.418126 29463 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:12:57.415807 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:57.424507 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:57.427886 30152 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:57.427942 31642 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:57.428135 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 63439.4us
I20260709 13:12:57.430933 31736 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:57.463604 31897 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.327s	user 0.004s	sys 0.009s
I20260709 13:12:57.465271 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:57.425148 31875 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:57.414990 31829 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:57.417848 31878 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.467041 31829 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.468478 31829 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:57.463150 29292 catalog_manager.cc:5697] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 4, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 4 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.439332 30126 leader_election.cc:400] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6.
I20260709 13:12:57.470654 31718 consensus_queue.cc:1059] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:57.472764 31676 raft_consensus.cc:3055] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:57.473122 31676 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:57.424760 31805 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:57.474103 31676 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:57.458559 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.462270 31642 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.462903 30151 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:57.475414 31676 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:57.471339 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.470649 30126 leader_election.cc:403] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:57.487321 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 60532.6us
I20260709 13:12:57.488931 31875 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:57.489054 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:57.486739 29292 catalog_manager.cc:5697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:12:57.490756 31878 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:57.490679 31899 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:57.475716 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.490425 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:57.493198 31899 raft_consensus.cc:2764] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:12:57.493691 30126 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:57.494565 31899 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:57.491165 29292 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:12:57.499897 29435 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:57.499397 31676 consensus_queue.cc:1059] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:57.500813 31772 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:57.501586 31675 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:57.502180 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:57.502064 31772 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:57.502954 31772 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.503123 31899 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:57.503657 31899 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.504130 31899 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:57.504765 29292 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:57.458357 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47376.1us
I20260709 13:12:57.508299 29292 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 4, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 4 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.518278 30159 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:12:57.516480 29393 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:12:57.519723 29393 pending_rounds.cc:85] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 3
I20260709 13:12:57.520079 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:57.521426 31867 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:57.521502 31718 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:57.522125 31867 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:57.522697 31718 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:57.519083 30159 pending_rounds.cc:85] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 3
I20260709 13:12:57.516144 31668 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:57.515760 31733 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:57.517841 31611 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:57.536932 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.537869 31642 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:57.540025 31642 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:57.526803 30159 pending_rounds.cc:107] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:12:57.549701 30159 raft_consensus.cc:2917] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:12:57.550267 30159 raft_consensus.cc:2889] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.521015 29393 pending_rounds.cc:107] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:12:57.550810 29393 raft_consensus.cc:2917] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:12:57.551244 29393 raft_consensus.cc:2889] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.551151 29392 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:12:57.517812 31675 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:12:57.535096 31757 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:57.533340 31668 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:57.560303 29464 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:12:57.525913 31686 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:12:57.559092 31718 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:12:57.544533 31733 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:57.525775 31862 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:12:57.571461 31668 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:57.572979 31668 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.554766 31805 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:12:57.575717 31867 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:57.576354 31867 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:57.531443 31490 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:12:57.566975 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.544849 31611 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.581151 31642 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:57.582700 31642 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:57.583949 31611 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:57.585274 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:57.585734 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:57.586339 30159 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
W20260709 13:12:57.600014 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.579921 31867 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:57.587886 31862 consensus_queue.cc:1243] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer 88760af579b54a6393c6251aa3c6b870 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:12:57.650174 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 123524us
W20260709 13:12:57.663172 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.597352 31737 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:12:57.667810 31733 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:57.675763 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.676369 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.678210 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:57.678933 29392 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.682194 30157 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:57.686138 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.687201 29360 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:57.689780 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:57.691010 29390 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:57.693737 29435 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:12:57.695243 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 156158us
I20260709 13:12:57.695308 29435 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:57.697108 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.698690 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:12:57.699411 29393 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:12:57.701638 30156 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:57.705438 29392 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:12:57.698830 31757 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:57.709069 31757 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:57.709611 31757 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.710778 29544 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:12:57.717684 31718 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:57.721101 31675 raft_consensus.cc:3055] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:57.721716 31675 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:57.727692 29395 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:12:57.733878 31870 raft_consensus.cc:3055] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:12:57.735419 31906 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:12:57.734303 31870 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:57.743446 30152 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:57.751693 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.752447 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.763157 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:57.764084 30159 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.774561 31570 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:57.775192 31570 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.775696 31570 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:57.802080 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 105946us
I20260709 13:12:57.696780 31676 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.805852 29438 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:57.813858 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.800062 31718 raft_consensus.cc:2764] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:57.845886 29468 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:57.834997 30159 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:12:57.801776 31690 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:57.863941 31690 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:57.864355 31690 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.864699 31690 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.846498 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:57.853084 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:57.884289 29469 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:57.855495 29543 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:57.892122 29465 raft_consensus.cc:2368] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5.
I20260709 13:12:57.797405 31899 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.846957 31875 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6.
W20260709 13:12:57.901216 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.823225 31867 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.847785 31675 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:57.836712 31829 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:57.914014 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 372944us
W20260709 13:12:57.926406 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.925580 31611 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:12:57.988189 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.991798 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 293782us
I20260709 13:12:57.992990 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:57.966113 29469 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:12:57.959476 31772 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:58.007936 31870 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:58.032758 31642 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:12:58.035271 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.037025 31718 raft_consensus.cc:1064] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:12:58.040246 31718 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.043226 29465 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:12:58.044880 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.045744 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.046253 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.047259 31642 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:58.047569 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.050101 29466 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 4. Ops: []
I20260709 13:12:58.050021 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:57.969795 31611 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.043114 31870 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.065582 30159 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:12:58.067945 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.063768 31490 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:58.059051 31862 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:12:58.091029 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:58.095048 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.099056 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.099251 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.078786 31899 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:58.066973 31909 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:12:58.110457 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:58.112675 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 131063us
I20260709 13:12:58.080694 31883 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:12:58.124773 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.161836 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:58.162789 30159 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:58.112546 31829 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:58.171685 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.178216 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:58.165851 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 96248.9us
W20260709 13:12:58.192152 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.199400 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.201309 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 114489us
W20260709 13:12:58.201054 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 57168.8us
I20260709 13:12:58.202327 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:58.206117 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.212742 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.213860 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.214933 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.215662 29546 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:58.218020 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.218369 29543 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:58.212533 31924 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:12:58.219378 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.219645 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.220564 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.220880 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.221326 29540 raft_consensus.cc:2410] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 4 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:12:58.221757 30126 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:58.196246 31916 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:58.223006 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:12:58.223163 31922 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:12:58.223273 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.224514 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.225298 29542 raft_consensus.cc:2368] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:12:58.226097 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.227643 29466 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:58.231554 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.233153 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:12:58.237715 31757 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.005s
I20260709 13:12:58.222177 31772 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:58.218396 31913 log.cc:927] Time spent T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:12:58.245172 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.245831 29472 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:58.247613 29466 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:58.247750 31867 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:58.222143 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:58.250809 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.251634 29541 raft_consensus.cc:2368] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:12:58.223194 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.252744 29537 raft_consensus.cc:2368] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:12:58.258749 29466 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:58.260272 30159 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:12:58.264168 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.266633 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44987.8us
I20260709 13:12:58.125373 31570 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.267429 30126 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:58.168992 31490 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:58.273849 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:58.272078 31837 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:58.284250 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.284278 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.285619 29537 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:58.288381 29466 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:58.238140 31757 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.300312 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:58.307507 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.285102 31899 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:58.311496 31862 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:58.317443 31876 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:58.321431 31910 raft_consensus.cc:3055] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:58.328626 31629 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.331437 31918 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.332792 29466 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:58.333510 31675 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.249935 31829 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:12:58.298185 31875 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:58.304226 31690 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:58.336200 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.284729 31878 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:58.278846 31919 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:58.273532 31925 consensus_queue.cc:1059] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:12:58.384150 29467 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:58.360450 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.366035 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.386735 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:58.367318 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 173652us
I20260709 13:12:58.361810 29546 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:58.350133 29465 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:58.395913 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.398382 29537 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:12:58.401769 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.410717 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.422950 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.411710 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.424522 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.342851 31862 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:58.425521 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.425922 29541 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:12:58.399734 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 82812.6us
W20260709 13:12:58.427843 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 225719us
I20260709 13:12:58.430372 29538 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:58.430590 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.350340 31910 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:58.434252 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.449152 29541 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:58.434939 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.414961 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.451920 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.452155 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.456403 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.398860 31611 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:58.464610 29537 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:58.470121 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:58.451967 31923 log.cc:927] Time spent T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:58.479066 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.481254 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:58.482117 29394 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:58.447281 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:58.500325 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.394634 31629 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.502805 29537 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:58.503777 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.504534 29394 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:12:58.507134 29538 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:58.447975 31875 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:58.515131 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.517580 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.521338 29464 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:12:58.531751 31676 consensus_meta.cc:287] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.716s	user 0.015s	sys 0.000s
I20260709 13:12:58.532277 31676 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:58.533564 31570 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:58.470451 31805 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:12:58.534834 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:58.536128 29470 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:58.537386 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.538663 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.539438 29538 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:58.539757 31909 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:58.540161 31909 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:58.541054 31909 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:58.453945 31490 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.542991 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.544312 31629 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:58.546123 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.484920 31810 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.546797 29544 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:58.533622 29363 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:58.550832 29467 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:58.395247 31918 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:12:58.542320 31909 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:58.578272 31878 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:58.602890 29538 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:58.411164 31919 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:58.613502 29544 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:12:58.620445 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:58.621215 30151 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:58.622547 31936 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:58.629576 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.631341 29394 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:58.632263 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 98708.4us
I20260709 13:12:58.635144 29466 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:58.639621 30157 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:58.557809 31876 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:58.642805 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
W20260709 13:12:58.638168 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 234448us
W20260709 13:12:58.616649 31935 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:12:58.646498 30154 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:58.685349 29472 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:12:58.547430 31910 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:58.649461 30160 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:58.658198 29470 raft_consensus.cc:606] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:12:58.693275 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 211241us
I20260709 13:12:58.693651 29470 raft_consensus.cc:614] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:58.659807 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.673779 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:58.646970 31915 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:12:58.698220 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 271370us
I20260709 13:12:58.701113 30126 leader_election.cc:400] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5.
I20260709 13:12:58.702651 30126 leader_election.cc:403] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:58.706902 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:58.712688 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 361922us
W20260709 13:12:58.713055 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83641.8us
I20260709 13:12:58.584219 31810 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.716199 29512 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:58.728130 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:58.507085 31862 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.704407 31757 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:58.729612 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 173285us
I20260709 13:12:58.734400 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:12:58.750593 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.716460 31611 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:58.751443 29509 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.600s (SENT)
I20260709 13:12:58.771407 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:58.720136 31936 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.774888 30123 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:58.732668 31765 consensus_queue.cc:1059] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:12:58.732774 31878 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.737886 29435 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:58.732928 31899 raft_consensus.cc:697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:12:58.764165 31944 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:12:58.784466 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:58.785341 29472 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:58.765111 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67084.8us
I20260709 13:12:58.719054 31948 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5.
I20260709 13:12:58.759256 31570 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:58.730639 31736 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:58.777562 29389 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:58.732108 31883 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:58.781263 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1816) took 1093 ms. Trace:
I20260709 13:12:58.813455 29472 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:58.811838 29396 rpcz_store.cc:276] 0709 13:12:57.681601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.685733 (+  4132us) service_pool.cc:224] Handling call
0709 13:12:57.686046 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.692218 (+  6172us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:57.845335 (+153117us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18003854e0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61ec3993c7 00007f61e89ab9a7 00007f61e89bb0bf 00007f61e89bb038
0709 13:12:57.989626 (+144291us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.155119 (+165493us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.162365 (+  7246us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.162567 (+   202us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:58.428278 (+265711us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18003854e0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61ec3993c7 00007f61e89ab9a7 00007f61e89bb0bf 00007f61e89bb038
0709 13:12:58.774322 (+346044us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.774708 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.774822 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.774900 (+    78us) raft_consensus.cc:1685] finished
0709 13:12:58.774918 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.775108 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162830,"prepare.queue_time_us":442541,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":87,"raft.queue_time_us":72982,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":52006,"spinlock_wait_cycles":12628608,"thread_start_us":573092,"threads_started":3,"wal-append.queue_time_us":329671}
W20260709 13:12:58.781965 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 47411.7us
I20260709 13:12:58.736893 31690 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:58.773182 31958 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:58.790786 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:12:58.794849 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 57076.6us
I20260709 13:12:58.774240 31837 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:58.730818 31946 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:12:58.815887 29509 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.721s (SENT)
I20260709 13:12:58.819664 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:58.783849 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.816666 29470 raft_consensus.cc:2376] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4. Re-sending same reply.
I20260709 13:12:58.789685 31862 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:58.826656 29509 leader_election.cc:336] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.772s (SENT)
I20260709 13:12:58.788077 31953 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.827225 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:58.830595 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1817) took 1148 ms. Trace:
W20260709 13:12:58.831350 31950 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:12:58.831769 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.843502 31919 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:58.816367 31736 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:12:58.844308 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.844883 31949 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:58.844988 31736 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:58.816819 31870 consensus_meta.cc:287] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.001s
I20260709 13:12:58.847411 31931 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:58.780799 31936 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.851223 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:12:58.779884 31875 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:12:58.831055 29388 rpcz_store.cc:276] 0709 13:12:57.681851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.687871 (+  6020us) service_pool.cc:224] Handling call
0709 13:12:57.695091 (+  7220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.069478 (+374387us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:58.109690 (+ 40212us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.287191 (+177501us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.301661 (+ 14470us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.301869 (+   208us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:58.451990 (+150121us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.452244 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.452325 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.830298 (+377973us) raft_consensus.cc:1685] finished
0709 13:12:58.830325 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.830504 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474908,"prepare.queue_time_us":228767,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":94,"raft.queue_time_us":113727,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":33116,"thread_start_us":441675,"threads_started":2,"wal-append.queue_time_us":267421}
I20260709 13:12:58.843662 31939 consensus_queue.cc:1059] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:58.815667 31924 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:58.853739 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:12:58.872438 29397 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:58.868494 29538 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:58.819986 31948 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:58.874464 29541 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:12:58.896888 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:12:58.901481 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.902215 29544 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:58.897699 29470 raft_consensus.cc:606] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:12:58.904786 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.905297 29472 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:58.906819 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:12:58.858983 31958 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:12:58.917245 31936 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:58.917119 31958 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:12:58.777056 31925 consensus_queue.cc:1175] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)" } } last_received_current_leader { term: 4 index: 5 } }
W20260709 13:12:58.921777 31951 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:12:58.854485 31953 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.925746 31953 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:58.927304 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:58.928025 31810 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:58.934093 31867 consensus_meta.cc:287] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.002s
I20260709 13:12:58.875793 31924 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:58.936431 31924 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:58.877532 31733 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:58.916319 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 89712.7us
I20260709 13:12:58.949144 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:58.949893 29470 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:12:58.897233 31629 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:58.954083 29471 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:12:58.795132 31876 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.949486 31611 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:58.960477 29544 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:12:58.963657 31935 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:12:58.972888 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 116743us
I20260709 13:12:58.964938 31919 raft_consensus.cc:3055] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:58.913576 31957 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:12:58.982662 29397 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:12:58.985061 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 198350us
I20260709 13:12:58.986892 29470 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:12:58.980044 31675 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.003s
I20260709 13:12:58.939422 31899 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:58.997172 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:59.003152 31946 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:58.977648 31570 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:58.979682 31961 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.984064 31919 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:58.982909 31918 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:59.043114 31942 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:12:59.044922 31945 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.047179 31960 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:12:59.052192 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 54897.6us
I20260709 13:12:58.957196 31952 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:59.079032 29544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:12:59.123818 29544 raft_consensus.cc:606] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:59.124217 29544 raft_consensus.cc:614] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:59.038558 30151 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:12:59.111845 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.042910 31611 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.114600 31973 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.116330 31919 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:12:59.118672 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 120271us
W20260709 13:12:59.107770 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 113545us
I20260709 13:12:59.124333 29469 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:12:59.124286 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:59.137116 30156 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:59.137152 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:12:59.131577 31942 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:59.191188 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 82348.8us
I20260709 13:12:59.167073 31805 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:59.179409 31914 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:59.207125 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:59.189148 31918 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.201311 31919 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:59.170200 31810 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:12:59.223590 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 86511.1us
I20260709 13:12:59.204753 31805 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:59.248052 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.224187 31930 raft_consensus.cc:3055] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:59.203119 31642 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:12:59.235669 31718 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:59.258561 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63401us
I20260709 13:12:59.265748 29438 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:59.252785 31805 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:59.270062 29509 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:59.228137 31570 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.272027 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.277933 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.267079 31930 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:12:59.278784 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 86536us
I20260709 13:12:59.122853 31945 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.275993 31867 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:59.283562 31867 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:59.283984 31867 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:59.283916 31965 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:59.284955 31945 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:59.230340 31914 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.273834 31974 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.287034 31987 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.286993 31974 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.165500 31973 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.289616 31974 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.290207 31973 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.298486 31737 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:59.298956 31737 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:59.299324 31737 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:59.301476 29388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef663d2174234a11995ce0c886e35150"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:12:59.302168 29388 raft_consensus.cc:606] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.302625 29388 raft_consensus.cc:614] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:59.287544 31914 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:59.274127 31928 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:59.311702 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.312433 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.267742 31946 consensus_queue.cc:1059] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:12:59.275465 31718 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:12:59.113969 31961 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.316916 31973 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:59.319387 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:59.271304 31970 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:12:59.343453 31977 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:12:59.337558 31876 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:12:59.346340 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:12:59.353442 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 71679.3us
I20260709 13:12:59.355033 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:59.354849 31718 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.337998 31928 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.355979 30154 raft_consensus.cc:2410] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:59.356115 31928 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.357510 31867 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.359258 31629 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:12:59.359452 31867 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:59.354842 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:59.359843 31629 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.362152 31629 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:12:59.371105 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.337772 31939 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.381511 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 384394us
I20260709 13:12:59.387653 31961 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.389390 31914 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:12:59.391642 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:59.390054 31914 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.377019 31930 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.383713 31690 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:59.394109 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1613) took 1354 ms. Trace:
I20260709 13:12:59.394616 29469 rpcz_store.cc:276] 0709 13:12:58.040231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.045493 (+  5262us) service_pool.cc:224] Handling call
0709 13:12:59.393855 (+1348362us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540035c354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:59.394003 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205926784}
I20260709 13:12:59.385149 31939 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.396478 29465 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:59.397764 31939 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.398418 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1627) took 1066 ms. Trace:
I20260709 13:12:59.399179 29465 rpcz_store.cc:276] 0709 13:12:58.331534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.535888 (+204354us) service_pool.cc:224] Handling call
0709 13:12:59.396086 (+860198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.396917 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.398203 (+  1286us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540035c350. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:12:59.398338 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977408896}
I20260709 13:12:59.367287 31676 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:59.402064 31676 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.372563 31611 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.404492 31676 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:12:59.407581 31909 consensus_meta.cc:287] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.800s	user 0.004s	sys 0.009s
I20260709 13:12:59.394557 31914 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.412690 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:59.413407 29467 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:12:59.415383 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:59.419795 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:12:59.384122 31928 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.394482 31690 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.425621 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:12:59.427430 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72837.3us
I20260709 13:12:59.428768 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:59.430405 31733 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:59.430859 31733 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.431201 31733 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:59.434971 29465 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:59.418653 31805 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.440690 31876 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.441234 31876 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.449563 31736 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:12:59.452131 31829 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:59.452575 31829 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:59.453612 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:59.454247 29465 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:59.456043 31930 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:59.438234 31805 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.469213 29467 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:59.470649 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.481091 29465 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:12:59.484616 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:12:59.483585 29360 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:59.485797 31611 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:59.504215 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 75942.7us
I20260709 13:12:59.496779 31961 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:59.501533 31805 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:59.510766 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.453642 31829 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.500079 31928 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:12:59.498123 31973 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:12:59.534050 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 256230us
I20260709 13:12:59.535399 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:59.510303 31690 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.538141 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:59.543475 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.510664 31961 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:12:59.512962 31974 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.570025 31970 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:59.587800 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:59.514536 31805 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:12:59.584585 29542 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:59.543215 31883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.008s	sys 0.003s
I20260709 13:12:59.574944 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:12:59.590698 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 85642.3us
I20260709 13:12:59.544543 31837 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:59.597599 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.571959 31629 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:59.597266 31883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.009s	sys 0.003s
I20260709 13:12:59.595753 31829 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:59.618408 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 169359us
I20260709 13:12:59.620952 32007 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:59.621989 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 47318.1us
I20260709 13:12:59.624395 29509 leader_election.cc:400] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
I20260709 13:12:59.616056 31974 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:59.626966 29363 leader_election.cc:400] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:12:59.596755 31837 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:12:59.597698 31876 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:12:59.638927 31996 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:12:59.641333 31995 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:59.644407 31805 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.601955 31629 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:12:59.646577 31992 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:12:59.647135 31718 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.594079 31733 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.662544 31961 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.667073 29509 leader_election.cc:403] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:59.695629 31953 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.032s	sys 0.040s
I20260709 13:12:59.617216 31883 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:12:59.687810 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.704965 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.730s (SENT)
W20260709 13:12:59.721150 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 96973.7us
I20260709 13:12:59.685904 31837 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:59.676193 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49377.8us
I20260709 13:12:59.731679 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.733034 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.733451 31733 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.703271 31629 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:59.734457 32000 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:59.735204 32000 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.736855 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:12:59.737324 29546 raft_consensus.cc:2368] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8.
I20260709 13:12:59.737574 29472 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:59.737644 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:12:59.740115 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:59.740856 29544 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
W20260709 13:12:59.722337 31953 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.032s	sys 0.040s
I20260709 13:12:59.742487 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:12:59.718498 31570 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.752013 30123 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.203s (SENT)
W20260709 13:12:59.794970 30123 leader_election.cc:336] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.985s (SENT)
I20260709 13:12:59.736877 31952 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
W20260709 13:12:59.798879 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44102.2us
I20260709 13:12:59.799937 30126 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:12:59.800436 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67498.8us
I20260709 13:12:59.802510 31945 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:59.802973 31945 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.803371 31945 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:59.819352 29472 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:12:59.802234 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:12:59.827157 30160 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:59.719833 31718 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.833590 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:59.872713 30158 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:12:59.863547 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.753552 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:59.756732 31946 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.823207 31958 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:59.875609 29544 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:59.823562 32000 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:59.879135 29509 leader_election.cc:336] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.542s (SENT)
W20260709 13:12:59.874424 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72288.4us
I20260709 13:12:59.928385 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:12:59.931902 29363 leader_election.cc:400] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:12:59.876212 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:12:59.813645 31570 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.937157 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:12:59.934108 31972 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:12:59.962962 30123 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.678s (SENT)
I20260709 13:12:59.953568 31733 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:59.967233 31737 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.667s	user 0.015s	sys 0.000s
W20260709 13:12:59.968088 32013 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:12:59.967846 31737 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:12:59.969110 29538 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:59.900662 31946 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:12:59.973752 31946 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.900931 30151 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:12:59.938122 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45854.6us
I20260709 13:13:00.023128 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:12:59.938205 31958 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:00.028383 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:00.029062 30160 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:00.029279 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 150208us
W20260709 13:13:00.060567 29509 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.169s (SENT)
I20260709 13:13:00.061264 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:00.028278 31942 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.062866 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.063351 31958 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:00.064822 32018 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:13:00.021070 31952 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:00.081492 31952 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.062924 31942 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.084007 31952 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:12:59.975310 31945 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.084939 31942 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.055541 31973 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:00.086761 31945 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:12:59.938002 31883 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.087566 31718 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.089609 32007 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:00.011682 31737 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:00.095227 29471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1622) took 1985 ms (client timeout 1752 ms). Trace:
W20260709 13:13:00.095832 29471 rpcz_store.cc:269] 0709 13:12:58.110012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.110175 (+   163us) service_pool.cc:224] Handling call
0709 13:13:00.094976 (+1984801us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400414954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:00.095130 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687283584}
I20260709 13:13:00.097337 30160 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
W20260709 13:13:00.100698 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 119977us
I20260709 13:13:00.111514 29363 leader_election.cc:400] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
W20260709 13:13:00.127264 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 95515.9us
I20260709 13:13:00.093922 32007 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:00.130262 29509 leader_election.cc:336] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.234s (SENT)
I20260709 13:13:00.130759 29509 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:00.131426 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.119799 31952 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.140522 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.139274 31970 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:00.136775 31974 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:00.135708 32007 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.152468 31919 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:00.152889 31919 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:00.153707 31919 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:00.157542 29509 leader_election.cc:336] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.613s (SENT)
I20260709 13:13:00.159854 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:00.161854 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.165459 31952 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:00.170289 31570 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.167866 31973 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:00.171612 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.172281 30155 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:13:00.173455 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.174564 31961 raft_consensus.cc:2764] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:13:00.161834 31974 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:00.177214 32022 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:00.177824 32022 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.179646 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.180562 31974 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:00.180773 32022 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.181988 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.167356 31919 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.183044 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.183897 30155 raft_consensus.cc:2368] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8.
I20260709 13:13:00.184523 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.184918 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.186383 30151 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:00.186919 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.187584 31985 raft_consensus.cc:993] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:00.188015 30156 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:00.194016 31919 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:00.197261 31837 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.197736 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.203567 31961 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:00.204846 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.207033 31961 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:00.208472 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.210618 31961 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:00.211042 31837 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.212499 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:00.241745 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:00.206468 31629 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.244984 31961 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:00.247957 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.250597 31883 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.271037 31961 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:00.250067 29394 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:00.253372 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.272625 29396 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:00.251967 29389 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:00.263375 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.274461 29397 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:00.265619 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.275442 29392 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:00.270536 29393 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:00.271126 29395 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:00.262110 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1826) took 1776 ms. Trace:
I20260709 13:13:00.266538 31919 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:00.272485 31961 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:00.290261 29360 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:00.292052 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 128925us
I20260709 13:13:00.285312 29392 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:00.271277 31883 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.288872 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.295599 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.297024 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.297910 29388 raft_consensus.cc:2410] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:13:00.295782 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.297930 29397 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:00.300012 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.301496 29389 raft_consensus.cc:2376] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4. Re-sending same reply.
I20260709 13:13:00.302944 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.304121 29394 raft_consensus.cc:2368] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5.
I20260709 13:13:00.304237 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.305080 29390 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:00.286330 31910 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:00.306397 29392 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:00.311079 29509 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:00.311903 31810 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:00.312438 31810 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:00.313349 31810 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.295293 31973 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:00.323732 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.324600 30160 raft_consensus.cc:2393] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 2: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:00.287156 31629 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:00.288496 31876 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:00.324504 31883 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.325644 31876 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.328236 31876 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.329380 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:00.299731 31993 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:13:00.335708 32007 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.297150 31919 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.297029 31570 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:00.338734 31570 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.339109 31570 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:00.345022 29509 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.039s (SENT)
I20260709 13:13:00.345582 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:00.347846 31977 raft_consensus.cc:3055] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.348276 31977 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:00.349123 31977 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.353740 31993 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:00.338315 31919 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.355614 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:00.360164 29509 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.882s (SENT)
I20260709 13:13:00.360622 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:00.350375 31977 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.368186 31993 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:00.276999 29391 rpcz_store.cc:276] 0709 13:12:58.485378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.485505 (+   127us) service_pool.cc:224] Handling call
0709 13:12:58.501946 (+ 16441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.641264 (+139318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.641315 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.645076 (+  3761us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.777976 (+132900us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:58.794146 (+ 16170us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.939169 (+145023us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18003858a0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61e8999060 00007f61e89ab716 00007f61e89bc287 00007f61e89bc208
0709 13:12:58.957036 (+ 17867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.569447 (+612411us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b18003858a0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419
0709 13:13:00.261773 (+692326us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540026fcd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:00.261832 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:00.261885 (+    53us) raft_consensus.cc:1685] finished
0709 13:13:00.261896 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.262040 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32378,"prepare.queue_time_us":21718,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":5735,"raft.queue_time_us":166457,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":34257,"spinlock_wait_cycles":336761984,"thread_start_us":80321,"threads_started":2,"wal-append.queue_time_us":153854,"wal-append.run_cpu_time_us":4141,"wal-append.run_wall_time_us":1404584}
W20260709 13:13:00.373313 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.376621 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.377231 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.378031 29389 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:13:00.378146 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:00.378290 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.379887 29388 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.387784 29389 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:00.393421 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.398622 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:00.399471 29538 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.399732 29541 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:00.401401 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:00.401726 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:00.402379 29540 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.403648 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:00.404212 29542 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:00.404806 29541 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:00.405637 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:00.414166 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:00.415127 29465 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:13:00.417387 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:00.417605 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.418073 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:00.416615 29388 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
W20260709 13:13:00.420331 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.428135 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:00.428972 29544 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:13:00.452068 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 128444us
I20260709 13:13:00.412068 31962 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.453400 29388 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:00.421811 31984 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.424286 31490 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.426227 31931 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.427350 31675 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.470268 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.471190 29393 raft_consensus.cc:2410] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:00.476215 29538 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:13:00.477883 30126 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:00.427647 31899 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:13:00.482860 31931 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.497217 31931 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.469980 31490 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.469485 31985 raft_consensus.cc:1081] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:00.500386 31490 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.483132 31675 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.502256 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.502774 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.503080 29393 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:00.504118 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.504159 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.505028 29389 raft_consensus.cc:2368] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:00.505770 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.505327 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.468151 31984 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.506927 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.507725 29389 raft_consensus.cc:2410] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:00.507556 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.509212 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.509609 29393 raft_consensus.cc:2393] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:00.424702 31570 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.460417 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:00.510628 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.516206 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.511435 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.517565 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.512179 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.430418 31991 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:13:00.514714 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.521136 29393 raft_consensus.cc:2410] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:00.522079 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:00.524950 29540 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:00.528033 30126 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:00.531700 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.538929 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:00.539650 29544 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:00.540769 29396 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:13:00.541249 29396 pending_rounds.cc:85] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 2
I20260709 13:13:00.541558 29396 pending_rounds.cc:107] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:00.541867 29396 raft_consensus.cc:2889] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.542295 29396 pending_rounds.cc:107] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:00.542623 29396 raft_consensus.cc:2889] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.508423 32020 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.543733 29395 raft_consensus.cc:2368] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3.
W20260709 13:13:00.545068 29509 leader_election.cc:336] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.175s (SENT)
I20260709 13:13:00.503219 31675 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.547442 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:00.466943 31962 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.563407 31962 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.564189 32020 raft_consensus.cc:697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:00.565227 32020 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.543607 31876 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:00.566995 31876 raft_consensus.cc:697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:00.567906 31876 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:00.547505 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 152700us
I20260709 13:13:00.572547 31984 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.575706 31642 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.576265 31642 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.576625 29512 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:00.548360 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:00.539600 29389 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:13:00.550312 31686 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:00.554741 29397 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.558077 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:00.559903 31570 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.547266 31932 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:00.617110 32030 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:13:00.617018 31932 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.621644 31932 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.578339 31642 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:00.625543 30160 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:00.594795 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:00.636312 29545 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:00.654446 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:00.679996 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 96553us
W20260709 13:13:00.694983 29545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1917) took 1838 ms (client timeout 1936 ms). Trace:
W20260709 13:13:00.695566 29545 rpcz_store.cc:269] 0709 13:12:58.856140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.856305 (+   165us) service_pool.cc:224] Handling call
0709 13:13:00.694396 (+1838091us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400409554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:00.694858 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3842085120}
I20260709 13:13:00.703907 31642 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:00.704936 31690 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:00.704772 31642 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.705793 31962 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:00.705935 31690 raft_consensus.cc:3055] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:00.706262 31962 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.706326 31690 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:00.706758 31962 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:00.707347 31690 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.708683 31690 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:00.705263 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 110589us
I20260709 13:13:00.703995 31932 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.675631 31993 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:00.710769 31932 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.711215 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:00.711643 31969 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.712131 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:00.704834 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 76162.7us
I20260709 13:13:00.712282 31969 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:00.713701 31668 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:00.714056 31668 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:00.714408 31668 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:00.715001 29438 leader_election.cc:400] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8.
I20260709 13:13:00.715317 29438 leader_election.cc:403] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.715581 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:00.573810 29290 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 3, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.629146 32007 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:00.735191 29292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 295) took 14588 ms (client timeout 15000 ms). Trace:
I20260709 13:13:00.732599 31870 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:00.738853 31870 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:00.739234 31870 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:00.651656 31989 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.752830 31962 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:00.667356 31984 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:13:00.812186 29438 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:00.743716 32007 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.752496 31941 raft_consensus.cc:2955] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:00.735757 29292 rpcz_store.cc:269] 0709 13:12:46.147047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.147357 (+   310us) service_pool.cc:224] Handling call
0709 13:13:00.735091 (+14587734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:58.058425 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:58.062221 (+  3796us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:58.062285 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:12:58.062309 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:58.197345 (+135036us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:58.247028 (+ 49683us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:58.247080 (+    52us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:12:58.247789 (+   709us) tablet.cc:701] Row locks acquired
0709 13:12:58.247838 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:12:58.248044 (+   206us) write_op.cc:270] Start()
0709 13:12:58.248221 (+   177us) write_op.cc:276] Timestamp: P: 1783602778247971 usec, L: 0
0709 13:12:58.248246 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:58.334565 (+ 86319us) log.cc:844] Serialized 2490 byte log entry
0709 13:12:58.998555 (+663990us) op_driver.cc:464] REPLICATION: finished
0709 13:12:59.047365 (+ 48810us) write_op.cc:301] APPLY: starting
0709 13:12:59.047705 (+   340us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:59.047916 (+   211us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:59.053710 (+  5794us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:59.224036 (+170326us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:59.224366 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:12:59.224415 (+    49us) write_op.cc:312] APPLY: finished
0709 13:12:59.224705 (+   290us) log.cc:844] Serialized 53 byte log entry
0709 13:12:59.224950 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:59.225125 (+   175us) write_op.cc:454] Released schema lock
0709 13:12:59.225188 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:59.225742 (+   554us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:59.225782 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34319,"reported_tablets":18,"spinlock_wait_cycles":4864,"child_traces":[["op",{"apply.queue_time_us":48494,"apply.run_cpu_time_us":9520,"apply.run_wall_time_us":178339,"num_ops":6,"prepare.queue_time_us":384321,"prepare.run_cpu_time_us":43303,"prepare.run_wall_time_us":446115,"raft.queue_time_us":146973,"raft.run_cpu_time_us":2933,"raft.run_wall_time_us":69244,"replication_time_us":750080,"thread_start_us":658170,"threads_started":4,"wal-append.queue_time_us":292981,"wal-append.run_cpu_time_us":41260,"wal-append.run_wall_time_us":1590409}]]}
I20260709 13:13:00.789714 31490 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:01.006765 30158 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.021s	sys 0.022s
W20260709 13:13:01.005374 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 289859us
W20260709 13:13:01.057081 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 244959us
W20260709 13:13:01.057339 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 512298us
W20260709 13:13:01.069581 29509 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 3.323s (SENT) [suppressed 29 similar messages]
I20260709 13:13:00.761818 31909 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8.
I20260709 13:13:01.073916 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.074925 29472 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:01.071682 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 62350.6us
I20260709 13:13:00.880084 31931 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:00.917376 31969 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:01.084537 30160 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:01.009089 32007 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:00.756628 31989 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.004423 31772 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.093010 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:01.081727 31952 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.058535 31925 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:01.075064 31985 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.028679 31490 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:01.104915 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.112126 29470 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:01.106587 31772 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.106902 31962 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:00.813503 31924 consensus_queue.cc:1059] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.272s
I20260709 13:13:01.107848 29392 raft_consensus.cc:2393] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:01.108837 29539 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:01.111096 30160 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:01.117841 30157 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:01.079741 31899 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:13:00.925052 31668 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.129710 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.129999 29471 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:01.130280 31924 raft_consensus.cc:3055] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:01.110848 31985 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.132030 30123 leader_election.cc:400] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5.
I20260709 13:13:01.110555 31642 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.116823 31490 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:01.104018 31909 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:13:01.145430 29363 connection.cc:256] RPC call timeout handler was delayed by -2.0665458619998844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 13:13:01.103899 31931 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:01.148546 29363 connection.cc:256] RPC call timeout handler was delayed by -1.6876458619999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:13:01.140270 30123 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:01.154151 31870 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:01.123725 30154 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.018s	sys 0.026s
I20260709 13:13:01.111035 31952 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.161026 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.116364 31925 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.196635 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.197249 31925 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.154325 32007 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.197935 29544 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:01.199834 32007 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.199421 29544 raft_consensus.cc:2955] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:01.132673 31837 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:01.187141 29540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:13:01.202602 29540 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.202229 31837 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:01.203512 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.204177 29537 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:01.205166 31837 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:01.130699 31924 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:01.138505 31985 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.197292 29545 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:01.197886 31952 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:01.210783 31668 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.210934 31924 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.212630 31924 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.214538 31932 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.185676 29464 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:01.186513 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.187637 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.188270 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.216733 29541 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:01.189002 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:01.192426 30154 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.018s	sys 0.027s
I20260709 13:13:01.217993 29543 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:13:01.193949 29463 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:01.216691 29542 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:01.219048 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 452) took 1483 ms. Trace:
I20260709 13:13:01.219564 30154 rpcz_store.cc:276] 0709 13:12:59.735531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.738265 (+  2734us) service_pool.cc:224] Handling call
0709 13:13:00.268143 (+529878us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:00.268340 (+   197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.268759 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.268789 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.269444 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:13:00.416984 (+147540us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:01.218124 (+801140us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.218474 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.218587 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:01.218647 (+    60us) raft_consensus.cc:1685] finished
0709 13:13:01.218760 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.218922 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":731448,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":4872,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12198,"spinlock_wait_cycles":91284352,"thread_start_us":861419,"threads_started":2,"wal-append.queue_time_us":250939}
I20260709 13:13:01.202978 29540 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.221220 31989 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:01.177958 29363 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:01.232098 31974 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:01.233230 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 55386.2us
I20260709 13:13:01.234968 31974 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:01.235805 32036 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:01.237022 31772 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.237028 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:01.238549 31974 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:01.238854 31931 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.239106 31974 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:01.240701 31974 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.242587 31899 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:01.156240 29469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.021s
W20260709 13:13:01.253167 29469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.008s	sys 0.021s
I20260709 13:13:01.243134 31899 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.254336 29467 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:01.267540 29390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.005s	sys 0.026s
W20260709 13:13:01.267961 29390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.005s	sys 0.026s
I20260709 13:13:01.269539 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.273947 29290 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.248149 29540 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.277858 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:01.279036 29397 raft_consensus.cc:2410] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:13:01.300797 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 1939) took 1700 ms. Trace:
I20260709 13:13:01.301721 29540 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:01.301286 29539 rpcz_store.cc:276] 0709 13:12:59.576912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.581979 (+  5067us) service_pool.cc:224] Handling call
0709 13:13:00.694581 (+1112602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.121725 (+427144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.231002 (+109277us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400409554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:01.277525 (+ 46523us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400409550. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:01.277656 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3496593536}
I20260709 13:13:01.292888 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:01.319077 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:01.320088 29546 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:01.320145 29438 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:01.326917 29392 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:13:01.327330 29392 pending_rounds.cc:85] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 6
I20260709 13:13:01.327625 29392 pending_rounds.cc:107] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:13:01.327921 29392 raft_consensus.cc:2889] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:01.276305 31899 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.335026 29394 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:01.332616 29438 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:01.337673 29438 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:01.333662 31998 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:01.350595 31998 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.351004 31998 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:01.316231 31931 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:13:01.352706 31668 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.353281 31668 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.353689 31668 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.358661 31642 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:01.359287 31642 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.359714 31642 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:01.363400 31987 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.363971 31987 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.364423 31987 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.367739 31878 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:01.368528 31878 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:01.371143 32037 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:13:01.373616 31870 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.226310 31876 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:13:01.377961 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.379027 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.380537 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.385008 29470 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:01.380805 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.380496 29438 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:01.387585 29466 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:01.384511 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.388706 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.389393 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.290427 31919 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
W20260709 13:13:01.376268 31690 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.667s	user 0.015s	sys 0.000s
I20260709 13:13:01.396008 29540 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:01.399487 31686 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:01.404464 31686 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.404896 31686 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:01.398691 29464 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:01.403244 29466 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:01.379753 31772 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.392498 31570 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.386247 31952 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.434227 31772 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.434481 31952 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.436878 31952 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.410048 31984 consensus_queue.cc:1059] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:01.438020 31984 raft_consensus.cc:3055] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:01.438421 31984 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:01.439435 31984 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.440737 31984 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:01.416400 31878 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:01.416597 31985 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.418167 31490 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.454286 29290 catalog_manager.cc:5697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 3 to 5, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.456336 31490 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:01.451895 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.457682 29540 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:01.448602 31570 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.388036 31925 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:13:01.460902 29438 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:01.461985 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:01.470341 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:01.494131 29472 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:01.494596 29363 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:01.496244 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:01.499234 32048 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.499872 32048 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.503288 32048 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.503831 32048 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:01.505113 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:01.506299 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:01.507272 32048 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.507863 31985 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.510505 31570 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.511108 31570 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:01.511780 31570 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.512117 31570 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:01.512475 31570 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.520475 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:01.521464 29540 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:01.522614 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.524564 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 455002us
W20260709 13:13:01.528986 29388 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.010s
I20260709 13:13:01.465372 31909 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.497583 31961 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:01.535821 30156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.000s	sys 0.010s
W20260709 13:13:01.542645 30156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.001s	sys 0.010s
W20260709 13:13:01.534952 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 470032us
W20260709 13:13:01.537441 29388 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.010s
I20260709 13:13:01.537786 31909 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.525815 31998 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.544516 31772 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:01.540063 31961 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.554914 31642 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:01.560938 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.456359 29290 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.550163 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1761) took 1043 ms. Trace:
I20260709 13:13:01.552520 31909 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.566984 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.540303 31987 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.572055 31668 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.569829 31961 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:01.593847 29472 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:01.599977 29472 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:01.602728 29467 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:01.602905 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 445760us
I20260709 13:13:01.604545 29470 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:01.608623 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 468401us
I20260709 13:13:01.610473 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.610670 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.612142 29540 raft_consensus.cc:2410] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:13:01.614351 29542 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:01.569355 29388 rpcz_store.cc:276] 0709 13:13:00.506302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.539140 (+ 32838us) service_pool.cc:224] Handling call
0709 13:13:00.539467 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.539837 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.539866 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.540455 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:13:00.867206 (+326751us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:01.549317 (+682111us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.549710 (+   393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.549805 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:01.549848 (+    43us) raft_consensus.cc:1685] finished
0709 13:13:01.549858 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.550089 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":503548,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":7001,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":1603,"thread_start_us":893033,"threads_started":2,"wal-append.queue_time_us":592502}
I20260709 13:13:01.615876 29546 raft_consensus.cc:2393] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:01.616397 29360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.007s
W20260709 13:13:01.616904 29360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.008s	sys 0.007s
I20260709 13:13:01.623502 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.624533 29542 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:13:01.626446 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:01.627118 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:01.627569 29540 raft_consensus.cc:2393] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:01.627867 29541 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.632382 29540 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.634467 30123 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:01.622012 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 54749.4us
I20260709 13:13:01.641718 29435 leader_election.cc:400] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8.
I20260709 13:13:01.641932 29542 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:01.644853 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:01.650708 30160 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:01.668478 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:01.672638 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.672992 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.684270 30160 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:01.692019 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.693871 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.701504 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:01.702494 29464 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:01.703845 29545 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:01.693816 29465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.008s
W20260709 13:13:01.710855 29465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.011s	sys 0.008s
I20260709 13:13:01.711861 30160 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 5
I20260709 13:13:01.722884 30160 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 13:13:01.724020 30160 raft_consensus.cc:2917] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 13:13:01.724937 30160 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:01.731423 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:01.732357 29472 raft_consensus.cc:3055] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.732791 29472 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:01.733805 29541 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:01.734615 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:01.736436 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 93078.3us
I20260709 13:13:01.688731 31952 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:01.742628 29544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.022s
W20260709 13:13:01.743091 29544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.001s	sys 0.022s
I20260709 13:13:01.622260 31878 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:13:01.755097 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1825) took 1169 ms. Trace:
I20260709 13:13:01.755504 29469 rpcz_store.cc:276] 0709 13:13:00.567266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.571291 (+  4025us) service_pool.cc:224] Handling call
0709 13:13:00.571578 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.571793 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:01.265395 (+693602us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.736356 (+470961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.736411 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:01.736461 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.736535 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.736644 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95277,"prepare.queue_time_us":787186,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":103291,"thread_start_us":1056978,"threads_started":2}
I20260709 13:13:01.758363 29540 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:01.756656 29472 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:01.783907 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 277665us
W20260709 13:13:01.784289 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 46333.5us
I20260709 13:13:01.793567 29545 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:01.800583 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:01.688956 31974 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:13:01.825017 29464 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:01.823526 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 179471us
I20260709 13:13:01.822316 29472 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.801810 31919 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.800344 32063 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEARNER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:01.842676 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:01.829167 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:01.859871 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 193515us
I20260709 13:13:01.818076 31997 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.803959 31991 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:13:01.839627 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 171271us
I20260709 13:13:01.871055 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:01.862514 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:01.864115 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:01.862537 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:01.878575 30160 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:01.801316 32049 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:13:01.843474 31998 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:01.890100 29472 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
W20260709 13:13:01.875597 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49682.2us
W20260709 13:13:01.880129 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 151407us
I20260709 13:13:01.865428 32050 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.843922 31837 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:13:01.872231 32048 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:01.844771 31919 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:01.902894 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.923509 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:01.926290 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:01.927145 30159 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:01.887816 31668 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:01.892347 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:01.896134 31642 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:01.897250 32063 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:01.895810 31989 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:01.896416 31987 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:01.935205 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:01.880084 31878 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:13:01.875375 31997 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.789191 29290 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 4, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.918478 31974 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:01.920578 31876 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:01.963711 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 72219.6us
W20260709 13:13:01.969223 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 170210us
I20260709 13:13:01.926466 32068 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:01.889405 32059 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:13:01.981699 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:01.964329 32056 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.990330 32065 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:13:01.991101 32062 log.cc:927] Time spent T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:13:01.991755 32060 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:13:01.992511 32052 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:13:01.993307 32069 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:13:01.993806 32074 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:01.991343 31876 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.005908 32073 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:01.926582 32050 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:01.971097 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:01.972680 31991 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:01.941944 32048 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:13:01.984074 32081 consensus_queue.cc:1059] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:13:02.020031 31870 raft_consensus.cc:1064] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:13:01.964738 31989 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.033535 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:02.051502 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 328389us
I20260709 13:13:02.052634 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:02.054550 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 257164us
I20260709 13:13:02.044489 32020 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:02.000183 32068 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:02.046046 32057 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:02.015741 32056 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:01.983433 31974 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.057643 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:02.074838 29540 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:13:02.077252 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 104389us
I20260709 13:13:02.063700 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:02.078750 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 93026.3us
I20260709 13:13:02.075843 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:02.080040 29544 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:02.078835 29539 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:02.036008 31686 consensus_meta.cc:287] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.006s
I20260709 13:13:02.036857 32085 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:02.087499 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:02.100297 29545 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:02.088824 29542 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:02.102198 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:02.102703 29540 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
W20260709 13:13:02.088622 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 106642us
I20260709 13:13:02.091383 29541 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:13:02.086004 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 221551us
I20260709 13:13:02.103827 29540 raft_consensus.cc:1240] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.097961 29546 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:13:02.104857 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:02.102825 29542 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:13:02.106483 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:02.107208 30159 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:13:02.110562 29471 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:02.110937 29471 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 5
I20260709 13:13:02.111159 29471 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 13:13:02.111507 29471 raft_consensus.cc:2917] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 13:13:02.112051 29471 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.113130 29539 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:02.116957 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:02.117786 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:02.118468 29471 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:13:02.090090 30160 raft_consensus.cc:2955] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:02.128535 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:02.129766 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:02.062201 32080 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:02.114472 29438 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:02.085701 32020 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:02.154312 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.146252 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:02.155360 30159 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:13:02.156914 29388 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:02.156772 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.157811 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.158563 29545 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:02.155061 29391 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:02.073493 32074 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:13:02.167593 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:02.098573 32087 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.173139 29438 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:02.047233 32073 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.174611 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.174779 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.176136 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.062776 32076 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:13:02.088275 31991 consensus_queue.cc:1059] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:13:02.132653 32059 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.179064 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.172240 31772 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:02.182580 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.184990 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.196300 29396 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:02.148269 31985 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:02.148527 32053 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:02.189000 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.182087 32087 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.098194 31686 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:02.181968 29497 heartbeater.cc:646] Failed to heartbeat to 127.27.150.190:35447 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.27.150.190:35447 timed out after 15.000s (SENT)
I20260709 13:13:02.075809 32079 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:13:02.150862 32020 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:02.137984 32083 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.202747 29389 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:02.165565 31931 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:02.166054 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:02.173892 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.160773 32090 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:02.210928 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:02.208895 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 465) took 1801 ms. Trace:
I20260709 13:13:02.209116 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.213163 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.216773 29390 raft_consensus.cc:2410] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:02.227548 29397 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:02.229115 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.229837 29397 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:02.217130 29544 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:02.204113 32092 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:13:02.206959 32084 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:02.219108 31961 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.005s
I20260709 13:13:02.219396 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:02.220932 32087 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.208034 32068 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:02.223302 31899 consensus_meta.cc:287] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.006s
I20260709 13:13:02.221143 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.197039 31490 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:02.189971 32088 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.206863 32073 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.233469 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.235798 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.223639 30156 rpcz_store.cc:276] 0709 13:13:00.407045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.407219 (+   174us) service_pool.cc:224] Handling call
0709 13:13:00.407624 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.408162 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:00.887859 (+479697us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.543405 (+655546us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:01.562074 (+ 18669us) log.cc:844] Serialized 26 byte log entry
0709 13:13:01.562267 (+   193us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:01.562619 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.562925 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.563037 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:01.993561 (+430524us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b1800264ca0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b4522 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:13:02.208643 (+215082us) raft_consensus.cc:1685] finished
0709 13:13:02.208672 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.208818 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":755277,"prepare.run_cpu_time_us":350,"prepare.run_wall_time_us":352,"raft.queue_time_us":1471,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":10832,"spinlock_wait_cycles":2473856,"thread_start_us":1116149,"threads_started":2,"wal-append.queue_time_us":1046770}
I20260709 13:13:02.286202 29389 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:02.239114 29469 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:02.202538 32053 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.204797 32056 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:02.263710 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:02.233228 29463 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:02.202629 32086 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.201700 31985 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.320502 31985 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:02.320473 32086 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.228955 31668 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:02.291325 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 332) took 1798 ms. Trace:
W20260709 13:13:02.301637 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 194541us
I20260709 13:13:02.228710 32090 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.308007 32089 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:02.308343 31837 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:02.309043 31989 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:02.282698 31899 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.235116 31997 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:02.169154 32080 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.210728 32048 consensus_queue.cc:1059] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:13:02.312968 32055 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.307s	user 0.001s	sys 0.002s
I20260709 13:13:02.211195 32059 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:02.319543 31570 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.807s	user 0.013s	sys 0.001s
I20260709 13:13:02.319831 32053 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:02.408957 30151 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:02.233582 31931 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:02.151962 32085 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.237293 32077 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.328430 29538 rpcz_store.cc:276] 0709 13:13:00.493349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.519161 (+ 25812us) service_pool.cc:224] Handling call
0709 13:13:00.519711 (+   550us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:00.520307 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.520337 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:00.548731 (+ 28394us) log.cc:844] Serialized 78 byte log entry
0709 13:13:01.557155 (+1008424us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:01.792837 (+235682us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.924440 (+131603us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.936267 (+ 11827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.936695 (+   428us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.291058 (+354363us) raft_consensus.cc:1685] finished
0709 13:13:02.291084 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.291249 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15399,"prepare.queue_time_us":330695,"prepare.run_cpu_time_us":509,"prepare.run_wall_time_us":2523,"raft.queue_time_us":77468,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":37696,"thread_start_us":833071,"threads_started":3,"wal-append.queue_time_us":772103}
I20260709 13:13:02.362387 29396 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:02.363781 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.282552 32087 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:02.375535 29392 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:02.358062 29397 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:13:02.360653 31984 consensus_meta.cc:287] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.911s	user 0.016s	sys 0.002s
I20260709 13:13:02.382298 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:02.390619 32086 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.391055 32078 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.391729 32094 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:13:02.229331 31952 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:02.364215 31668 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:02.412861 29395 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:02.347509 32089 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:02.277662 31961 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.422375 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.225941 32083 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.425350 29389 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:02.429504 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:02.443949 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 61804.9us
W20260709 13:13:02.460752 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 193678us
I20260709 13:13:02.289930 32088 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.502610 29395 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:13:02.470687 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 123034us
I20260709 13:13:02.430794 32050 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.532065 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:02.535509 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:02.398773 32020 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.413268 31570 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.844336 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:02.725502 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 461867us
I20260709 13:13:02.847179 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:02.577936 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:02.736879 32089 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.506714 31989 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:02.503582 32093 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.576570 29394 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:02.683784 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:02.862187 29463 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:02.857590 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 110037us
I20260709 13:13:02.862648 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:02.506758 32097 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:02.504201 31686 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:02.585826 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.584908 29438 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:02.641912 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:02.505664 32059 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.443102 32077 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:02.532150 32066 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:13:02.640501 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:02.868417 29509 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:02.528034 31984 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.459406 32087 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.900722 31984 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.902454 32087 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.903143 31984 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:02.904503 31570 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.905920 32088 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.539736 32056 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:02.906635 32056 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.908712 32056 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.504969 31931 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.506512 32085 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:02.816322 32055 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:13:02.825582 32107 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:13:02.911728 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 290) took 1824 ms. Trace:
I20260709 13:13:02.494656 32090 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:02.912509 32090 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:02.622108 32096 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:02.913420 32096 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:02.913890 32096 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:02.912102 29465 rpcz_store.cc:276] 0709 13:13:01.087345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.087499 (+   154us) service_pool.cc:224] Handling call
0709 13:13:01.087960 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:01.103133 (+ 15173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.103166 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:01.111181 (+  8015us) log.cc:844] Serialized 52 byte log entry
0709 13:13:01.711431 (+600250us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:01.755841 (+ 44410us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.785048 (+ 29207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.785127 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.312161 (+527034us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:02.911366 (+599205us) raft_consensus.cc:1685] finished
0709 13:13:02.911482 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.911640 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45565,"prepare.queue_time_us":80289,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":46249,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":13269,"spinlock_wait_cycles":3219712,"thread_start_us":576423,"threads_started":1,"wal-append.queue_time_us":881665}
I20260709 13:13:02.874389 32093 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.917239 32083 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:02.917822 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 333008us
I20260709 13:13:02.885399 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:02.499879 32080 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:02.777338 32074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.017s
I20260709 13:13:02.640062 31876 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.890249 32077 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:02.891556 32111 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:02.891916 32105 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:02.894598 31909 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.307s	user 0.021s	sys 0.000s
W20260709 13:13:02.895355 32112 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:13:02.924289 32090 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.932037 32105 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.933215 32089 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:02.899726 32110 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.869504 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:02.853873 32086 raft_consensus.cc:3055] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:02.934651 32086 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:13:02.936108 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 66703.6us
I20260709 13:13:02.937075 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:02.509302 31952 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.945749 31952 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:02.919539 29538 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:13:02.920387 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:02.504499 31899 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:02.522008 32068 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:02.819589 32048 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:02.575912 32050 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.918089 32106 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:02.926774 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.012s	sys 0.015s
W20260709 13:13:02.963867 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.013s	sys 0.015s
W20260709 13:13:02.965579 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 434301us
I20260709 13:13:02.927063 32059 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:02.927835 32104 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:02.859074 32081 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.940479 31961 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:02.940198 32086 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.941663 32100 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:02.942322 32088 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:02.918955 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:02.950428 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.951119 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:02.976954 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.951452 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:02.946276 31985 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.625s	user 0.005s	sys 0.012s
I20260709 13:13:02.978930 31985 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.978363 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.961575 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:02.925987 32074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.000s	sys 0.021s
I20260709 13:13:02.642051 31668 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.928256 32093 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.503188 32078 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.964879 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:02.943481 32105 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.974350 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:03.000372 29394 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:03.001459 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:02.983615 29471 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:02.887660 32097 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.002970 32099 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:03.003068 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:03.004735 32099 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:02.986873 29389 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:13:02.947737 31909 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.006698 31984 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:03.007315 31984 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:03.008049 31909 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:03.008721 31919 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.962813 32050 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.981282 31570 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:13:03.016322 32050 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:03.016430 32100 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:03.016886 32121 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:13:03.017470 29467 raft_consensus.cc:2368] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4.
I20260709 13:13:03.019405 32084 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:03.019789 32084 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:03.020730 32084 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:02.963512 31952 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:03.008301 31984 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.980949 32081 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:02.964699 32048 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.021417 32078 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:03.294874 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.016911 32100 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.307199 32100 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.308054 32048 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:03.023439 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:03.264782 32123 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.021821 29397 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:03.005963 29391 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.005s	sys 0.035s
I20260709 13:13:03.066138 29394 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:13:03.017423 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 53071.1us
I20260709 13:13:03.074044 29512 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:03.296548 32053 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.009s
I20260709 13:13:03.074513 31837 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.239s
W20260709 13:13:03.313987 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 395080us
I20260709 13:13:03.336844 32121 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.337607 29466 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:03.337422 32121 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.339015 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:03.339619 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1890) took 1059 ms. Trace:
I20260709 13:13:03.340329 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:03.340651 31961 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.341308 31961 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.343654 31961 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:03.343441 32053 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:03.344434 31961 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:03.344960 31961 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.347313 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39036 (request call id 302) took 1137 ms. Trace:
I20260709 13:13:03.347471 32097 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:03.347957 31961 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:03.347824 29471 rpcz_store.cc:276] 0709 13:13:02.210160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.210677 (+   517us) service_pool.cc:224] Handling call
0709 13:13:03.347049 (+1136372us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54002a49d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:03.347232 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740567296}
I20260709 13:13:03.349579 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.350836 29464 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:03.350632 32123 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:03.351050 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 327681us
W20260709 13:13:03.352227 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 278327us
I20260709 13:13:03.353092 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.353603 32123 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:03.364938 29393 raft_consensus.cc:2410] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:13:03.316880 29391 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.016s	sys 0.039s
I20260709 13:13:03.316200 32084 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:03.321117 29510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.000s	sys 0.025s
W20260709 13:13:03.375792 29510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.000s	sys 0.026s
I20260709 13:13:03.346179 32053 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:03.309842 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.323900 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 83118.7us
I20260709 13:13:03.325078 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.325886 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.340366 32121 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:03.327407 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.327708 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.390268 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.391238 29472 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:03.392517 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.328148 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.328985 32081 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:02.999692 32088 raft_consensus.cc:697] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:02.988988 32080 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.344s
I20260709 13:13:03.331029 32048 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:03.144744 32093 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.327437 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1883) took 1121 ms. Trace:
I20260709 13:13:03.421520 29395 rpcz_store.cc:276] 0709 13:13:02.206362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.220863 (+ 14501us) service_pool.cc:224] Handling call
0709 13:13:03.327205 (+1106342us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000a50d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:03.327328 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387910400}
I20260709 13:13:03.334348 29396 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:03.318230 32128 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:03.353726 29464 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:03.422878 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:03.423480 29395 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:13:03.423843 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.424305 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:03.424631 30123 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:03.424764 29464 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:03.425493 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:03.425990 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.426957 29464 raft_consensus.cc:2393] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 2: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:03.426847 32093 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.427999 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.428742 29464 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:13:03.354959 31989 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:03.355928 32125 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.356331 32086 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:03.356647 31985 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:03.358482 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:03.339984 29392 rpcz_store.cc:276] 0709 13:13:02.280506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.460859 (+180353us) service_pool.cc:224] Handling call
0709 13:13:02.461218 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.691029 (+229811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.691076 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:02.691135 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:02.691179 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.339372 (+648193us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540031db54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:03.339432 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.339554 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452043520}
I20260709 13:13:03.350308 29471 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:13:03.310323 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 268606us
I20260709 13:13:03.373303 29466 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:03.375320 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1876) took 1188 ms. Trace:
I20260709 13:13:02.986171 32106 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:03.326694 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.386888 32092 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.394436 29397 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2.
I20260709 13:13:03.394515 29468 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:03.395593 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.449306 29463 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:03.385623 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1882) took 1179 ms. Trace:
I20260709 13:13:03.440666 29391 rpcz_store.cc:276] 0709 13:13:02.187037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.187194 (+   157us) service_pool.cc:224] Handling call
0709 13:13:02.187544 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:02.207481 (+ 19937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.207521 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:02.208211 (+   690us) log.cc:844] Serialized 52 byte log entry
0709 13:13:02.384823 (+176612us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:03.365982 (+981159us) log.cc:844] Serialized 14 byte log entry
0709 13:13:03.374791 (+  8809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.374931 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.374998 (+    67us) raft_consensus.cc:1685] finished
0709 13:13:03.375017 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.375224 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32335,"prepare.queue_time_us":452945,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":7478,"raft.queue_time_us":179854,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":27762,"thread_start_us":1082934,"threads_started":2,"wal-append.queue_time_us":300595}
I20260709 13:13:03.396530 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.439785 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.389797 29470 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:03.398617 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:03.452337 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93988.7us
I20260709 13:13:03.354686 32110 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:03.429129 32093 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:03.380275 32136 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:03.378280 31668 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:03.430084 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:03.471251 29395 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:03.435912 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:03.471220 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.452180 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:03.453375 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:03.481690 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:03.401736 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:03.460628 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:03.463959 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:03.486418 29464 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:13:03.450121 29390 rpcz_store.cc:276] 0709 13:13:02.206088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.228964 (+ 22876us) service_pool.cc:224] Handling call
0709 13:13:02.277044 (+ 48080us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:02.323267 (+ 46223us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:02.467154 (+143887us) log.cc:844] Serialized 14 byte log entry
0709 13:13:03.294776 (+827622us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b18002786e0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e854123a 00007f61e89aba2a
0709 13:13:03.312102 (+ 17326us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:03.312957 (+   855us) log.cc:844] Serialized 52 byte log entry
0709 13:13:03.313128 (+   171us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:03.317163 (+  4035us) log.cc:844] Serialized 14 byte log entry
0709 13:13:03.317405 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.317501 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.385375 (+ 67874us) raft_consensus.cc:1685] finished
0709 13:13:03.385411 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.385554 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67809,"prepare.queue_time_us":318766,"prepare.run_cpu_time_us":5067,"prepare.run_wall_time_us":59085,"raft.queue_time_us":141901,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":46381,"spinlock_wait_cycles":11708032,"thread_start_us":105006,"threads_started":2,"wal-append.queue_time_us":684097}
I20260709 13:13:03.429301 31919 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:13:03.492937 29395 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:03.497020 29392 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:03.451311 32125 raft_consensus.cc:697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:03.433252 32121 consensus_queue.cc:1059] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:13:03.453159 32097 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:03.501401 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:03.503218 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:03.438465 32114 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:03.469767 31837 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:03.457432 32110 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.479972 31985 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.519452 32110 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:03.457077 32053 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:13:03.493224 32099 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.459318 32092 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.510565 32068 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:03.546298 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 45029.6us
I20260709 13:13:03.508996 32142 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:03.530018 32096 consensus_meta.cc:287] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.616s	user 0.013s	sys 0.001s
I20260709 13:13:03.515937 31919 consensus_queue.cc:1243] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:03.550391 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:03.518415 32114 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:03.494462 31668 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.581771 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 689) took 1719 ms. Trace:
I20260709 13:13:03.595285 30151 rpcz_store.cc:276] 0709 13:13:01.862316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.865972 (+  3656us) service_pool.cc:224] Handling call
0709 13:13:03.581458 (+1715486us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54005a0854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:03.581652 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076467456}
I20260709 13:13:03.516925 32097 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:03.552042 31837 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.487318 32136 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.593171 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:03.604681 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:03.605878 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:03.560339 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:03.610457 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50259.6us
I20260709 13:13:03.493695 32088 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.554224 32068 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.568434 32095 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:03.579329 32074 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:03.583106 32093 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:03.618376 29464 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:13:03.550479 31642 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:03.622632 31919 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:03.625964 32121 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:03.599591 32048 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:03.627615 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 191861us
I20260709 13:13:03.595383 32114 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.612998 32059 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:03.614445 31931 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:03.594609 32096 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.623721 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:03.654229 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:03.634143 32131 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.196s	user 0.002s	sys 0.000s
I20260709 13:13:03.652729 30123 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:03.611361 31837 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.635672 32093 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:03.676496 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:03.634584 32068 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:03.633917 32074 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:03.641778 32129 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:13:03.653671 32090 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:03.674229 32049 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:03.674862 32141 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:03.547170 32106 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.638278 31642 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:03.639993 31919 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.687312 30123 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:03.691277 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:03.705233 32074 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:03.643342 32121 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.694696 29509 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:03.758888 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 64250.5us
I20260709 13:13:03.760146 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:03.653885 32048 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:03.667763 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 266101us
W20260709 13:13:03.762058 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74884.7us
I20260709 13:13:03.725232 32073 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:03.653653 32130 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.662909 32142 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.629997 32125 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.664573 31931 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:03.723173 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.724475 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:03.690742 32093 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:03.731150 29467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39036 (request call id 300) took 2098 ms (client timeout 1635 ms). Trace:
I20260709 13:13:03.743588 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:03.744704 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:03.746810 29541 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:03.779469 29540 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:03.780732 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:03.747857 29544 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:03.782348 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:03.783555 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:03.694046 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:03.640913 32097 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.791531 29540 raft_consensus.cc:2393] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:03.765292 32099 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:03.725155 32141 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.746311 31642 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:03.746833 31919 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:03.779085 29467 rpcz_store.cc:269] 0709 13:13:01.620030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.620186 (+   156us) service_pool.cc:224] Handling call
0709 13:13:03.718273 (+2098087us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400412b54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:03.718542 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3090254080}
I20260709 13:13:03.780661 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:03.704373 32123 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:03.695948 32145 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:03.787359 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93389.3us
I20260709 13:13:03.763757 32121 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:03.762403 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:03.797973 31690 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:03.802498 32115 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:13:03.802892 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:03.724678 32090 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:03.767628 32048 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:03.769279 32073 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:03.766816 32059 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:03.773142 32146 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.764747 32143 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:03.831151 29544 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:03.832229 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:03.833130 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:03.777794 32142 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.787638 32124 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:13:03.773273 32130 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:03.866449 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.313150 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:04.313709 29541 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
W20260709 13:13:04.314083 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 481933us
I20260709 13:13:03.781759 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 563) took 1275 ms. Trace:
W20260709 13:13:04.155944 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.087492 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 321301us
I20260709 13:13:04.329048 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.330137 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:03.787284 31931 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.316660 29540 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:04.317564 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.335242 30158 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:04.335825 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 701) took 1368 ms. Trace:
W20260709 13:13:04.139777 32100 consensus_meta.cc:287] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.832s	user 0.014s	sys 0.003s
I20260709 13:13:03.891642 32156 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.340687 32073 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.332882 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.342523 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:04.343151 32147 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:13:04.343688 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.344342 29537 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:04.345165 32161 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:04.345898 32161 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.348651 32161 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.349464 32161 consensus_queue.cc:1059] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:04.350791 32073 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:04.337934 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.353061 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.353730 29540 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:04.354696 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.336216 30158 rpcz_store.cc:276] 0709 13:13:02.967046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.967194 (+   148us) service_pool.cc:224] Handling call
0709 13:13:04.317410 (+1350216us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ceee 0000000000375939 00007f61ed8f01e0 00007f61ed9b90c4 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:04.335738 (+ 18328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2773888}
I20260709 13:13:04.355111 31984 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:04.330193 29544 raft_consensus.cc:2410] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:04.355748 31984 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:04.356457 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.356757 31984 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.357530 31952 raft_consensus.cc:3055] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:04.357627 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.358049 31952 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:04.041425 32084 consensus_meta.cc:287] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.002s
I20260709 13:13:04.340958 32156 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:04.343233 32093 consensus_meta.cc:287] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 13:13:04.351594 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:04.355233 29540 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:04.369041 29543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.025s
W20260709 13:13:04.369663 29543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.010s	sys 0.025s
I20260709 13:13:04.369694 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.330986 29541 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:04.358353 29544 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:04.028867 32157 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.814899 31668 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:03.896828 32148 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.815166 32141 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:04.336728 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 85838.8us
I20260709 13:13:04.378381 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.379333 29540 raft_consensus.cc:2410] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:04.345193 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.188041 32096 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:03.835369 32092 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:03.890684 32155 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.891346 31837 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:03.862191 32123 raft_consensus.cc:697] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:03.893980 32082 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:04.137898 32099 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:03.891268 31961 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.294581 32136 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:04.316006 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:04.366220 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:04.434983 29394 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:13:04.435190 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 119288us
I20260709 13:13:04.328217 32153 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:04.355193 32145 raft_consensus.cc:670] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } [suppressed 6 similar messages]
I20260709 13:13:03.791838 32144 consensus_queue.cc:1059] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.562s
I20260709 13:13:04.371271 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.375502 29392 raft_consensus.cc:1240] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:04.338369 32143 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:04.381771 29537 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:04.387766 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:04.391325 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.340283 32100 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:04.407080 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 94001.6us
I20260709 13:13:04.415657 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1771) took 1466 ms. Trace:
I20260709 13:13:04.371304 31642 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:04.437602 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 111738us
I20260709 13:13:04.445595 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:04.430457 29541 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:04.331940 32146 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.485342 29469 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:04.485615 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.462203 29396 rpcz_store.cc:276] 0709 13:13:02.949699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.950041 (+   342us) service_pool.cc:224] Handling call
0709 13:13:04.415377 (+1465336us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540031d654. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:04.415568 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824354688}
I20260709 13:13:04.376991 32093 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.486285 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.496973 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:04.497507 29467 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:13:04.502316 29509 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.006s
W20260709 13:13:04.502759 29509 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.006s
W20260709 13:13:04.503654 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 532493us
I20260709 13:13:04.505239 29435 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:04.380349 32160 raft_consensus.cc:3055] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:04.508201 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.508260 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.508597 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:04.506754 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44267.5us
W20260709 13:13:04.471691 31991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.019s
I20260709 13:13:04.511300 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:04.440863 31570 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:04.513166 31570 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.516708 29537 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:04.441808 32082 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.324409 30152 rpcz_store.cc:276] 0709 13:13:02.506525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.508148 (+  1623us) service_pool.cc:224] Handling call
0709 13:13:02.540072 (+ 31924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.773112 (+233040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.817470 (+ 44358us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.888282 (+ 70812us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.256949 (+368667us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:03.264584 (+  7635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.277688 (+ 13104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.767207 (+489519us) raft_consensus.cc:1685] finished
0709 13:13:03.770301 (+  3094us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.778229 (+  7928us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158,"spinlock_wait_cycles":101252864,"thread_start_us":256970,"threads_started":1,"wal-append.queue_time_us":490222}
I20260709 13:13:04.518167 32142 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:04.498219 31690 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:04.510830 32160 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:04.519260 32100 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.519510 31690 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.519289 32082 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.519749 32160 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.517498 29540 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:04.520900 32160 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:04.521970 29540 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:13:04.522603 32142 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.523196 32142 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.523837 31642 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:04.523911 32168 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:13:04.524616 31642 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:04.525436 32084 consensus_queue.cc:1059] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:04.525720 32142 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:04.526681 32168 raft_consensus.cc:3055] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:04.526904 32158 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:13:04.527115 32168 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:04.528128 32168 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.528961 32156 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.467159 31961 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.378192 32157 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.536623 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:04.375483 31952 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.457495 32099 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.540347 32077 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:04.540828 32077 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.550890 29537 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:04.497036 29394 raft_consensus.cc:2410] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 7 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:13:04.677320 29397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1774) took 1725 ms (client timeout 2082 ms). Trace:
I20260709 13:13:04.678284 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1776) took 1059 ms. Trace:
I20260709 13:13:04.669214 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:04.671777 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:04.672034 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.678893 29394 rpcz_store.cc:276] 0709 13:13:03.618970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.445193 (+826223us) service_pool.cc:224] Handling call
0709 13:13:04.677992 (+232799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:04.680858 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:04.681734 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.685352 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 329) took 1326 ms. Trace:
I20260709 13:13:04.561950 31974 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.686976 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:04.688086 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:04.693150 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.685524 29391 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:13:04.694420 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.695331 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.696769 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:04.697340 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:04.440999 32059 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:04.565222 32068 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.851s	user 0.010s	sys 0.001s
W20260709 13:13:04.582952 32074 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.002s
I20260709 13:13:04.541335 32077 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:04.575999 32078 raft_consensus.cc:3055] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:04.783221 32078 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:04.578641 31870 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.786761 31952 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:04.787077 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:04.578328 31931 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:04.789665 29393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1893) took 2474 ms (client timeout 2004 ms). Trace:
W20260709 13:13:04.790289 29393 rpcz_store.cc:269] 0709 13:13:02.315189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.429150 (+113961us) service_pool.cc:224] Handling call
0709 13:13:04.789001 (+2359851us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54000a64d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:04.789312 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150769408}
I20260709 13:13:04.600363 32081 raft_consensus.cc:3055] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:04.820633 32082 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:04.831107 32081 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:04.831571 32082 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.835975 32082 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:04.565580 32086 consensus_meta.cc:287] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.127s	user 0.006s	sys 0.010s
I20260709 13:13:04.513929 31570 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.887066 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.561514 32090 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:04.893003 29389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1772) took 1942 ms (client timeout 1739 ms). Trace:
I20260709 13:13:04.893532 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.895161 31931 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:04.895287 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.896317 30156 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:04.897573 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.525033 31642 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.898948 31642 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:04.561136 32093 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:04.571293 32095 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.003s
I20260709 13:13:04.604450 32097 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:04.906035 32095 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:04.686693 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:04.908370 32086 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.562180 32099 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:04.515256 31991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.017s	sys 0.021s
I20260709 13:13:04.912928 31991 raft_consensus.cc:3055] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:04.913311 31991 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:04.707931 30158 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:04.740049 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 233478us
I20260709 13:13:04.916617 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:04.743077 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.751577 29469 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.919003 29394 raft_consensus.cc:2410] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:04.752650 32092 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:04.919687 29396 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:13:04.678161 29397 rpcz_store.cc:269] 0709 13:13:02.951950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.978075 (+ 26125us) service_pool.cc:224] Handling call
0709 13:13:04.676716 (+1698641us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b54002c15d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:04.676982 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95480192}
I20260709 13:13:04.920149 32092 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.921855 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 336) took 1538 ms. Trace:
I20260709 13:13:04.754515 32080 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.922765 31961 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.923609 31961 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:04.923300 32080 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.924033 31961 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:04.924458 31961 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.925917 32080 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.754873 32089 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.926994 32088 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.927100 32089 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.927838 32088 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.929308 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 327) took 1572 ms. Trace:
I20260709 13:13:04.929996 29469 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:04.758240 32104 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:04.758749 31899 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.930907 32104 consensus_queue.cc:1243] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:04.931104 31899 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.932281 32104 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:13:04.932848 32104 raft_consensus.cc:1068] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:04.934087 31899 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:04.763239 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1672) took 1271 ms. Trace:
I20260709 13:13:04.702217 29392 rpcz_store.cc:276] 0709 13:13:03.358791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.497967 (+139176us) service_pool.cc:224] Handling call
0709 13:13:03.528400 (+ 30433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.441806 (+913406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.684646 (+242840us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b540012f554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:04.685042 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947511552}
I20260709 13:13:04.766559 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2004) took 1041 ms. Trace:
I20260709 13:13:04.922231 29397 rpcz_store.cc:276] 0709 13:13:03.383301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.920668 (+1537367us) service_pool.cc:224] Handling call
0709 13:13:04.921122 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.921469 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.921496 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.921553 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:04.921594 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.921658 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.921773 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:04.768153 29538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 1997) took 2238 ms (client timeout 1875 ms). Trace:
I20260709 13:13:04.780095 32068 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:04.516584 32110 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.997s	user 0.015s	sys 0.000s
W20260709 13:13:04.604019 32114 consensus_meta.cc:287] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.925s	user 0.013s	sys 0.000s
I20260709 13:13:04.569814 32123 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.601918 32121 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.570482 32130 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:04.486932 32143 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.018102 32121 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.545032 32144 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.576642 32146 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:04.380630 32148 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.506142 32153 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.441496 32154 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:04.417073 32155 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.541175 32157 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:04.599416 32168 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.523692 32170 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:04.782454 32020 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:04.838723 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 172409us
I20260709 13:13:04.782073 32074 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.893019 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.895583 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1897) took 1927 ms. Trace:
I20260709 13:13:04.904631 32156 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.909255 32086 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:04.756283 32100 consensus_queue.cc:1059] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:04.931571 32115 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.760991 29467 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:13:04.762756 29471 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:04.936450 29470 rpcz_store.cc:276] 0709 13:13:03.490801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.491377 (+   576us) service_pool.cc:224] Handling call
0709 13:13:03.510481 (+ 19104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.520147 (+  9666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.520186 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:03.520240 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:03.520300 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.762006 (+1241706us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b540035c354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:04.762093 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.762402 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21572352}
I20260709 13:13:04.922760 32092 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:04.937157 29539 rpcz_store.cc:276] 0709 13:13:03.725209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.725412 (+   203us) service_pool.cc:224] Handling call
0709 13:13:03.725822 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.360192 (+634370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.360268 (+    76us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.360743 (+   475us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:04.360796 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.765893 (+405097us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54002c6fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:04.765984 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.766292 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458271104}
W20260709 13:13:04.937501 29538 rpcz_store.cc:269] 0709 13:13:02.531370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.531712 (+   342us) service_pool.cc:224] Handling call
0709 13:13:04.767616 (+2235904us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400409a54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:04.767859 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887388928}
I20260709 13:13:04.945963 32068 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.942492 29392 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:04.893533 29389 rpcz_store.cc:269] 0709 13:13:02.950076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.951130 (+  1054us) service_pool.cc:224] Handling call
0709 13:13:04.892531 (+1941401us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b540026fcd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:04.892740 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18432384}
I20260709 13:13:04.948112 32110 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.946135 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1781) took 1325 ms. Trace:
I20260709 13:13:04.953876 32114 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.963500 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1847) took 1569 ms. Trace:
I20260709 13:13:04.970664 29360 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:04.970741 32178 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.929709 29390 rpcz_store.cc:276] 0709 13:13:03.356803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.488317 (+131514us) service_pool.cc:224] Handling call
0709 13:13:03.514371 (+ 26054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.522659 (+  8288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.522705 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.530356 (+  7651us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.751982 (+1221626us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b1800409780. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:13:04.775182 (+ 23200us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:04.775480 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.775646 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.928798 (+153152us) raft_consensus.cc:1685] finished
0709 13:13:04.928818 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.929119 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9111,"raft.queue_time_us":14714,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":11206,"spinlock_wait_cycles":9284480,"thread_start_us":22727,"threads_started":1,"wal-append.queue_time_us":1245327}
I20260709 13:13:04.971470 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:04.972133 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53768.8us
I20260709 13:13:04.972371 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:04.973177 31675 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:04.975399 31919 consensus_meta.cc:287] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.105s	user 0.019s	sys 0.001s
I20260709 13:13:04.976601 29397 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:04.889716 31570 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:04.991730 32180 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 13:13:04.930233 32089 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:05.018563 32143 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:04.605844 32141 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.020028 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:05.020880 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 101702us
I20260709 13:13:05.021335 32106 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:05.036111 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:05.036778 29464 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:05.039410 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.047261 32144 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:04.962867 31991 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:05.078372 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.079934 32048 consensus_meta.cc:287] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.747s	user 0.017s	sys 0.003s
I20260709 13:13:05.055380 32146 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.109187 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1681) took 1341 ms. Trace:
W20260709 13:13:05.128721 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.121300 29544 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:13:05.149334 32154 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.129504 32153 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.154331 30160 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:05.187345 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 340) took 1328 ms. Trace:
I20260709 13:13:05.150345 29388 rpcz_store.cc:276] 0709 13:13:02.968273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.024676 (+ 56403us) service_pool.cc:224] Handling call
0709 13:13:04.892794 (+1868118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.893250 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.893274 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.893341 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.893371 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.893459 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.895239 (+  1780us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540026fcd0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:04.895368 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4295325056}
I20260709 13:13:05.447520 29468 rpcz_store.cc:276] 0709 13:13:03.385703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.457635 (+ 71932us) service_pool.cc:224] Handling call
0709 13:13:03.458037 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.624513 (+166476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.624569 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:03.624634 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:03.624683 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.954287 (+1329604us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002a44d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:04.954364 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.954627 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382116224}
I20260709 13:13:05.429333 32074 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:05.430814 32177 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.447s	user 0.004s	sys 0.002s
I20260709 13:13:05.465309 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1782) took 1836 ms. Trace:
I20260709 13:13:05.466614 29397 rpcz_store.cc:276] 0709 13:13:03.620937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.975746 (+1354809us) service_pool.cc:224] Handling call
0709 13:13:04.976314 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.453928 (+477614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.457718 (+  3790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:05.448436 29396 rpcz_store.cc:276] 0709 13:13:03.620658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.944861 (+1324203us) service_pool.cc:224] Handling call
0709 13:13:04.945374 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.945749 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.945788 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.945857 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:04.945910 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.945967 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.946068 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:05.458806 31952 consensus_meta.cc:287] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.012s
I20260709 13:13:05.452621 31909 raft_consensus.cc:1027] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: attempt to promote peer c65265f20d7e42b6bfe314c5d109bdf7: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:13:05.470019 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 324001us
I20260709 13:13:05.498286 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1784) took 1688 ms. Trace:
I20260709 13:13:05.510728 29388 rpcz_store.cc:276] 0709 13:13:03.831688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.460778 (+1629090us) service_pool.cc:224] Handling call
0709 13:13:05.492633 (+ 31855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.497854 (+  5221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.497900 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:05.497966 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:05.497998 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.498057 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.498202 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:05.501670 31642 consensus_meta.cc:287] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.004s
I20260709 13:13:05.502547 29545 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:05.507349 29542 raft_consensus.cc:2393] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:05.461216 31931 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.469439 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 338) took 2073 ms. Trace:
I20260709 13:13:05.508674 32141 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:05.520072 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.524394 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.352195 32130 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:05.521924 29392 rpcz_store.cc:276] 0709 13:13:03.383865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.941673 (+1557808us) service_pool.cc:224] Handling call
0709 13:13:04.942188 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.456381 (+514193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.456770 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:05.451411 29540 rpcz_store.cc:276] 0709 13:13:03.775260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.523109 (+747849us) service_pool.cc:224] Handling call
0709 13:13:04.523439 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:04.525259 (+  1820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.525288 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:04.674420 (+149132us) log.cc:844] Serialized 52 byte log entry
0709 13:13:04.776587 (+102167us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:05.010223 (+233636us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.055943 (+ 45720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.087805 (+ 31862us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.092381 (+  4576us) raft_consensus.cc:1685] finished
0709 13:13:05.092398 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.103245 (+ 10847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665,"prepare.queue_time_us":172284,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":44261,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":257,"thread_start_us":245090,"threads_started":2,"wal-append.queue_time_us":312869}
I20260709 13:13:05.445286 29541 rpcz_store.cc:276] 0709 13:13:03.760695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.512275 (+751580us) service_pool.cc:224] Handling call
0709 13:13:04.512616 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:04.527210 (+ 14594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.527246 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:04.553200 (+ 25954us) log.cc:844] Serialized 52 byte log entry
0709 13:13:04.836866 (+283666us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:04.837495 (+   629us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.837962 (+   467us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.838261 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.081011 (+242750us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5400251f54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:05.081076 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.090874 (+  9798us) raft_consensus.cc:1685] finished
0709 13:13:05.090900 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.101542 (+ 10642us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9639,"prepare.queue_time_us":277163,"prepare.run_cpu_time_us":1480,"prepare.run_wall_time_us":7987,"raft.queue_time_us":31309,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":68601,"spinlock_wait_cycles":84032512,"thread_start_us":98064,"threads_started":1,"wal-append.queue_time_us":257061}
W20260709 13:13:05.533774 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.535130 30154 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:05.351827 32091 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:05.536604 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 566273us
I20260709 13:13:05.536967 32091 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.537551 29360 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:05.452970 32146 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.522369 30153 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:05.547725 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 332) took 2165 ms. Trace:
I20260709 13:13:05.527837 31570 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:05.520881 31675 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:05.525264 31991 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:05.457283 31919 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.552053 29391 rpcz_store.cc:276] 0709 13:13:03.377270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.755613 (+1378343us) service_pool.cc:224] Handling call
0709 13:13:04.756359 (+   746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.757217 (+   858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.757265 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.758129 (+   864us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.828978 (+ 70849us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:04.829019 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.829112 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.542630 (+713518us) raft_consensus.cc:1685] finished
0709 13:13:05.542654 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.542805 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66506,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":55017,"thread_start_us":57401,"threads_started":1,"wal-append.queue_time_us":748445}
I20260709 13:13:05.468731 32115 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.462512 32048 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.514108 32106 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.518360 31642 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.577365 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:05.579561 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:05.580989 32121 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:05.581431 29360 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:05.581772 32110 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:05.582757 32091 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.584009 32059 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:05.585572 29395 raft_consensus.cc:2368] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4.
W20260709 13:13:05.592969 29544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1682) took 1832 ms (client timeout 2002 ms). Trace:
W20260709 13:13:05.593523 29544 rpcz_store.cc:269] 0709 13:13:03.761012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.371032 (+610020us) service_pool.cc:224] Handling call
0709 13:13:05.592656 (+1221624us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54002bbe54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:05.592860 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411925888}
I20260709 13:13:05.560521 32195 raft_consensus.cc:2764] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:05.604126 29390 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:05.604590 32154 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:05.605700 29542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2008) took 1863 ms (client timeout 2204 ms). Trace:
I20260709 13:13:05.606132 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:05.606206 29542 rpcz_store.cc:269] 0709 13:13:03.742788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.743114 (+   326us) service_pool.cc:224] Handling call
0709 13:13:05.605419 (+1862305us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54003a7d54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:05.605616 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3973092736}
I20260709 13:13:05.604619 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:05.530977 32178 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.531134 32156 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.581811 32121 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:05.624667 32081 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.628791 32088 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:05.630389 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2007) took 1889 ms. Trace:
I20260709 13:13:05.565912 31931 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:05.631266 29541 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:05.616263 32100 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:05.565661 32130 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.643124 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:05.619220 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:05.638144 29546 rpcz_store.cc:276] 0709 13:13:03.741220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.741506 (+   286us) service_pool.cc:224] Handling call
0709 13:13:03.741916 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.359976 (+618060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.360007 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.360047 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:04.360084 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.629901 (+1269817us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400396554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:05.629969 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.630146 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420829952}
W20260709 13:13:05.648180 29395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1779) took 2028 ms (client timeout 2691 ms). Trace:
I20260709 13:13:05.624089 32121 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:05.671065 29395 rpcz_store.cc:269] 0709 13:13:03.620058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.351272 (+731214us) service_pool.cc:224] Handling call
0709 13:13:05.634979 (+1283707us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001725d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:05.648101 (+ 13122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771002752}
I20260709 13:13:05.642599 32100 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.641886 32154 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:05.687288 32154 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:05.687860 32154 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:05.690883 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 70674.1us
I20260709 13:13:05.692042 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:05.693704 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:05.696286 32170 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.000s
I20260709 13:13:05.696830 32170 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:05.683956 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.635s (SENT)
I20260709 13:13:05.698643 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:05.699446 29471 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:05.699600 32143 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:05.699942 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 482) took 1009 ms. Trace:
I20260709 13:13:05.701010 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 480) took 1011 ms. Trace:
I20260709 13:13:05.684646 32091 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.701795 29463 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:05.700093 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1679) took 1003 ms. Trace:
I20260709 13:13:05.702663 32091 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.704113 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 335) took 2321 ms. Trace:
I20260709 13:13:05.705122 32091 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:05.701395 30159 rpcz_store.cc:276] 0709 13:13:04.689288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.766487 (+ 77199us) service_pool.cc:224] Handling call
0709 13:13:04.767124 (+   637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.767940 (+   816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.767980 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.847112 (+ 79132us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.126686 (+279574us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:05.126749 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.126847 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.700605 (+573758us) raft_consensus.cc:1685] finished
0709 13:13:05.700632 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.700782 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73091,"raft.queue_time_us":1622,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":47575,"thread_start_us":169795,"threads_started":1,"wal-append.queue_time_us":758420}
I20260709 13:13:05.677559 32121 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:05.709509 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2001) took 2016 ms. Trace:
W20260709 13:13:05.686879 31961 consensus_meta.cc:287] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.762s	user 0.005s	sys 0.012s
W20260709 13:13:05.712702 32193 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 13:13:05.712524 31961 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.682574 32088 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:05.715569 32088 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:05.715790 32078 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.716710 32146 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.717767 32089 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:05.718497 31642 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:05.721355 32168 consensus_meta.cc:287] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:13:05.717438 32078 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:05.724893 32077 consensus_meta.cc:287] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.941s	user 0.011s	sys 0.005s
I20260709 13:13:05.703078 29471 rpcz_store.cc:276] 0709 13:13:04.696524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.696791 (+   267us) service_pool.cc:224] Handling call
0709 13:13:05.699999 (+1003208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:05.700487 30154 rpcz_store.cc:276] 0709 13:13:04.690082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.697553 (+  7471us) service_pool.cc:224] Handling call
0709 13:13:04.698043 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.535714 (+837671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.699601 (+163887us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400467dd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:05.699816 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866642176}
I20260709 13:13:05.709998 29545 rpcz_store.cc:276] 0709 13:13:03.692836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.693570 (+   734us) service_pool.cc:224] Handling call
0709 13:13:03.717039 (+ 23469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.539108 (+1822069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.709143 (+170035us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54000f3cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:05.709419 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4094143360}
I20260709 13:13:05.733794 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 339) took 1070 ms. Trace:
I20260709 13:13:05.744305 29389 rpcz_store.cc:276] 0709 13:13:04.663775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.461239 (+797464us) service_pool.cc:224] Handling call
0709 13:13:05.632111 (+170872us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:05.646140 (+ 14029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.682654 (+ 36514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.682696 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:05.733389 (+ 50693us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:05.733464 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.733558 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.733710 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32506624}
I20260709 13:13:05.704622 29393 rpcz_store.cc:276] 0709 13:13:03.382933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.791601 (+1408668us) service_pool.cc:224] Handling call
0709 13:13:04.792295 (+   694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.951083 (+158788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.963106 (+ 12023us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:05.035332 (+ 72226us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.234234 (+198902us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:05.234299 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.234421 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.703801 (+469380us) raft_consensus.cc:1685] finished
0709 13:13:05.703835 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.704027 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133616,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":6828,"thread_start_us":208187,"threads_started":2,"wal-append.queue_time_us":516397}
I20260709 13:13:05.682137 32100 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:05.753358 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:05.725757 32148 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.758170 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:05.776901 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1783) took 1967 ms. Trace:
W20260709 13:13:05.776818 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 83254.7us
I20260709 13:13:05.739624 32077 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.764575 32086 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:05.802881 29466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1841) took 2373 ms. Trace:
I20260709 13:13:05.803368 29466 rpcz_store.cc:276] 0709 13:13:03.355377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.454746 (+ 99369us) service_pool.cc:224] Handling call
0709 13:13:03.455135 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.512841 (+ 57706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.512904 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.513532 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.767891 (+1254359us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18003f2bc0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:13:05.000931 (+233040us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:05.000971 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.006080 (+  5109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.711623 (+705543us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:05.728545 (+ 16922us) raft_consensus.cc:1685] finished
0709 13:13:05.728578 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.728769 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71858,"raft.queue_time_us":57275,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4795,"spinlock_wait_cycles":10004608,"thread_start_us":229811,"threads_started":1,"wal-append.queue_time_us":1722644}
I20260709 13:13:05.781443 32144 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:05.811816 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 255594us
I20260709 13:13:05.791528 31919 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:05.815048 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:05.770869 32168 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:13:05.815505 32048 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:05.838858 32199 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.311s	user 0.004s	sys 0.000s
I20260709 13:13:05.827385 32156 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:05.826485 32130 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.781252 31675 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.875545 32125 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.876256 32125 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.877606 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.878666 29466 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:05.845353 32148 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.882308 32148 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.882543 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 478) took 1193 ms. Trace:
I20260709 13:13:05.883198 30157 rpcz_store.cc:276] 0709 13:13:04.688619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.700441 (+ 11822us) service_pool.cc:224] Handling call
0709 13:13:04.700986 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.019309 (+318323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.019345 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:05.019404 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:05.019439 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.882105 (+862666us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54006428d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:05.882158 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.882297 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731220736}
W20260709 13:13:05.885370 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.885921 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.882537 32146 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.830296 32086 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:05.888988 32020 consensus_meta.cc:287] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.743s	user 0.015s	sys 0.000s
I20260709 13:13:05.906688 32146 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.895272 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 481) took 1205 ms. Trace:
I20260709 13:13:05.907632 30160 rpcz_store.cc:276] 0709 13:13:04.689667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.707060 (+ 17393us) service_pool.cc:224] Handling call
0709 13:13:04.707552 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.445680 (+738128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.895013 (+449333us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400133b54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:05.895205 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016760704}
I20260709 13:13:05.895985 32155 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:05.896013 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:05.909081 32146 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.910108 29438 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:05.910571 32170 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:05.911044 32170 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.911405 32170 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:05.911695 29438 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:05.913549 32205 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:05.914067 32205 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:05.914841 31870 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:05.915270 31870 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.915650 31870 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:05.915122 32205 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.912681 29438 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:05.920145 32204 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:05.920712 32204 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:05.897781 32123 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:05.898826 32203 log.cc:927] Time spent T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:13:05.878598 32207 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:05.923908 32207 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.924160 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.892715 32114 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:05.907128 31878 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.887480 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 95801.6us
I20260709 13:13:05.846642 32106 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:05.878857 32125 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.937605 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.926245 32207 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:05.940336 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 113353us
I20260709 13:13:05.927814 32178 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:05.935945 32130 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.936229 31878 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:05.947149 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.947587 30156 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:05.947819 29466 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:05.952298 32077 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.962318 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:05.963271 29463 raft_consensus.cc:2393] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:05.778621 29394 rpcz_store.cc:276] 0709 13:13:03.809668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.989684 (+1180016us) service_pool.cc:224] Handling call
0709 13:13:04.990277 (+   593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.990962 (+   685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.991002 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.991764 (+   762us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.337231 (+345467us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:05.773353 (+436122us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.774648 (+  1295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.774762 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.774822 (+    60us) raft_consensus.cc:1685] finished
0709 13:13:05.774840 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.776809 (+  1969us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2039,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":4446,"thread_start_us":544586,"threads_started":2,"wal-append.queue_time_us":590837}
I20260709 13:13:05.964166 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.964998 29470 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:05.965167 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 483) took 1274 ms. Trace:
I20260709 13:13:05.965241 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.966097 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.966472 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.967022 29464 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:05.968008 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:05.969213 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:05.970605 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:05.971365 29512 connection.cc:256] RPC call timeout handler was delayed by -1.0247399269999278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
I20260709 13:13:05.972295 29512 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:05.972926 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0577835050000886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2848s for a response
W20260709 13:13:05.973863 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.974114 32125 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:05.974501 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.973457 29512 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:05.939292 32148 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:05.977072 32146 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:05.979363 32146 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.982733 32091 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.982563 32121 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.983498 32091 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:05.988543 31952 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:05.977246 32130 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.982132 32146 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:05.974776 32125 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:05.993532 32081 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:05.985051 32110 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.998479 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 60557.7us
I20260709 13:13:05.954312 31931 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.004084 31952 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:06.043466 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.965658 30155 rpcz_store.cc:276] 0709 13:13:04.690501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.698536 (+  8035us) service_pool.cc:224] Handling call
0709 13:13:04.699161 (+   625us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:04.699877 (+   716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.699909 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:04.700992 (+  1083us) log.cc:844] Serialized 52 byte log entry
0709 13:13:04.829243 (+128251us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:05.006699 (+177456us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.964506 (+957807us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54000abf20. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e891c733 00007f61e89a1dbf 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c
0709 13:13:05.964573 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.964661 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.964707 (+    46us) raft_consensus.cc:1685] finished
0709 13:13:05.964796 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.964956 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185446,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":53848,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":4350,"spinlock_wait_cycles":39772672,"thread_start_us":304534,"threads_started":2,"wal-append.queue_time_us":238669}
I20260709 13:13:06.045727 31961 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:06.008700 31878 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:06.006284 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 576) took 1115 ms. Trace:
I20260709 13:13:06.047091 30156 rpcz_store.cc:276] 0709 13:13:04.891193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.897146 (+  5953us) service_pool.cc:224] Handling call
0709 13:13:06.005991 (+1108845us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400271354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:06.006170 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413242624}
I20260709 13:13:05.993903 32204 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:13:06.017040 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.018925 32125 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:06.050838 32192 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:05.998042 32091 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.051689 32192 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.034920 32155 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:13:06.053265 32155 raft_consensus.cc:1068] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:13:06.050832 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.037549 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1787) took 1375 ms. Trace:
I20260709 13:13:06.054689 29390 rpcz_store.cc:276] 0709 13:13:04.662563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.461283 (+798720us) service_pool.cc:224] Handling call
0709 13:13:05.519573 (+ 58290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.604666 (+ 85093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.037238 (+432572us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b54001720d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:06.037476 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193851648}
I20260709 13:13:06.055984 32121 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.039533 32130 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:06.063228 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47565.2us
I20260709 13:13:06.063719 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:06.039975 32153 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:06.073948 32153 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:06.041356 32115 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.042815 31952 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.077349 31952 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:06.004314 32148 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.046459 31961 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:06.031175 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.078411 31961 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.078356 32148 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.086872 31961 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.087389 32192 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.088768 32148 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:06.093786 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 95993.3us
I20260709 13:13:06.094800 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 340) took 1430 ms. Trace:
I20260709 13:13:06.096052 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:06.096262 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.096819 30151 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:06.097985 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.098315 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:06.098690 30156 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.103381 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.104018 30155 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.108150 30153 raft_consensus.cc:2410] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:06.113354 29294 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 3 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.115684 32121 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:06.116273 32121 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.116725 32121 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:06.116617 29294 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 6, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.118650 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:06.122555 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:06.123358 30151 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:06.124615 29360 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:06.125552 32144 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.126081 32144 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.126571 32178 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:06.128970 32178 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:06.132308 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 127258us
I20260709 13:13:06.129446 32178 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:06.122254 29294 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:06.133564 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 52436.1us
I20260709 13:13:06.093057 32110 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.095245 29397 rpcz_store.cc:276] 0709 13:13:04.664247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.467378 (+803131us) service_pool.cc:224] Handling call
0709 13:13:05.535647 (+ 68269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:05.551756 (+ 16109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.551799 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:05.590160 (+ 38361us) log.cc:844] Serialized 52 byte log entry
0709 13:13:05.697452 (+107292us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800409540. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:13:05.825643 (+128191us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:06.059755 (+234112us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:06.093225 (+ 33470us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.093561 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.093633 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:06.093678 (+    45us) raft_consensus.cc:1685] finished
0709 13:13:06.093689 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.094731 (+  1042us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8208,"prepare.queue_time_us":15313,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":22755,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":15155,"spinlock_wait_cycles":117363840,"thread_start_us":376981,"threads_started":2,"wal-append.queue_time_us":345718}
I20260709 13:13:06.095012 32170 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.138161 32154 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.156131 29512 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:06.156987 32130 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:06.157994 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.167158 29390 raft_consensus.cc:2410] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:06.133371 32148 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.160192 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.144980 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:06.163695 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.163996 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.174054 29360 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:06.179446 29294 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.192703 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.192952 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.200188 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.204644 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.166579 31991 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.206658 30156 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:06.200843 29397 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:06.214763 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.216181 32141 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:06.217141 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 61120us
I20260709 13:13:06.218757 29512 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:06.222214 32218 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:06.222673 32218 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:06.223013 32218 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:06.226641 32146 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:06.227094 32146 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.227456 32146 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:06.233741 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.234630 29468 raft_consensus.cc:2368] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:13:06.180374 32144 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:06.259743 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.261103 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.263062 32048 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:06.263605 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.265004 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.266317 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.267479 29294 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 4, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 4 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.249264 30155 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:13:06.258428 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44920.5us
I20260709 13:13:06.274374 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.179123 32148 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.284062 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.284721 29394 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:06.212461 31878 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.280401 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:06.283703 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 109752us
W20260709 13:13:06.287176 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.293377 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:06.295881 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 150983us
I20260709 13:13:06.306000 29294 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 4, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 4 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.307715 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.308671 30156 raft_consensus.cc:2410] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:06.309713 29397 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:13:06.310492 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53703.4us
I20260709 13:13:06.238752 31991 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.310141 29397 pending_rounds.cc:85] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 2
W20260709 13:13:06.314047 32089 consensus_meta.cc:287] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.596s	user 0.003s	sys 0.012s
I20260709 13:13:06.317502 29397 pending_rounds.cc:107] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:06.325733 31931 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:06.326903 29294 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:06.336427 31870 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.338470 32110 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:06.339285 32213 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:13:06.339849 32154 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.339931 32130 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.343590 29397 raft_consensus.cc:2889] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:06.357424 29463 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:06.359678 30155 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:06.301072 31878 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.382213 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:06.387560 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 72382.5us
I20260709 13:13:06.349408 32089 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:06.390003 29467 raft_consensus.cc:2368] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
I20260709 13:13:06.387679 29294 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 3 to 5, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 5 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.393283 32148 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:06.398327 29290 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 282) took 20318 ms (client timeout 15000 ms). Trace:
I20260709 13:13:06.398766 32170 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.394074 32130 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.414355 31878 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.435454 29397 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:06.436041 29397 pending_rounds.cc:85] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 2
I20260709 13:13:06.436362 29397 pending_rounds.cc:107] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:06.436691 29397 raft_consensus.cc:2889] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:06.436849 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.437793 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.438723 29391 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:06.398350 32154 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:06.420257 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.402240 32091 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.420634 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.452248 29469 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:06.420979 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.427013 29390 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:06.430101 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:06.430958 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.419592 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.453567 30155 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:06.430526 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:06.434669 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 54614.9us
I20260709 13:13:06.454608 30151 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:06.430667 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.426373 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.419919 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.438200 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:06.386586 32100 consensus_meta.cc:287] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.000s
I20260709 13:13:06.427384 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.435027 29463 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:06.459606 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:06.461522 29392 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:06.457892 29294 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 3 to 4, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:06.469950 29543 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:06.471489 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:06.473217 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.473352 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.475458 29545 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:06.431556 30153 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:06.427623 31991 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.429590 29395 raft_consensus.cc:2955] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:06.479439 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.429025 31870 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.433991 32130 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:06.491900 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.492275 29463 raft_consensus.cc:2368] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4.
I20260709 13:13:06.492693 29466 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:06.493592 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.494525 29471 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:06.495702 29539 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:06.499199 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.493011 29294 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 3 to 6, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.502949 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.506413 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.508713 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:06.417876 32218 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.509176 29541 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:06.497057 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:06.421557 31690 consensus_queue.cc:1059] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:13:06.502378 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.511196 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.514875 29471 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 2.
I20260709 13:13:06.513221 29546 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.514173 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.519106 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.458388 32146 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.520998 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.524426 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.526574 29470 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:06.520373 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.525671 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.529170 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.515458 32081 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:13:06.503881 31642 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:06.468127 32100 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.533156 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:06.524257 30126 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.947s (SENT) [suppressed 8 similar messages]
I20260709 13:13:06.534701 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.536578 29543 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:06.536484 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.539999 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.467937 32148 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:13:06.542585 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.543066 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.521193 31878 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.482621 32154 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:06.534664 31690 raft_consensus.cc:3055] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:06.543252 29541 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:06.547120 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.547890 29397 raft_consensus.cc:2376] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 2. Re-sending same reply.
I20260709 13:13:06.549345 32100 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:06.554944 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.555320 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:06.530738 32130 consensus_queue.cc:1059] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:13:06.555953 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.509410 32178 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.557183 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:06.580291 29538 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:06.558127 32148 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:13:06.542001 32081 raft_consensus.cc:1068] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:06.562503 32091 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:06.562680 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:06.589608 30156 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:06.562988 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:06.563578 29435 connection.cc:256] RPC call timeout handler was delayed by -1.875655806000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2765s for a response
I20260709 13:13:06.563999 32141 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:06.564157 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:06.565126 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.565378 29464 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
W20260709 13:13:06.567030 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.614619 29397 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:06.615046 29544 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:06.528401 29294 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:06.525247 32205 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:06.619212 32081 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:06.619941 32081 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.621045 29464 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:06.577621 29472 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:06.581885 29471 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:06.561285 30153 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:13:06.582228 29466 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:06.582885 32148 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:06.585018 32154 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.585711 29388 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:06.586026 31952 raft_consensus.cc:3055] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:06.575074 31690 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:06.590287 29435 connection.cc:256] RPC call timeout handler was delayed by -1.5140751730000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 13:13:06.629484 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 110323us
I20260709 13:13:06.630707 29469 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:06.643801 29392 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:06.633919 29389 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:06.640604 29471 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:06.642477 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 78399.3us
W20260709 13:13:06.645228 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 121004us
I20260709 13:13:06.622207 32081 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:06.646595 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.631145 30153 pending_rounds.cc:85] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 4
I20260709 13:13:06.659126 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.557183 31642 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.575233 31878 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.687425 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.580704 32121 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.636384 31952 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:06.696802 29541 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:06.675523 30153 pending_rounds.cc:107] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:13:06.661020 32048 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.701256 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.704862 29467 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:06.704349 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:06.708166 29539 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.677577 32091 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:06.707988 30153 raft_consensus.cc:2889] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:06.398984 29290 rpcz_store.cc:269] 0709 13:12:46.031998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.068651 (+ 36653us) service_pool.cc:224] Handling call
0709 13:13:06.344486 (+20275835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:02.911269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:02.911953 (+   684us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:02.911995 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:13:02.912012 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:02.912806 (+   794us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:02.912872 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:02.912898 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:13:02.913712 (+   814us) tablet.cc:701] Row locks acquired
0709 13:13:02.913732 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:13:02.913909 (+   177us) write_op.cc:270] Start()
0709 13:13:02.914051 (+   142us) write_op.cc:276] Timestamp: P: 1783602782913847 usec, L: 0
0709 13:13:02.914077 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:13:02.914842 (+   765us) log.cc:844] Serialized 2099 byte log entry
0709 13:13:04.258775 (+1343933us) op_driver.cc:464] REPLICATION: finished
0709 13:13:04.558428 (+299653us) write_op.cc:301] APPLY: starting
0709 13:13:04.558577 (+   149us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:04.558771 (+   194us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:04.558904 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:04.590838 (+ 31934us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:04.591171 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:13:04.591240 (+    69us) write_op.cc:312] APPLY: finished
0709 13:13:04.591580 (+   340us) log.cc:844] Serialized 47 byte log entry
0709 13:13:04.591865 (+   285us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:04.592032 (+   167us) write_op.cc:454] Released schema lock
0709 13:13:04.592098 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:04.592664 (+   566us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:04.592707 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57791,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":261367,"apply.run_cpu_time_us":3771,"apply.run_wall_time_us":34204,"num_ops":5,"prepare.queue_time_us":268733,"prepare.run_cpu_time_us":18449,"prepare.run_wall_time_us":345990,"raft.queue_time_us":352990,"raft.run_cpu_time_us":8801,"raft.run_wall_time_us":302950,"replication_time_us":1291020,"thread_start_us":610020,"threads_started":4,"wal-append.queue_time_us":465286,"wal-append.run_cpu_time_us":10439,"wal-append.run_wall_time_us":2205117}]]}
I20260709 13:13:06.717681 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:06.722247 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.619946 32205 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.723560 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.729902 29393 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:06.720794 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.732474 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.743191 29466 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:06.748849 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.759531 29541 raft_consensus.cc:2410] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:06.765092 30156 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:06.770916 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:06.772815 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 67575.2us
I20260709 13:13:06.772878 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.774304 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.768419 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:06.727818 32091 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:06.780505 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.782809 29390 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:06.773193 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.785001 29471 raft_consensus.cc:2368] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4.
I20260709 13:13:06.781401 29464 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:06.788064 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:06.788581 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.791182 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.791430 29396 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:06.791756 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.799140 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:06.757680 32089 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:06.729079 32048 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.794283 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.810614 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:06.810663 29397 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:06.815936 29393 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:06.812527 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:06.809763 29539 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:06.816838 29467 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:06.733403 32081 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:13:06.820362 29541 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:13:06.815951 29545 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:13:06.824033 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 71523.9us
I20260709 13:13:06.824925 29397 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:06.703788 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:06.832686 29472 raft_consensus.cc:606] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:06.835930 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:06.837342 29392 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:06.778064 32192 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:13:06.833472 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 84872.2us
I20260709 13:13:06.845163 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:06.818063 32154 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:06.814558 32218 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:06.860917 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.848404 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.863390 29465 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:06.850736 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.736812 32148 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.821386 32146 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:06.825335 31870 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:06.884953 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:06.887799 29541 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:06.791359 31952 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.832057 32141 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:13:06.892025 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.867888 32178 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:06.869405 31931 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:06.873090 31870 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:06.800143 31690 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:06.908710 29539 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:13:06.904837 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 69033.5us
W20260709 13:13:06.918140 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 73059.8us
I20260709 13:13:06.920161 29363 leader_election.cc:400] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:13:06.920547 29363 leader_election.cc:403] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:13:06.922399 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:06.924551 32178 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:06.930280 29363 leader_election.cc:400] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
I20260709 13:13:06.933531 29363 leader_election.cc:403] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:13:06.936439 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:06.906730 31870 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:06.914479 32242 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:06.904486 32089 raft_consensus.cc:697] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:06.913841 32192 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:06.916299 31642 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:06.955682 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:06.956698 29539 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:13:06.957463 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.962808 29546 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:06.964359 29435 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:06.937999 32121 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:06.979946 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.980618 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 44272us
I20260709 13:13:06.948115 32242 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:06.940343 32100 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:13:06.988780 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:06.989730 32231 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:13:06.990361 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.990700 31878 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:06.989042 32235 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:13:06.991892 32089 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.992475 32081 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:06.992772 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.993063 32081 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:06.993638 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:06.994069 32081 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.994831 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:06.997481 32192 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:06.998566 32192 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:06.999835 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:07.002252 32247 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:07.002898 32247 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:07.005252 32247 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:07.001399 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:07.006673 29465 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:07.007593 32154 raft_consensus.cc:697] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:07.008759 32154 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.015024 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.015692 29539 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:07.018028 29544 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:06.980897 32114 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.937079 32091 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:07.021428 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 57200.9us
I20260709 13:13:06.981593 32248 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:06.986889 32205 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:07.034402 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.034029 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.035426 29544 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:07.017395 32204 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:07.037874 29435 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:07.040789 32230 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:13:07.045259 32217 raft_consensus.cc:3055] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:07.056365 32217 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:07.046770 32234 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 13:13:07.047080 32205 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:07.049213 29538 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:07.012991 32242 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:07.062762 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.065135 29544 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:07.066668 30156 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:07.066856 29539 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:07.043489 32204 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:07.094491 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.119998 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.135433 30156 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:07.025583 32114 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.148388 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:07.149071 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.149982 29544 raft_consensus.cc:2410] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:07.033157 31870 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.059725 32205 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:07.151754 29388 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:07.151589 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:07.181696 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:07.064973 32212 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:13:07.193563 29539 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:13:07.194793 29363 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.833s (SENT)
I20260709 13:13:07.195294 29363 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:07.087865 32204 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:07.192345 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:07.197418 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.199368 29539 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:07.203588 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.200383 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.204257 29470 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:07.205421 29546 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:07.136176 31878 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:07.209407 32114 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:07.209894 29544 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:07.210359 31870 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.208056 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:07.212615 32250 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:07.213265 32250 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.193151 32081 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.215240 32081 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.216262 32250 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.182948 32205 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:07.223450 29472 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:13:07.225790 32114 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.219679 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.226311 32114 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:07.226913 32114 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.227066 30153 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:07.222820 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:07.230695 32245 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:07.231285 32245 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.231741 32245 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:07.235165 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:07.235036 32237 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:07.229161 32178 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:13:07.236456 32237 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:07.236822 32237 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:07.237707 32237 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.239454 32237 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:07.207840 32192 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:07.250193 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.219483 32242 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:07.258550 29396 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:07.263540 29546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36373f233812459591c31993a4959894"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:13:07.264424 29546 raft_consensus.cc:606] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:07.225057 32246 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:07.268957 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.253539 31991 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:07.221909 31878 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.274945 29538 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:13:07.275673 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53215.2us
I20260709 13:13:07.279452 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:07.279498 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:07.268321 32246 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.268698 32081 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.290212 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.274605 31991 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:07.292955 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.294632 31878 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:07.302753 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.283378 31870 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.303959 31870 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:07.301465 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.302572 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:07.244428 32217 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:07.287147 32154 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:07.332316 32154 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:07.332808 32154 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:07.323603 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:07.324779 32227 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.524s	user 0.002s	sys 0.000s
W20260709 13:13:07.325232 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 45879.3us
W20260709 13:13:07.326701 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.285032 32233 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:13:07.330821 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.286729 32246 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:07.337742 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.341768 32048 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.291319 32192 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:13:07.309749 31991 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:07.339107 32259 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:07.341818 31878 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:07.352070 31878 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:07.352342 31642 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:07.353196 31878 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.342134 29538 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:07.350910 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.342962 32110 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:07.306741 32248 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
I20260709 13:13:07.357946 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.365852 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.335547 32081 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:07.342705 32254 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
I20260709 13:13:07.369215 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.369936 29465 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:07.372399 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1904) took 1059 ms. Trace:
I20260709 13:13:07.372782 29394 rpcz_store.cc:276] 0709 13:13:06.313065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.313247 (+   182us) service_pool.cc:224] Handling call
0709 13:13:06.325414 (+ 12167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.378041 (+ 52627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.378094 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.386065 (+  7971us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.547112 (+161047us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:06.812321 (+265209us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.823537 (+ 11216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.823626 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.324070 (+500444us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:07.364378 (+ 40308us) raft_consensus.cc:1685] finished
0709 13:13:07.372171 (+  7793us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.372326 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18504,"prepare.queue_time_us":86067,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":16549,"raft.queue_time_us":73603,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":27823,"spinlock_wait_cycles":24669056,"thread_start_us":314762,"threads_started":2,"wal-append.queue_time_us":272633}
I20260709 13:13:07.345536 32148 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:07.381676 31931 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:07.382656 32048 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:07.383306 32048 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.384577 31931 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:07.356416 32110 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:07.386720 32110 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.387612 32110 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:07.390733 31870 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:07.391242 32255 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:13:07.376108 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:07.363125 31878 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:07.364364 32217 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.405045 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.385602 32048 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.405900 29465 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:07.355962 32264 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:07.398478 32081 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.414693 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:07.419358 32257 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 13:13:07.419859 32081 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.408257 32100 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:07.420740 32100 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.421115 32100 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:07.424187 29393 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:07.432878 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:07.433751 30155 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:07.436851 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:07.438441 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.440717 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.442117 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.442812 30158 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:07.445921 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39036 (request call id 322) took 1009 ms. Trace:
I20260709 13:13:07.446342 29467 rpcz_store.cc:276] 0709 13:13:06.436859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.479675 (+ 42816us) service_pool.cc:224] Handling call
0709 13:13:07.445721 (+966046us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002a4ed4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:07.445852 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427453184}
W20260709 13:13:07.448637 32238 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.662s	user 0.006s	sys 0.022s
I20260709 13:13:07.449564 29466 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:07.454248 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 311) took 1038 ms. Trace:
W20260709 13:13:07.420300 32251 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.386s	user 0.003s	sys 0.000s
I20260709 13:13:07.454633 29463 rpcz_store.cc:276] 0709 13:13:06.416200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.582720 (+166520us) service_pool.cc:224] Handling call
0709 13:13:06.612116 (+ 29396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.791861 (+179745us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:06.834216 (+ 42355us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.946369 (+112153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.946454 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:06.946506 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.453267 (+506761us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b18003dab00. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419
0709 13:13:07.453986 (+   719us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001e5854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:07.454052 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.454182 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22977,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3282,"raft.queue_time_us":83,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":9752,"spinlock_wait_cycles":794003968,"thread_start_us":59865,"threads_started":1,"wal-append.queue_time_us":181935}
I20260709 13:13:07.458206 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.459014 30153 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:07.460917 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.461530 30153 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:07.466501 29360 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:07.467733 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.467917 31961 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:07.469882 29360 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:07.470718 31961 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:07.471243 32249 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.427s	user 0.000s	sys 0.004s
I20260709 13:13:07.471201 31961 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.473137 31961 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:07.474385 31690 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.481400 31952 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:07.488297 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.489171 29512 leader_election.cc:400] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4.
I20260709 13:13:07.489558 29512 leader_election.cc:403] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:07.491443 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.492164 29541 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:07.492465 32228 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4.
I20260709 13:13:07.493338 32228 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:07.493929 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.495795 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.496551 29541 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:07.498929 29512 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:07.499120 29471 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:07.500639 32130 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:07.501190 32130 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:07.501314 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:07.502058 29470 raft_consensus.cc:2376] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6. Re-sending same reply.
I20260709 13:13:07.504344 32077 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.505079 32077 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.401687 32204 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:07.508042 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 93520.1us
W20260709 13:13:07.509224 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.509999 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.531598 32089 raft_consensus.cc:3055] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:07.461915 32245 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.502194 32130 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:07.678646 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.605366 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 245605us
W20260709 13:13:07.583336 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.686465 29389 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:07.686856 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 341293us
I20260709 13:13:07.553369 29471 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:13:07.532639 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.532143 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.689677 29537 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:07.581996 30155 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:13:07.595595 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.694419 32048 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:07.695066 32048 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.697324 32048 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.688872 29470 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:13:07.562879 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 770149us
I20260709 13:13:07.704718 29438 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:07.705673 29468 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:07.706079 29438 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:07.702863 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 147463us
I20260709 13:13:07.709192 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:07.711874 29467 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:07.712335 29392 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:07.715041 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:07.714970 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.717439 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:07.727341 29463 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:07.725847 29512 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:07.724478 30123 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:07.729660 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:07.730309 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:07.730993 29394 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:07.532199 32089 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:07.682667 32077 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.732195 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:07.732249 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:07.736954 30159 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:07.738993 32091 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:07.729636 32114 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.004s
I20260709 13:13:07.739414 32091 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.739820 32091 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:07.739646 32114 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.741511 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.741952 32114 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:07.742636 30156 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:07.730921 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:07.728138 32232 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:13:07.738624 32205 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.743028 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.821336 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.742195 29539 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:07.826707 29463 raft_consensus.cc:3055] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:07.827193 29463 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:07.831293 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.831440 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.832602 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.833026 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:07.851473 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 120645us
I20260709 13:13:07.709142 32263 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:13:07.743834 32233 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:07.859203 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:07.736991 32178 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:07.867962 29465 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:07.876439 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 403548us
I20260709 13:13:07.874261 29388 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
W20260709 13:13:07.866621 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 121642us
I20260709 13:13:07.867280 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:07.858682 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.863353 32170 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:07.831527 32114 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:07.879747 30155 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:07.866775 29537 raft_consensus.cc:2376] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3. Re-sending same reply.
I20260709 13:13:07.885644 29546 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:07.885535 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.859980 29463 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.888581 29463 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:07.884950 32237 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:07.890249 32237 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:07.890648 32237 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:07.852218 32204 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.746156 31961 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:07.874748 32233 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.880548 32178 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.832466 31952 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:13:07.909245 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 200803us
I20260709 13:13:07.907305 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.887907 32242 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:07.915458 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.870963 32081 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:13:07.888463 32048 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:07.917554 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:07.919194 29471 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:07.919935 31961 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.921271 29393 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:13:07.924853 32154 consensus_meta.cc:287] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.001s
I20260709 13:13:07.925290 32154 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:07.926714 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:07.911018 32233 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:07.909293 32178 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:07.931962 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 225977us
I20260709 13:13:07.932744 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:07.943459 32141 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:07.944120 32141 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:07.948675 29438 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:07.915633 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.917371 32048 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:07.962205 32268 raft_consensus.cc:993] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:07.926568 32242 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:07.965135 32242 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:07.965973 32205 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:07.967272 32245 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:07.969031 32154 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:07.970629 32077 consensus_queue.cc:1059] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:07.972240 32077 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:07.972702 32077 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:07.978689 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.981570 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:07.987046 29539 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:13:07.987740 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:08.003837 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.005028 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.005704 29539 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:13:08.007407 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.008205 29539 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
W20260709 13:13:07.965155 31991 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.600s	user 0.003s	sys 0.005s
I20260709 13:13:07.930693 32228 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:13:08.010026 29465 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:08.032164 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 135754us
I20260709 13:13:07.958544 32048 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:08.037012 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 55526.7us
I20260709 13:13:07.953368 31909 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:08.035789 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48143.2us
I20260709 13:13:08.035538 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:08.038635 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:08.039333 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.003832 31642 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:07.999563 32170 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:08.040583 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.043660 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:08.046687 29509 connection.cc:256] RPC call timeout handler was delayed by -2.0027084989999366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2691s for a response
W20260709 13:13:08.047048 29509 connection.cc:256] RPC call timeout handler was delayed by -1.9796550659998502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 13:13:08.035145 30153 raft_consensus.cc:2393] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:08.058933 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:08.059902 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:07.973920 32077 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.059983 29544 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:08.040681 32272 raft_consensus.cc:1081] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:08.004884 31870 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:13:08.060322 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:08.055231 32100 consensus_meta.cc:287] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.003s
I20260709 13:13:08.049700 32263 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:08.071365 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:08.058305 32246 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.717s	user 0.000s	sys 0.012s
I20260709 13:13:08.056804 32264 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:07.955627 32089 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.008857 32273 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:13:08.070281 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.072324 30160 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:08.034809 31991 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.057704 31642 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:08.081748 29543 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:08.068166 32258 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:08.087002 30157 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:08.058163 31690 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:13:08.087417 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:08.095321 29543 raft_consensus.cc:2376] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7. Re-sending same reply.
I20260709 13:13:08.093861 29463 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:08.076398 32246 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.096267 29463 pending_rounds.cc:85] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 5
I20260709 13:13:08.098927 29463 pending_rounds.cc:107] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:08.099212 29463 raft_consensus.cc:2889] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:08.066543 32204 consensus_queue.cc:1059] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:13:08.068841 32154 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:13:08.114277 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.085697 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.068336 32268 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:13:08.084980 32170 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:08.070735 32130 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:13:08.073238 32100 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.094862 32276 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.097056 32258 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:08.133299 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.137243 32245 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:13:08.138633 32276 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.157995 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:08.158910 30152 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:08.158129 32154 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:08.167860 29537 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
W20260709 13:13:08.171988 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 116267us
I20260709 13:13:08.174039 29543 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:08.146464 32279 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.148512 32274 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:08.185310 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 140939us
I20260709 13:13:08.138656 31909 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:08.211249 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.162488 32276 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:08.183871 32246 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:08.153079 32237 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.217448 29463 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:08.218760 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:08.210654 32217 consensus_meta.cc:287] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.802s	user 0.007s	sys 0.007s
I20260709 13:13:08.223248 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:08.189990 32264 raft_consensus.cc:697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:08.144764 31642 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.220640 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:08.241067 29466 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:08.232923 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:08.230877 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:08.237285 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:08.173259 32154 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.243381 29467 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:08.245397 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 56137.8us
I20260709 13:13:08.249804 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:08.252614 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.237388 32276 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:08.191912 32274 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.205681 32091 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:08.258755 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 211204us
W20260709 13:13:08.278179 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 234899us
I20260709 13:13:08.279206 32237 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:08.280229 29540 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:08.279284 32091 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:08.282694 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4450550659998953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 13:13:08.282887 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:08.283278 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4309037119999175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29150000000000004s for a response
W20260709 13:13:08.283619 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2746084989998963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.35000000000000003s for a response
I20260709 13:13:08.286618 32141 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.243968 32283 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:08.291860 32141 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:08.258049 32246 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:13:08.293684 32272 raft_consensus.cc:3055] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:08.258224 30154 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:08.294310 32272 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:08.209064 32258 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.253849 32048 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.293772 32246 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:08.301060 29466 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:08.301760 29463 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:08.277755 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:08.305840 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.306787 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:08.307097 30151 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:08.308260 29467 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
W20260709 13:13:08.309964 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.316123 29463 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:08.316857 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:08.316810 29470 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:08.320298 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:08.321084 30123 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:08.324759 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:08.191354 32279 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:08.259202 32276 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:08.332739 30151 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.259907 31991 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:08.328452 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:08.295267 32272 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.334164 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:08.339519 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 145376us
I20260709 13:13:08.335705 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:08.303745 32246 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:08.326392 31878 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:08.347770 29389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1924) took 1280 ms (client timeout 1674 ms). Trace:
W20260709 13:13:08.352177 29389 rpcz_store.cc:269] 0709 13:13:07.067035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.067248 (+   213us) service_pool.cc:224] Handling call
0709 13:13:08.347586 (+1280338us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54000a55d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:08.347694 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431753856}
I20260709 13:13:08.327226 32242 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:08.326589 32237 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:08.328661 32287 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:08.361574 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.381664 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 297579us
I20260709 13:13:08.342068 32091 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:08.342793 32250 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:08.333474 32081 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.447819 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:08.448601 29466 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:08.327203 32178 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.413868 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:08.356375 32100 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.358353 32237 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:08.446583 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 99856.5us
I20260709 13:13:08.390842 32114 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:08.395956 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:08.466862 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53201.8us
I20260709 13:13:08.429020 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:08.471700 29471 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:08.440528 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.388685 32048 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.464527 32154 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:08.446792 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 126563us
I20260709 13:13:08.397069 32148 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:08.418339 32293 log.cc:927] Time spent T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.099s	user 0.003s	sys 0.001s
I20260709 13:13:08.462572 32237 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:08.323035 32264 consensus_queue.cc:237] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.355347 31961 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
W20260709 13:13:08.488768 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 92877.3us
I20260709 13:13:08.327692 31909 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.384392 32242 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.458036 32081 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.523764 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:08.486706 32114 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:08.487396 32148 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:08.460795 32250 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:08.512518 32233 consensus_meta.cc:287] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.558s	user 0.000s	sys 0.012s
I20260709 13:13:08.531174 29466 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:08.391597 32287 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.528851 32218 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:08.452278 32276 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.545153 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:08.529273 32148 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:08.465575 32246 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.539239 32263 raft_consensus.cc:2764] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:13:08.542280 32218 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:08.569329 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 597) took 1135 ms. Trace:
I20260709 13:13:08.569753 30159 rpcz_store.cc:276] 0709 13:13:07.433559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.438135 (+  4576us) service_pool.cc:224] Handling call
0709 13:13:08.569129 (+1130994us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400475c54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:08.569258 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684534016}
I20260709 13:13:08.546105 32299 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:08.571610 32279 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:08.540038 32170 consensus_queue.cc:1059] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:13:08.529701 32300 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:13:08.574026 32302 consensus_queue.cc:1175] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" responder_term: 7 status { last_received { term: 6 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:08.583694 32081 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:08.584152 32114 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:08.585037 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.560679 32276 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:08.577268 29509 leader_election.cc:400] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4.
I20260709 13:13:08.577833 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:08.578171 29545 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:08.563602 32110 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:08.612027 30159 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:08.581194 32291 log.cc:927] Time spent T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:13:08.610637 32110 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:08.627493 32250 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:08.627452 32110 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.628661 32110 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:08.632128 32287 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.635813 29470 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:08.593598 32246 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:08.586688 32274 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.625692 32242 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.641777 32272 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:08.646477 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:08.648725 30152 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:08.649983 31878 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:08.652406 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:08.654948 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.538662 32233 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.569140 32218 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:08.695503 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.696103 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.699189 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:08.702796 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 50492.4us
I20260709 13:13:08.705696 29360 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:08.714700 30158 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:08.684294 32295 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:08.713584 30155 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:08.701110 32242 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:08.722813 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 230796us
I20260709 13:13:08.725395 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:08.724499 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:08.729130 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.713563 31991 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:08.714879 32279 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:08.717787 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.721380 32310 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:08.730304 32307 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:08.736290 32279 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:08.747445 32279 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.728061 32237 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.752313 32233 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:08.752921 32307 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:08.754033 32307 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.755863 32237 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:08.759361 32301 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 13:13:08.761317 32081 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.761886 32081 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.764577 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:08.765357 29537 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:08.729387 32242 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.774021 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:08.774626 29467 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:08.777355 30159 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
W20260709 13:13:08.794396 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 73518us
I20260709 13:13:08.795398 29392 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:08.795935 29392 pending_rounds.cc:85] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 3
I20260709 13:13:08.796221 29392 pending_rounds.cc:107] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:08.796506 29392 raft_consensus.cc:2889] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:08.797263 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.736068 31991 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:08.802350 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:08.821872 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:08.792900 29360 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:08.830377 29394 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:08.824227 29396 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:13:08.831095 29396 pending_rounds.cc:85] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 3
I20260709 13:13:08.831401 29396 pending_rounds.cc:107] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:08.831717 29396 raft_consensus.cc:2889] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:08.832330 29389 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:08.832569 29391 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
I20260709 13:13:08.764549 32081 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.738916 32130 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:08.829254 29390 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:13:08.844887 29390 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 5
I20260709 13:13:08.845075 29388 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:08.826066 30156 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEARNER]: Advancing to term 6
W20260709 13:13:08.839236 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 46488.2us
I20260709 13:13:08.801802 32217 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:08.730165 32274 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:13:08.845299 29390 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:13:08.850529 29390 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:08.849341 29467 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:08.849584 32048 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:08.828042 29537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:13:08.853986 32081 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:08.844208 32178 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.854578 32081 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.854425 29537 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.858183 29537 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:08.875155 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:08.879376 30157 raft_consensus.cc:2393] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:08.896934 29396 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:08.898336 29393 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:08.850332 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.899726 30156 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:13:08.900113 30156 pending_rounds.cc:85] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 5
I20260709 13:13:08.900409 30156 pending_rounds.cc:107] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:13:08.900717 30156 raft_consensus.cc:2889] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:08.901733 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 130201us
I20260709 13:13:08.904145 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:08.904806 29391 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:13:08.905084 30126 leader_election.cc:336] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.621s (SENT)
I20260709 13:13:08.882531 32048 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:08.873991 32217 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:08.952351 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49254.8us
W20260709 13:13:08.907243 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 79744.8us
I20260709 13:13:08.964555 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:08.945724 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.967022 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.968294 30156 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:08.968935 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:08.969859 29467 raft_consensus.cc:606] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:08.971558 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 66507.9us
I20260709 13:13:08.977805 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.979022 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:08.979382 30156 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:08.980096 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.947s (SENT)
I20260709 13:13:08.980644 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:08.981771 32258 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:08.982359 32258 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:08.882398 32170 consensus_queue.cc:1059] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:13:08.985651 32258 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.934059 29537 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.887259 32148 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:08.959364 31991 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.058290 30159 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:08.987061 32328 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:13:09.099522 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:09.100212 29395 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:09.085152 32218 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:09.101402 32148 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:09.102135 32218 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:09.098858 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.023418 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58974.6us
I20260709 13:13:09.102825 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:09.103204 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:09.103578 30159 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.104210 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:09.104956 29394 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:09.105054 29509 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:09.060462 29541 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:09.105821 31952 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:09.106575 31952 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:09.106853 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:09.107046 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1738) took 1367 ms. Trace:
I20260709 13:13:09.107456 29397 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.107772 29509 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:09.107429 29541 rpcz_store.cc:276] 0709 13:13:07.739387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.823032 (+ 83645us) service_pool.cc:224] Handling call
0709 13:13:09.060083 (+1237051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.105991 (+ 45908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.106855 (+   864us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540036c250. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:09.106975 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2742972160}
W20260709 13:13:09.078764 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.952379 32264 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:08.979694 29396 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:09.109668 29395 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:08.971122 30154 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:09.048976 32048 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.009811 32233 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:09.109714 32264 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:09.113206 32154 raft_consensus.cc:3055] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.113718 32154 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:09.113507 32264 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.114974 32264 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.114625 32154 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.060148 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1736) took 1321 ms. Trace:
I20260709 13:13:09.116449 29545 rpcz_store.cc:276] 0709 13:13:07.738640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.742798 (+  4158us) service_pool.cc:224] Handling call
0709 13:13:09.059915 (+1317117us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540036c254. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:09.060081 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962897792}
I20260709 13:13:09.046929 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:08.987026 32170 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:09.126945 32170 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:09.127965 32170 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:09.060778 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 357) took 1150 ms. Trace:
I20260709 13:13:09.129586 32089 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.129488 29540 rpcz_store.cc:276] 0709 13:13:07.910279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.910551 (+   272us) service_pool.cc:224] Handling call
0709 13:13:09.060534 (+1149983us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400061654. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:09.060704 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832164224}
I20260709 13:13:08.978488 32242 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:08.950745 32263 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.135906 32258 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:09.136061 32263 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:09.137745 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:09.102319 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:09.138973 31952 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:09.139092 29391 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:09.139746 32263 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:09.141024 29546 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:08.896740 31909 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:09.142289 31909 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:09.144225 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.148525 29391 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:08.978709 31931 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.158499 32283 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.158974 31931 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:09.159162 32283 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:09.160343 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.145839 31909 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:09.029830 32081 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:09.053556 32217 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:09.084347 30151 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:09.041121 32318 log.cc:927] Time spent T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:13:09.040372 32312 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:13:09.055316 32273 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:09.169551 32273 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:09.196372 32273 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:09.153579 29537 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:09.197536 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:09.198815 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.199394 29537 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
W20260709 13:13:09.010910 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.150393 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:09.172885 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.201355 32248 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:09.198405 30155 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:09.178017 32077 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:09.203636 32273 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:09.206838 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:09.181694 29540 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:09.205183 32154 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:09.200836 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 95963.3us
I20260709 13:13:09.208348 32141 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:09.209070 29466 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:09.209343 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 59050.2us
I20260709 13:13:09.210124 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.210950 32141 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:09.212294 29466 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:09.185499 32269 raft_consensus.cc:3055] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:09.212615 29465 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:09.212893 32269 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:09.213768 32269 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.214759 29466 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:09.214823 32269 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:09.216930 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:09.220316 29539 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:09.222075 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 363) took 1298 ms. Trace:
W20260709 13:13:09.186105 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 48888.2us
I20260709 13:13:09.187860 32192 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.222389 29539 rpcz_store.cc:276] 0709 13:13:07.923334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.070076 (+146742us) service_pool.cc:224] Handling call
0709 13:13:09.221879 (+1151803us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400060c54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:09.222012 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635108608}
I20260709 13:13:09.223555 32218 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:13:09.186308 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.224295 32192 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:09.170440 32228 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:09.225150 32228 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:09.225090 32218 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:09.226274 32228 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.227078 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 491) took 1179 ms. Trace:
I20260709 13:13:09.227274 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.151928 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:13:09.207698 29467 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:09.227962 29540 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:09.184159 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.229215 29545 raft_consensus.cc:2393] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:09.218330 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:09.219302 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:09.219473 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:09.231460 29468 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:09.192131 32281 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 1.053s	user 0.003s	sys 0.000s
I20260709 13:13:09.231760 29468 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:09.232628 29468 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:09.219952 32141 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:09.233537 29468 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:09.233733 29438 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:09.220147 30155 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:09.234589 32263 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:09.235211 32263 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.235616 32263 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:09.236526 32258 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:13:09.238270 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.240981 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.227567 32228 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.247162 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:09.227489 30158 rpcz_store.cc:276] 0709 13:13:08.047545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.047688 (+   143us) service_pool.cc:224] Handling call
0709 13:13:09.226876 (+1179188us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400690fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:09.227011 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503556480}
I20260709 13:13:09.161939 32283 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:09.300321 29397 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:09.004293 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:09.310672 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:09.323869 29539 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:09.326030 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.334867 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:09.336862 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 384141us
I20260709 13:13:09.337867 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:09.358752 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 112043us
I20260709 13:13:09.360554 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:09.363682 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 359452us
I20260709 13:13:09.370388 32218 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:09.371310 32218 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.375211 32218 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:09.360492 29438 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:09.024255 32299 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:09.378636 30126 leader_election.cc:336] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.973s (SENT)
I20260709 13:13:09.395179 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:09.267586 32217 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:09.396974 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 67461.1us
I20260709 13:13:09.399995 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:09.129642 32170 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.402494 29545 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:09.402846 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 65124us
I20260709 13:13:09.403671 29435 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.396963 32283 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:09.406965 31690 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:09.407950 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 351) took 1666 ms. Trace:
I20260709 13:13:09.181772 31931 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:09.411733 30126 leader_election.cc:336] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.766s (SENT)
I20260709 13:13:09.411855 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.412992 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:09.408344 29538 rpcz_store.cc:276] 0709 13:13:07.741554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.743235 (+  1681us) service_pool.cc:224] Handling call
0709 13:13:07.866261 (+123026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:07.869695 (+  3434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.869735 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:08.828996 (+959261us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b2c000d87c8. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e729aa11 00007f61e72aa372 00007f61e89dca01 00007f61e89a143a 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2
0709 13:13:08.829645 (+   649us) log.cc:844] Serialized 52 byte log entry
0709 13:13:08.978355 (+148710us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:08.978393 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.978511 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.407637 (+429126us) raft_consensus.cc:1685] finished
0709 13:13:09.407660 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.407882 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2247,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":15901440,"thread_start_us":125280,"threads_started":1,"wal-append.queue_time_us":558002}
I20260709 13:13:09.333925 32081 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:09.418408 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.415544 29545 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:09.417078 29468 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:09.293308 32258 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 13:13:09.426242 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:09.423972 29512 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:09.426559 29435 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.293246 32192 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:13:09.415256 32259 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:09.433305 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:09.435691 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:09.416833 32317 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:09.424993 32233 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:09.443459 29509 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.416973 32283 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:09.426328 31870 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:09.408941 32272 consensus_queue.cc:1059] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:13:09.448268 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:09.451748 30157 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:09.453752 29435 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.453779 29545 raft_consensus.cc:2376] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3. Re-sending same reply.
I20260709 13:13:09.455180 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.455794 29466 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:09.410879 32217 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:09.436265 32259 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:09.464797 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 151962us
I20260709 13:13:09.465798 29363 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.467669 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:09.467911 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.468603 32307 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:09.469110 32307 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:09.469568 32307 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:09.455953 29545 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:09.457927 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:09.435849 32296 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:09.474143 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:09.479008 30157 raft_consensus.cc:2393] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:09.432297 31690 consensus_queue.cc:1059] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:13:09.448999 32313 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:09.445266 32077 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:09.484449 29538 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:09.477469 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:09.448855 31642 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.452419 32141 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:09.434269 32218 consensus_queue.cc:1059] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:13:09.481048 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.453821 32297 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:09.453094 32264 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:09.486100 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:09.463277 32259 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.463668 32250 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:13:09.472209 32317 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:09.514808 32302 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.481168 32279 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:09.526412 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45561.5us
I20260709 13:13:09.498574 32077 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.546458 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.599233 32218 raft_consensus.cc:3055] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:09.529934 29546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "495c8d0b86f84e95b022820009da4795"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:13:09.462924 32081 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:09.602283 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 120429us
I20260709 13:13:09.607734 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:09.720353 29546 raft_consensus.cc:606] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:09.720793 29546 raft_consensus.cc:614] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:09.490656 32296 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:09.526575 32245 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:09.674861 29537 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:09.618018 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.639403 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.600317 32264 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.601344 32048 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:09.723040 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.700539 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:09.704335 29470 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:13:09.710754 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:09.528676 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44927.8us
W20260709 13:13:09.672894 32320 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:13:09.715689 29545 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
W20260709 13:13:09.725965 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.726701 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:09.728621 29545 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:09.721483 29435 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:09.733697 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:09.737315 30158 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:09.613240 31690 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
W20260709 13:13:09.717374 32089 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:13:09.748296 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.530226 31642 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.708734 32192 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.755103 29546 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:09.709975 32279 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.762378 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:09.726910 32264 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.719677 32218 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:09.728850 32141 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:09.734938 32290 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:09.743180 32303 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:09.796973 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 260192us
I20260709 13:13:09.640331 32283 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.798677 30160 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:09.749058 32245 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:09.744863 32302 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.772969 32292 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:09.735544 32300 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:13:09.742496 32267 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:13:09.780869 32089 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:09.782126 32279 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:09.726649 32314 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.347s
I20260709 13:13:09.774096 32272 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.762951 32242 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.824347 30126 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:09.743492 32081 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.834811 29538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:13:09.943406 29538 raft_consensus.cc:606] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:09.943861 29538 raft_consensus.cc:614] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:09.849234 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 115638us
I20260709 13:13:09.822263 32141 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:09.859311 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 134319us
I20260709 13:13:09.861306 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 498) took 1776 ms. Trace:
W20260709 13:13:09.913829 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 62847.8us
W20260709 13:13:09.926595 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 189970us
I20260709 13:13:09.934649 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:09.857159 32125 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.945446 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:09.782764 32192 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:09.951978 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 127759us
I20260709 13:13:09.950913 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2064) took 1296 ms. Trace:
I20260709 13:13:09.953208 30160 rpcz_store.cc:276] 0709 13:13:08.084533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.084656 (+   123us) service_pool.cc:224] Handling call
0709 13:13:09.168814 (+1084158us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:09.169053 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.798449 (+629396us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b5400133e20. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8918dc0 00007f61e89a31c0 00007f61e89a4231 00007f61e89a0d8f 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c
0709 13:13:09.855618 (+ 57169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.861119 (+  5501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135579776}
I20260709 13:13:09.966856 29541 rpcz_store.cc:276] 0709 13:13:08.654181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.109906 (+455725us) service_pool.cc:224] Handling call
0709 13:13:09.110175 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.110387 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:09.547299 (+436912us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.950490 (+403191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.950561 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:09.950614 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.950690 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.950835 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":488163,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":80657,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":124,"thread_start_us":838753,"threads_started":3}
I20260709 13:13:09.971838 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:09.972550 29388 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:09.966379 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:09.976011 30126 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:09.898878 32089 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.861661 32292 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:09.996778 29396 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:09.944689 32272 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:10.008113 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 62801.8us
I20260709 13:13:10.009130 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.010754 32303 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:10.011760 32303 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:09.973284 32217 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:09.990600 32089 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:09.983888 32233 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:10.049270 32347 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:13:10.050961 32351 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:13:10.052191 32331 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
W20260709 13:13:10.054356 32329 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:13:10.055722 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1945) took 1106 ms. Trace:
I20260709 13:13:10.056525 32204 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:09.900660 32218 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.059580 32218 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.061924 32300 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:09.858656 32296 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.062693 32300 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:10.064831 32332 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:13:10.013855 32272 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.066526 32295 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:10.066838 32353 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:13:10.067059 32295 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.071620 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1940) took 1202 ms. Trace:
I20260709 13:13:10.072000 29389 rpcz_store.cc:276] 0709 13:13:08.868996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.869188 (+   192us) service_pool.cc:224] Handling call
0709 13:13:08.888144 (+ 18956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.888526 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.888555 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.889061 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.420050 (+530989us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:09.420088 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.420150 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.071355 (+651205us) raft_consensus.cc:1685] finished
0709 13:13:10.071378 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.071534 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4708,"thread_start_us":471427,"threads_started":1,"wal-append.queue_time_us":844230}
I20260709 13:13:10.056136 32292 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.076593 32212 raft_consensus.cc:3055] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:10.076968 32212 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:09.952615 32242 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.085969 32295 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.090900 32205 raft_consensus.cc:3055] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:10.091321 32205 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:10.092149 32205 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.093261 32205 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:10.095669 32334 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.420s	user 0.000s	sys 0.002s
I20260709 13:13:10.097286 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2054) took 1851 ms. Trace:
I20260709 13:13:10.097709 29542 rpcz_store.cc:276] 0709 13:13:08.245920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.314690 (+ 68770us) service_pool.cc:224] Handling call
0709 13:13:08.315087 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.326014 (+ 10927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.326068 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.075635 (+749567us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b2c000d87c8. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e729aa11 00007f61e72aa372 00007f61e89dca01 00007f61e89a143a 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2
0709 13:13:09.076236 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.392095 (+315859us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:09.392147 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.392247 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.096922 (+704675us) raft_consensus.cc:1685] finished
0709 13:13:10.096947 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.097205 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1589,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6277,"spinlock_wait_cycles":3422976,"thread_start_us":315303,"threads_started":1,"wal-append.queue_time_us":406935}
I20260709 13:13:10.100309 31642 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.103319 30160 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:10.103654 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 720) took 1309 ms. Trace:
I20260709 13:13:10.104803 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2061) took 1793 ms. Trace:
I20260709 13:13:10.105089 32233 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.105170 29544 rpcz_store.cc:276] 0709 13:13:08.311017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.891862 (+580845us) service_pool.cc:224] Handling call
0709 13:13:08.922058 (+ 30196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.979547 (+ 57489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.979594 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.017946 (+ 38352us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.617507 (+599561us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:09.617567 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.617659 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.104573 (+486914us) raft_consensus.cc:1685] finished
0709 13:13:10.104610 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.104736 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11183,"raft.queue_time_us":66516,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":12309,"thread_start_us":206141,"threads_started":1,"wal-append.queue_time_us":720267}
I20260709 13:13:10.107450 32364 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.107923 32364 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:10.109655 29538 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:09.994381 32290 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:10.084895 29294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 176) took 9564 ms. Trace:
I20260709 13:13:10.056120 29390 rpcz_store.cc:276] 0709 13:13:08.949151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.955941 (+  6790us) service_pool.cc:224] Handling call
0709 13:13:08.968424 (+ 12483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.971710 (+  3286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.971736 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.009381 (+ 37645us) log.cc:844] Serialized 572 byte log entry
0709 13:13:09.430275 (+420894us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:09.430315 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.430390 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.055451 (+625061us) raft_consensus.cc:1685] finished
0709 13:13:10.055476 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.055633 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":407350,"threads_started":1,"wal-append.queue_time_us":742779}
I20260709 13:13:10.026808 31952 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:10.124598 30153 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.066s	user 0.014s	sys 0.000s
I20260709 13:13:09.990934 32125 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.120604 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.156275 29545 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
W20260709 13:13:10.157819 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.153025 29388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:13:10.108269 32364 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.077884 32212 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:10.163064 32268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.022s	sys 0.038s
I20260709 13:13:10.252465 29388 raft_consensus.cc:606] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:10.250422 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 129941us
I20260709 13:13:10.129691 30153 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:10.015980 32245 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.162259 32048 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:10.236689 32077 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:10.270766 32268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.022s	sys 0.040s
I20260709 13:13:10.255456 32217 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:10.326622 32338 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:13:10.268318 32299 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.131934 31952 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:10.283183 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.126856 29294 rpcz_store.cc:276] 0709 13:13:00.520290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.529636 (+  9346us) service_pool.cc:224] Handling call
0709 13:13:00.624466 (+ 94830us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b54001b0990. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587d0b2 00007f61ee7f6a89 00007f61ee78eda6 00007f61ee760088 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc
0709 13:13:00.629175 (+  4709us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890b090 00007f61e89a9f3a 00007f61ee7601cc 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc 00007f61ecd1e392 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:10.079410 (+9450235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:07.204414 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:07.239308 (+ 34894us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:07.239368 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:13:07.239389 (+    21us) tablet.cc:662] Decoding operations
0709 13:13:07.285782 (+ 46393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:07.285871 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:07.285901 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:13:07.288629 (+  2728us) tablet.cc:701] Row locks acquired
0709 13:13:07.288675 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:13:07.288879 (+   204us) write_op.cc:270] Start()
0709 13:13:07.289033 (+   154us) write_op.cc:276] Timestamp: P: 1783602787288812 usec, L: 0
0709 13:13:07.289049 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:13:07.295324 (+  6275us) log.cc:844] Serialized 4528 byte log entry
0709 13:13:07.915128 (+619804us) op_driver.cc:464] REPLICATION: finished
0709 13:13:08.107871 (+192743us) write_op.cc:301] APPLY: starting
0709 13:13:08.108018 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:08.158805 (+ 50787us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:08.158995 (+   190us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:08.284200 (+125205us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:08.284586 (+   386us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:13:08.284630 (+    44us) write_op.cc:312] APPLY: finished
0709 13:13:08.285111 (+   481us) log.cc:844] Serialized 83 byte log entry
0709 13:13:08.285335 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:08.285531 (+   196us) write_op.cc:454] Released schema lock
0709 13:13:08.285633 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:08.286109 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:08.286148 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116337,"reported_tablets":23,"spinlock_wait_cycles":121611392,"child_traces":[["op",{"apply.queue_time_us":186989,"apply.run_cpu_time_us":6128,"apply.run_wall_time_us":178211,"num_ops":11,"prepare.queue_time_us":190975,"prepare.run_cpu_time_us":64090,"prepare.run_wall_time_us":268196,"raft.queue_time_us":361642,"raft.run_cpu_time_us":31842,"raft.run_wall_time_us":183767,"replication_time_us":617144,"thread_start_us":594017,"threads_started":4,"wal-append.queue_time_us":221376,"wal-append.run_cpu_time_us":56829,"wal-append.run_wall_time_us":1840791}]]}
I20260709 13:13:10.134657 32250 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 13:13:10.276577 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:10.339684 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 378401us
I20260709 13:13:10.350610 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:13:10.351416 29463 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:13:10.104144 30152 rpcz_store.cc:276] 0709 13:13:08.793826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.802316 (+  8490us) service_pool.cc:224] Handling call
0709 13:13:08.945072 (+142756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.988575 (+ 43503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.003460 (+ 14885us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.123447 (+119987us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4c00501540. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e6c6da20 00007f61e6c7ea29 00007f61e6c44644 00007f61e6c6bf2d 00007f61e6c6bb93 00007f61e899c18b 00007f61e899ccb5 00007f61e899e004 00007f61e899d729 00007f61e89a2d96 00007f61e8997adb
0709 13:13:09.124546 (+  1099us) log.cc:844] Serialized 572 byte log entry
0709 13:13:09.429303 (+304757us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:09.434803 (+  5500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.442581 (+  7778us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.103223 (+660642us) raft_consensus.cc:1685] finished
0709 13:13:10.103275 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.103582 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61190400,"thread_start_us":292348,"threads_started":1,"wal-append.queue_time_us":976333}
W20260709 13:13:10.353722 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 393418us
I20260709 13:13:10.356748 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:10.359194 29538 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:10.371173 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 94721.4us
I20260709 13:13:10.373021 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.354735 32242 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:10.378026 32242 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.378495 32125 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.379364 32125 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.379971 32125 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.328857 32077 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:13:10.384368 32263 consensus_meta.cc:287] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.148s	user 0.011s	sys 0.011s
I20260709 13:13:10.255537 32148 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.324569 32302 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:10.425690 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.354899 32212 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.384920 32263 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.446305 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:10.447475 29537 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:10.446857 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52331.9us
W20260709 13:13:10.460238 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 484261us
I20260709 13:13:10.464804 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:10.462911 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 207367us
W20260709 13:13:10.471439 32228 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.204s	user 0.010s	sys 0.006s
I20260709 13:13:10.474983 32367 raft_consensus.cc:2764] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:13:10.475625 32269 consensus_meta.cc:287] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.260s	user 0.011s	sys 0.006s
W20260709 13:13:10.476281 30153 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 497) took 2402 ms (client timeout 1827 ms). Trace:
W20260709 13:13:10.476770 30153 rpcz_store.cc:269] 0709 13:13:08.073370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.073845 (+   475us) service_pool.cc:224] Handling call
0709 13:13:08.646260 (+572415us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:10.476020 (+1829760us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b540029d1d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:10.476169 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876657280}
I20260709 13:13:10.478325 32369 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:10.478870 32369 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:10.479236 32369 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.480278 31952 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:10.387244 32242 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:10.481076 32242 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:10.481585 32170 consensus_meta.cc:287] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.067s	user 0.012s	sys 0.003s
I20260709 13:13:10.481855 29543 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:10.440171 32148 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:10.483871 32154 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.276s	user 0.016s	sys 0.000s
I20260709 13:13:10.484637 32148 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.337842 32217 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.489068 32217 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.355154 32299 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.486624 32048 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.492925 29392 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:13:10.490104 32141 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:10.399679 32233 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:10.502166 29545 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:10.515552 32299 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.526592 32369 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.529218 32369 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:10.504231 32125 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.539652 32366 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.540277 32366 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.388705 32287 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:13:10.445462 32192 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:10.436885 32300 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.546624 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 374) took 1061 ms. Trace:
W20260709 13:13:10.549316 29392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 362) took 1451 ms (client timeout 1652 ms). Trace:
W20260709 13:13:10.515633 32307 consensus_meta.cc:287] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.045s	user 0.015s	sys 0.000s
I20260709 13:13:10.551831 29543 rpcz_store.cc:276] 0709 13:13:09.485676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.485817 (+   141us) service_pool.cc:224] Handling call
0709 13:13:10.546389 (+1060572us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54002bc354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:10.546535 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170874112}
W20260709 13:13:10.552502 29392 rpcz_store.cc:269] 0709 13:13:09.098047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.137414 (+ 39367us) service_pool.cc:224] Handling call
0709 13:13:10.549091 (+1411677us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001c57d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:10.549234 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3095779072}
I20260709 13:13:10.543020 32361 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:10.566537 29539 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.004s	sys 0.021s
W20260709 13:13:10.544401 32273 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.340s	user 0.014s	sys 0.009s
W20260709 13:13:10.571589 29539 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.004s	sys 0.021s
I20260709 13:13:10.575174 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:10.576442 29543 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:10.577811 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:10.578467 29543 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:10.578785 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:10.579432 29545 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:10.532032 32362 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:13:10.564198 32299 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.547524 32233 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:13:10.594310 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49077.6us
W20260709 13:13:10.593667 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52156.1us
I20260709 13:13:10.591791 32290 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:10.592650 29291 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:10.605952 32264 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.002s
I20260709 13:13:10.602734 32375 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.606853 32264 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.607137 29291 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.609390 29291 catalog_manager.cc:5697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:10.606158 32233 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:10.563901 32367 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:13:10.610905 32233 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:10.613260 32218 consensus_meta.cc:287] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
I20260709 13:13:10.614916 32366 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.615585 32373 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:10.603083 32299 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.614092 32264 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:10.618852 32299 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:10.620450 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:13:10.622603 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.566606 32307 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.641659 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:10.627943 32362 consensus_queue.cc:1243] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer 88760af579b54a6393c6251aa3c6b870 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:13:10.675362 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.004s	sys 0.023s
W20260709 13:13:10.675868 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.005s	sys 0.023s
W20260709 13:13:10.623245 31991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.017s	sys 0.012s
I20260709 13:13:10.606971 32375 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:10.648293 32272 consensus_meta.cc:287] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.008s
W20260709 13:13:10.705119 30124 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.023s	sys 0.019s
W20260709 13:13:10.707471 30124 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.023s	sys 0.020s
W20260709 13:13:10.685650 32259 consensus_meta.cc:287] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.045s	user 0.006s	sys 0.018s
W20260709 13:13:10.722853 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 349926us
W20260709 13:13:10.684139 31991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.018s	sys 0.013s
W20260709 13:13:10.701843 31690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.009s	sys 0.032s
W20260709 13:13:10.730182 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 131900us
I20260709 13:13:10.730782 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:10.732038 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:10.703459 32299 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:10.733845 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:10.746608 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:10.747248 29393 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.743392 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:10.747047 29471 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:10.725735 29291 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.740772 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:10.749239 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:10.749686 29467 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:10.745800 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.750097 29466 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:10.757040 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:10.757275 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:10.757737 29467 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:10.758287 30159 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:10.742399 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:10.759066 29394 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 3: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:10.759392 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:10.759295 29291 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 4, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 4 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.760311 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:10.740674 32218 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:10.762624 32385 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:10.761623 29291 catalog_manager.cc:5697] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), now has a pending config: VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130), VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131), VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:10.764030 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:10.763288 32385 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.764955 29512 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:10.765019 29291 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 2, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.761806 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:10.767125 32385 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:10.767429 29396 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:10.768963 32141 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:10.769193 32365 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.769402 32141 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.769694 32365 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:10.769907 32141 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:10.770635 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:10.772092 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 87230.2us
I20260709 13:13:10.773568 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:10.735394 32259 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.723199 32263 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:10.761632 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:10.777935 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:10.780444 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:10.783569 30160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.024s	sys 0.029s
W20260709 13:13:10.804908 30160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.025s	sys 0.033s
I20260709 13:13:10.804908 29543 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.734056 32283 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:10.809263 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 300013us
I20260709 13:13:10.770164 32365 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:10.808924 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63236.1us
I20260709 13:13:10.818600 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:10.736838 31690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.010s	sys 0.032s
I20260709 13:13:10.817013 30126 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:10.823571 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:10.823762 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 50263.7us
I20260709 13:13:10.824404 29466 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:10.748298 32361 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:10.827697 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:10.824368 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:10.829738 29537 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.830551 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.750590 32081 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:10.812237 32089 consensus_meta.cc:287] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:13:10.837651 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.721276 32272 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.840799 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:10.842684 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:10.850221 29543 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:10.899755 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.827075 32369 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.910007 29466 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:10.911484 29467 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:10.815646 32192 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:10.838907 32250 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:10.841868 30154 raft_consensus.cc:2410] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:13:10.845033 32303 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.049s
I20260709 13:13:10.919209 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2081) took 1505 ms. Trace:
I20260709 13:13:10.839633 32125 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.801160 32287 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:13:10.834616 32354 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:10.914021 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 73760.3us
I20260709 13:13:10.838984 32228 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:10.923696 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:10.905493 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63838.2us
I20260709 13:13:10.956355 30156 raft_consensus.cc:2376] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7. Re-sending same reply.
I20260709 13:13:10.923189 29539 rpcz_store.cc:276] 0709 13:13:09.413838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.418380 (+  4542us) service_pool.cc:224] Handling call
0709 13:13:09.418680 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.418911 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:10.576186 (+1157275us) log.cc:844] Serialized 14 byte log entry
0709 13:13:10.918725 (+342539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:10.918817 (+    92us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:10.918881 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.918971 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.919131 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193152,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":104,"thread_start_us":1479768,"threads_started":2}
I20260709 13:13:10.806170 32299 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.834026 32361 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:10.943912 29537 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:10.762636 32218 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:10.844581 32327 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.845516 32258 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:10.840451 32154 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:13:10.907171 32081 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:10.878360 32089 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.838914 31961 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:13:10.902875 32376 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:10.915422 32369 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:10.922881 32303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.014s	sys 0.050s
I20260709 13:13:10.958573 32228 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:10.951422 32334 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:13:10.955641 32279 consensus_meta.cc:287] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.012s	user 0.019s	sys 0.004s
I20260709 13:13:10.968981 32307 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:10.958985 32386 log.cc:927] Time spent T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.327s	user 0.001s	sys 0.001s
I20260709 13:13:10.975430 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.981729 32204 raft_consensus.cc:993] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:10.957209 32245 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:10.983116 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:10.983278 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:10.827780 32283 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.963868 32361 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:10.972992 32273 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.995272 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:10.736493 32290 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.995749 29392 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:10.979548 32369 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.958704 32125 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:10.975960 32300 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:10.984763 32228 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:11.004904 32379 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:10.962571 32354 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:10.993532 32380 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.018702 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:11.027235 30156 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:11.019701 30159 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:11.008944 32212 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.973573 32327 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.007133 31952 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:11.023355 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:10.990738 32250 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:13:11.047991 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.048663 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:10.982089 32376 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.018362 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:10.998013 32279 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.064500 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:11.031011 32373 raft_consensus.cc:1081] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:11.030001 32379 raft_consensus.cc:697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:11.011842 32273 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.036128 32170 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:11.032037 32192 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:11.088718 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:11.063675 32204 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:11.057212 32259 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:11.136586 29388 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:11.014878 32300 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.012094 32245 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.070858 31690 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.076988 31952 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:11.035881 32380 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.049408 32212 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.085134 30154 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
W20260709 13:13:11.253993 29393 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.003s
I20260709 13:13:11.255375 29393 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:11.256879 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:11.257607 29393 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.155530 32272 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:11.256690 29282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 473077us
I20260709 13:13:11.194034 31642 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:11.209479 32148 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.221995 32364 consensus_meta.cc:287] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.941s	user 0.013s	sys 0.000s
I20260709 13:13:11.186622 32326 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:13:11.230340 32373 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.285099 29393 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:11.279824 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:11.267746 32375 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:11.281437 32296 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:11.298945 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:11.368963 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:11.280550 32295 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.193s	user 0.019s	sys 0.000s
W20260709 13:13:11.442759 29397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.007s	sys 0.003s
W20260709 13:13:11.443387 29397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.007s	sys 0.003s
I20260709 13:13:11.288460 32218 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:11.373898 29395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.008s
I20260709 13:13:11.434371 30156 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:11.274724 32388 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:11.283928 32148 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.281714 32364 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.298089 32268 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.366029 32264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.003s	sys 0.007s
I20260709 13:13:11.278700 32381 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.456s
W20260709 13:13:11.479826 30151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.035s	sys 0.121s
W20260709 13:13:11.454164 29395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.003s	sys 0.008s
I20260709 13:13:11.447132 32382 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.578715 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.586326 30151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.040s	sys 0.136s
W20260709 13:13:11.461542 32317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.002s	sys 0.009s
W20260709 13:13:11.531495 30126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.004s	sys 0.008s
W20260709 13:13:11.590874 30126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.004s	sys 0.008s
W20260709 13:13:11.591300 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 745511us
W20260709 13:13:11.549353 32264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.003s	sys 0.008s
I20260709 13:13:11.592484 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:11.524959 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.024s	sys 0.050s
W20260709 13:13:11.600039 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.026s	sys 0.050s
W20260709 13:13:11.600865 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 617831us
I20260709 13:13:11.602311 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.603263 29393 raft_consensus.cc:2410] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:11.592507 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:11.604339 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:11.596237 29391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.002s	sys 0.011s
I20260709 13:13:11.296643 32373 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:11.596930 29362 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.27.150.190:35447, user_credentials={real_user=slave}} blocked reactor thread for 67093.2us
I20260709 13:13:11.444795 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:11.446808 32299 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:11.607252 29391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.002s	sys 0.011s
I20260709 13:13:11.611869 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:11.614763 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.617354 29470 raft_consensus.cc:1240] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:11.610049 30123 leader_election.cc:336] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.547s (SENT)
I20260709 13:13:11.618883 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:11.628309 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:11.603415 32317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.003s	sys 0.009s
I20260709 13:13:11.629109 29393 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.525067 32125 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:11.439370 32296 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:11.575250 32368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.024s	sys 0.052s
W20260709 13:13:11.644201 32383 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:13:11.648779 32364 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:11.597752 32268 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.650771 32273 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:11.373035 32379 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.453229 32295 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.621639 32283 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:11.639503 32368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.024s	sys 0.052s
I20260709 13:13:11.581034 31952 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.607066 32382 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.674341 32300 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:11.674628 32389 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:13:11.676064 32373 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:11.674646 32391 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:11.671789 32403 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:11.679780 32242 consensus_meta.cc:287] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.198s	user 0.014s	sys 0.000s
I20260709 13:13:11.667690 32375 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:11.681771 32296 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:11.785218 32170 consensus_meta.cc:287] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:13:11.785919 32170 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:11.685541 32394 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:13:11.687052 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.714931 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:11.695647 32354 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:11.786813 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1966) took 1034 ms. Trace:
I20260709 13:13:11.787139 29544 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.787335 29391 rpcz_store.cc:276] 0709 13:13:10.752394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.752540 (+   146us) service_pool.cc:224] Handling call
0709 13:13:10.752874 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.753231 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.753272 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.786239 (+ 32967us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.611697 (+825458us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:11.611827 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.612021 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.786527 (+174506us) raft_consensus.cc:1685] finished
0709 13:13:11.786554 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.786736 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18485,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":768040,"threads_started":1,"wal-append.queue_time_us":833979}
W20260709 13:13:11.789556 32141 consensus_meta.cc:287] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.019s	user 0.006s	sys 0.005s
I20260709 13:13:11.789513 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.662250 32376 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:11.791553 32406 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:13:11.793331 32205 consensus_meta.cc:287] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.700s	user 0.019s	sys 0.005s
I20260709 13:13:11.464733 32388 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.637168 30154 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:11.800535 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 624) took 1065 ms. Trace:
W20260709 13:13:11.713732 29389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.011s	sys 0.055s
W20260709 13:13:11.745270 29436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.026s	sys 0.071s
I20260709 13:13:11.797364 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:11.801677 29436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.027s	sys 0.076s
I20260709 13:13:11.798317 32391 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:11.666918 32364 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:11.801249 29389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.030s	sys 0.088s
I20260709 13:13:11.801054 30155 rpcz_store.cc:276] 0709 13:13:10.735049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.735234 (+   185us) service_pool.cc:224] Handling call
0709 13:13:10.759686 (+ 24452us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:10.759872 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.778477 (+ 18605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.778525 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.816569 (+ 38044us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.278242 (+461673us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:11.278292 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.278412 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.794748 (+516336us) raft_consensus.cc:1685] finished
0709 13:13:11.794770 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.800430 (+  5660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18104,"raft.queue_time_us":22502,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":14406,"spinlock_wait_cycles":8797952,"thread_start_us":375215,"threads_started":1,"wal-append.queue_time_us":781858}
I20260709 13:13:11.813874 29544 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:11.804517 29538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:13:11.814836 29538 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.815312 29538 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.824779 29393 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:11.721366 30158 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:11.812871 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.828578 29391 raft_consensus.cc:1240] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.829862 32411 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.830242 32390 log.cc:927] Time spent T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:13:11.830595 32411 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.790112 32141 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.830029 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:11.794257 32268 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:11.832110 29397 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 1.
I20260709 13:13:11.720721 32283 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.843343 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:11.825868 29538 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.813614 32391 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:11.832070 32317 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.857277 32317 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.858716 29538 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:11.835067 32403 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:11.812604 32375 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.863473 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:11.843853 32326 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:11.848341 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.800191 32242 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:11.864948 32393 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.414s	user 0.001s	sys 0.001s
I20260709 13:13:11.826363 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:11.887430 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 277410us
I20260709 13:13:11.850265 32380 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:11.899803 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.652s (SENT)
I20260709 13:13:11.900856 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:11.904191 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:11.900820 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 289015us
I20260709 13:13:11.907279 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:11.907810 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:11.902158 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.909368 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.911767 29393 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:11.885646 32205 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.910097 29391 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:11.894169 32295 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:11.868037 32388 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:11.935950 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:11.919103 32384 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
W20260709 13:13:11.920811 32228 consensus_meta.cc:287] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.901s	user 0.015s	sys 0.000s
I20260709 13:13:11.923213 32364 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:11.947352 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 138052us
I20260709 13:13:11.955797 29438 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:11.951269 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 730) took 1206 ms. Trace:
I20260709 13:13:11.929216 32148 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:11.954835 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:11.868882 32283 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.958128 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:11.933156 32317 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:11.974261 29391 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:11.896951 32326 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:11.947352 32141 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:11.958482 32303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.012s	sys 0.010s
I20260709 13:13:11.988237 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.000237 29393 raft_consensus.cc:2410] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:11.985131 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:12.001456 29391 raft_consensus.cc:2410] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:11.957978 30151 rpcz_store.cc:276] 0709 13:13:10.745317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.745453 (+   136us) service_pool.cc:224] Handling call
0709 13:13:10.760559 (+ 15106us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:10.760739 (+   180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.779117 (+ 18378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.779162 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.779687 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.589664 (+809977us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:11.896450 (+306786us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.897019 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.897145 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.940821 (+ 43676us) raft_consensus.cc:1685] finished
0709 13:13:11.950921 (+ 10100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.951170 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17951,"prepare.queue_time_us":91131,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":40004,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":11223,"spinlock_wait_cycles":30131968,"thread_start_us":1038923,"threads_started":2,"wal-append.queue_time_us":944083}
I20260709 13:13:11.936738 32205 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:11.955865 32423 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:12.010200 29438 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.007675 29393 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:13:12.010964 29393 pending_rounds.cc:85] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 3
I20260709 13:13:12.011344 29393 pending_rounds.cc:107] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:12.011688 29393 raft_consensus.cc:2889] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:12.013681 29393 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:12.015097 32414 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:13:12.017388 32242 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.010075 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:13:12.019126 29470 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:13:11.978807 32411 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:11.996484 32303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.013s	sys 0.010s
I20260709 13:13:12.019095 32423 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.988373 32417 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:11.955111 32228 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.077602 30157 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:13:12.080178 32419 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:13:12.081306 32205 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:12.081931 32365 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.243s	user 0.013s	sys 0.006s
W20260709 13:13:12.088213 29390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.001s	sys 0.014s
W20260709 13:13:12.088397 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.121537 29390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.001s	sys 0.014s
I20260709 13:13:12.114989 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1957) took 1377 ms. Trace:
I20260709 13:13:12.122100 29388 rpcz_store.cc:276] 0709 13:13:10.737672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.738626 (+   954us) service_pool.cc:224] Handling call
0709 13:13:10.739321 (+   695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.210641 (+471320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.114591 (+903950us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540026f7d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:12.114885 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911330048}
I20260709 13:13:12.123106 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:12.117708 32326 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.121129 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:12.135694 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.128949 29471 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:12.124536 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:12.139297 29543 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:12.130332 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 508) took 1296 ms. Trace:
I20260709 13:13:12.124163 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 621) took 2021 ms. Trace:
I20260709 13:13:12.140918 30156 rpcz_store.cc:276] 0709 13:13:10.833555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.457877 (+624322us) service_pool.cc:224] Handling call
0709 13:13:11.458337 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.458903 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.458942 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.581479 (+122537us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.893763 (+312284us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:11.917290 (+ 23527us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.917587 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.917693 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.130118 (+212425us) raft_consensus.cc:1685] finished
0709 13:13:12.130139 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.130268 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10113,"prepare.queue_time_us":24478,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":14295,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":48542,"thread_start_us":240887,"threads_started":1,"wal-append.queue_time_us":512329}
I20260709 13:13:12.142414 29393 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:12.142858 29538 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:12.128175 32365 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.139077 32375 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.139811 32264 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:12.147526 32365 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:12.148283 32264 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:12.148772 32245 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:12.149982 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.150665 29471 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:12.149509 32264 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.143416 29539 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:12.151654 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.161111 29468 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:12.162765 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.142196 30160 rpcz_store.cc:276] 0709 13:13:10.109676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.109803 (+   127us) service_pool.cc:224] Handling call
0709 13:13:10.123924 (+ 14121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.124376 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.124407 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.124988 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:13:10.807215 (+682227us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:10.807275 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.807373 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.029705 (+1222332us) raft_consensus.cc:1685] finished
0709 13:13:12.076469 (+ 46764us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.124088 (+ 47619us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":335016,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":156,"thread_start_us":681766,"threads_started":1,"wal-append.queue_time_us":1308510}
W20260709 13:13:12.152467 30159 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 734) took 1397 ms (client timeout 1815 ms). Trace:
I20260709 13:13:12.152902 29471 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:13:12.165475 30159 rpcz_store.cc:269] 0709 13:13:10.755413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.759151 (+  3738us) service_pool.cc:224] Handling call
0709 13:13:12.152284 (+1393133us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540025b554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:12.152390 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597040000}
I20260709 13:13:12.153800 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 729) took 1414 ms. Trace:
I20260709 13:13:12.151572 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.154579 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:12.154727 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1958) took 1416 ms. Trace:
I20260709 13:13:12.166675 30157 rpcz_store.cc:276] 0709 13:13:10.738950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.739207 (+   257us) service_pool.cc:224] Handling call
0709 13:13:10.764870 (+ 25663us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:12.077152 (+1312282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.089745 (+ 12593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.153570 (+ 63825us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400680bd0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:12.153715 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019552768}
I20260709 13:13:12.019033 31991 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:13:11.991003 32403 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.148375 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 733) took 1393 ms. Trace:
I20260709 13:13:12.021988 32382 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.070775 32423 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.167286 29392 rpcz_store.cc:276] 0709 13:13:10.738058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.738698 (+   640us) service_pool.cc:224] Handling call
0709 13:13:10.739035 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.004295 (+265260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.154477 (+1150182us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54000e65d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:12.154664 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589758208}
I20260709 13:13:12.169167 29465 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:12.169437 29463 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:12.138648 32361 consensus_meta.cc:287] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.124s	user 0.016s	sys 0.000s
W20260709 13:13:12.158079 31690 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.903s	user 0.007s	sys 0.007s
I20260709 13:13:12.173686 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:12.171627 30158 rpcz_store.cc:276] 0709 13:13:10.755149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.761357 (+  6208us) service_pool.cc:224] Handling call
0709 13:13:12.148150 (+1386793us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54006bec54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:12.148306 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082025216}
I20260709 13:13:12.141700 32272 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.178526 29388 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:12.127772 32417 raft_consensus.cc:697] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:12.156189 32283 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.168339 32370 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:12.181906 31690 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.192452 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:12.193169 29388 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.193846 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.194605 29465 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:12.194818 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:12.195547 29539 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:12.196237 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.197384 29463 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
W20260709 13:13:12.183017 32369 consensus_meta.cc:287] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.167s	user 0.016s	sys 0.000s
I20260709 13:13:12.198894 30126 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:12.185137 32370 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:12.180099 32361 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.203883 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:12.223568 29392 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:12.222258 29538 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:12.205719 32245 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:12.203384 30126 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:12.206743 32228 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.202847 32297 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:13:12.211632 32279 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.213153 29512 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.234076 29470 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:12.183781 32272 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.215989 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.235776 32417 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.236668 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:12.237514 29465 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.222868 32299 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.221840 29438 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.189754 32375 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.227666 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:12.241303 29464 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.228076 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.241539 29438 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.229229 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.242137 29469 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:12.242488 29466 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:12.243009 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.243144 32370 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.234593 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:12.244351 32370 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:12.243932 32375 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.245541 32365 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:12.245990 32365 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.246356 32365 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:12.247776 32382 consensus_queue.cc:1059] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.249583 32382 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:12.250610 32263 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:12.251083 32263 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.251461 32263 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:12.232517 32245 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.252251 32245 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:12.254616 32287 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:12.255093 32287 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.255434 32287 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:12.215690 32369 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.258205 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.250631 32077 raft_consensus.cc:3055] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.235208 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:12.216796 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.261600 29512 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.236605 31952 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:12.243840 29393 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:12.265681 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.214143 32391 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.259830 32077 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:12.227357 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:12.247205 32375 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.330267 29392 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:12.448031 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1970) took 1401 ms. Trace:
W20260709 13:13:12.261786 29509 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.045s (SENT) [suppressed 56 similar messages]
I20260709 13:13:12.449632 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1969) took 1637 ms. Trace:
I20260709 13:13:12.263535 29512 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.233412 32376 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:12.353708 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 111089us
I20260709 13:13:12.532342 29438 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.268693 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.266350 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.535053 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.441892 29465 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:12.331049 29388 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:12.537825 29470 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:12.354460 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:12.420729 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1971) took 1359 ms. Trace:
I20260709 13:13:12.524703 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.266377 30151 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:12.517844 32439 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:13:12.538954 29394 rpcz_store.cc:276] 0709 13:13:11.060908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.071131 (+ 10223us) service_pool.cc:224] Handling call
0709 13:13:11.071550 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.072052 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.072087 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.072643 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.710766 (+638123us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:11.763773 (+ 53007us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.419917 (+656144us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b18003155e0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61e8999060 00007f61e89ab716 00007f61e89bc287 00007f61e89bc208
0709 13:13:12.420166 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.420287 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.420347 (+    60us) raft_consensus.cc:1685] finished
0709 13:13:12.420454 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.420632 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26634,"prepare.queue_time_us":54522,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":683061,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":13655,"spinlock_wait_cycles":9695104,"thread_start_us":499412,"threads_started":1,"wal-append.queue_time_us":792524}
I20260709 13:13:12.445066 32205 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:13:12.523643 29360 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:12.530856 29464 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:12.299651 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:12.231755 32273 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:12.325104 30159 raft_consensus.cc:2955] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:12.556913 30155 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.558902 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:12.560395 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 206085us
I20260709 13:13:12.366128 32141 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.524722 32303 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.536258 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.564211 29392 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:12.313249 32369 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.533238 29393 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:12.538339 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.565268 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:12.527678 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 264208us
I20260709 13:13:12.540081 29438 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:12.297775 32307 raft_consensus.cc:993] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:13:12.466414 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.526237 29396 rpcz_store.cc:276] 0709 13:13:11.046928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.047197 (+   269us) service_pool.cc:224] Handling call
0709 13:13:11.081113 (+ 33916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.081401 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:11.665828 (+584427us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.447466 (+781638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.447555 (+    89us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:12.447628 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.447740 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.447925 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580088,"prepare.queue_time_us":564385,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":581350,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":675144,"threads_started":2,"wal-append.queue_time_us":323794}
I20260709 13:13:12.539808 32228 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:12.352911 32326 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.297266 32361 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.265605 32366 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.264681 31952 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.300004 32382 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:12.537209 32376 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.239197 32283 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.305s
I20260709 13:13:12.262225 32299 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.497922 32242 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.551558 32279 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.504930 32410 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.559583 29394 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:12.562175 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:12.385329 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 622) took 1670 ms. Trace:
I20260709 13:13:12.357348 32367 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:12.526806 29389 rpcz_store.cc:276] 0709 13:13:10.812728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.812873 (+   145us) service_pool.cc:224] Handling call
0709 13:13:10.813293 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.813506 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:11.814110 (+1000604us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.449139 (+635029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.449220 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:12.449284 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.449382 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.449550 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":554186,"prepare.queue_time_us":822137,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":529095,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":26150,"thread_start_us":1010855,"threads_started":2,"wal-append.queue_time_us":190166}
I20260709 13:13:12.618391 29538 raft_consensus.cc:2955] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:12.606420 32376 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:12.563135 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1963) took 1817 ms. Trace:
I20260709 13:13:12.298027 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.526849 29463 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:12.632225 29463 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:12.632030 29395 rpcz_store.cc:276] 0709 13:13:10.745561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.746381 (+   820us) service_pool.cc:224] Handling call
0709 13:13:10.801693 (+ 55312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.811298 (+  9605us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:11.586537 (+775239us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.422944 (+836407us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.423665 (+   721us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.423860 (+   195us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:12.562694 (+138834us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.562894 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.562952 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.562981 (+    29us) raft_consensus.cc:1685] finished
0709 13:13:12.562988 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.563082 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":635473,"prepare.queue_time_us":789034,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":661809,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":18980,"thread_start_us":1092481,"threads_started":3,"wal-append.queue_time_us":349471}
I20260709 13:13:12.566584 31690 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:12.570830 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.569962 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.639143 29393 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:12.571188 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.571854 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.640513 29392 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:12.555379 32413 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:12.575023 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:12.562873 32205 raft_consensus.cc:1068] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Service unavailable: leader transfer in progress
I20260709 13:13:12.518867 32263 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.561954 32258 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:12.567549 32317 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:12.585770 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.571995 32388 raft_consensus.cc:1081] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:13:12.517578 32245 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.585888 30155 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:12.570833 32228 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.581260 31952 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:12.614360 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.644455 32362 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:12.619493 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.716198 29396 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:12.580893 32382 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:12.630065 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 67942.7us
I20260709 13:13:12.630592 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.718807 32382 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.719375 29389 raft_consensus.cc:2410] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:12.720743 29389 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:13:12.571470 32141 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.615052 32242 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.723846 32141 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.544080 30152 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:12.323745 32302 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:12.569792 32303 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.642474 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:12.633133 29463 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.725095 30157 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.602423 32366 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.730993 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:12.731746 30151 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:12.673910 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:12.683187 32081 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.644284 31690 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.706382 29394 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:12.564074 32273 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.610220 32431 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:13:12.602970 32077 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.618281 32410 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:12.714031 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.719164 29435 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:12.724103 32242 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.725500 29463 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:12.666847 32258 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.579464 32326 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.644901 30154 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:12.670572 32317 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.737541 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:12.738595 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:12.618762 32279 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.631963 32367 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.705757 32228 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:12.699626 32089 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.644670 32413 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.667659 32365 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.741863 31690 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:12.744329 32362 raft_consensus.cc:697] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:12.774606 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 1959) took 2036 ms. Trace:
W20260709 13:13:12.758992 32443 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 13:13:12.739675 32302 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.756776 32369 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.745205 32081 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.765745 32432 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.769201 32317 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:12.759330 32258 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:12.615686 30153 rpcz_store.cc:276] 0709 13:13:10.715504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.721887 (+  6383us) service_pool.cc:224] Handling call
0709 13:13:10.961491 (+239604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.283561 (+322070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.288992 (+  5431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:11.296395 (+  7403us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:11.301544 (+  5149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.384369 (+1082825us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54005a0854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:12.384425 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.385093 (+   668us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54005a0850. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:12.385245 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034584704}
I20260709 13:13:12.761720 32077 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.768242 32391 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.810676 29463 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:12.792644 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59192.2us
I20260709 13:13:12.789760 32413 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.792589 29390 rpcz_store.cc:276] 0709 13:13:10.738408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.738558 (+   150us) service_pool.cc:224] Handling call
0709 13:13:10.738957 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:10.748365 (+  9408us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:11.222831 (+474466us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.490695 (+1267864us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:12.499211 (+  8516us) log.cc:844] Serialized 52 byte log entry
0709 13:13:12.499414 (+   203us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:12.766152 (+266738us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.766753 (+   601us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.774130 (+  7377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.774251 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.774308 (+    57us) raft_consensus.cc:1685] finished
0709 13:13:12.774325 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.774522 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395048,"prepare.queue_time_us":930591,"prepare.run_cpu_time_us":227,"prepare.run_wall_time_us":32356,"raft.queue_time_us":377821,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":31019,"spinlock_wait_cycles":10924160,"thread_start_us":1584532,"threads_started":3,"wal-append.queue_time_us":911481}
I20260709 13:13:12.826617 30156 raft_consensus.cc:2410] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:12.795363 32212 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.794337 32388 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.610358 32380 raft_consensus.cc:2955] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:12.833331 32299 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:12.834160 32444 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:13:12.826654 32426 log.cc:927] Time spent T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.828s	user 0.003s	sys 0.003s
I20260709 13:13:12.851946 32326 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.861660 32365 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.851192 32362 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.858536 32302 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:12.859969 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.869560 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:12.852886 32442 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:13:12.808498 32369 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.883005 32273 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.885033 32303 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.852372 32410 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.853155 32388 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.923264 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.924685 29397 raft_consensus.cc:2410] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:12.938664 32272 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.940775 32410 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:12.941210 32228 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.941488 32410 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:12.947415 32367 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.950636 32245 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:12.950837 32369 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.951886 32410 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.952702 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.965706 29396 raft_consensus.cc:2410] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:12.953203 32327 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.954519 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:12.955360 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:12.957820 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 188455us
I20260709 13:13:12.967983 29392 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:12.968889 29397 raft_consensus.cc:2376] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4. Re-sending same reply.
I20260709 13:13:12.969563 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:12.958215 30157 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
W20260709 13:13:12.967710 32287 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.712s	user 0.023s	sys 0.006s
I20260709 13:13:12.976846 29435 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:12.950762 32081 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:12.977098 32273 consensus_queue.cc:1059] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:12.979673 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.977283 32326 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:13:12.962930 32423 consensus_meta.cc:287] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.779s	user 0.010s	sys 0.008s
I20260709 13:13:12.975505 32287 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:12.987139 32228 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:12.988777 32287 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:12.990869 32279 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:12.966209 32370 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.010s
I20260709 13:13:12.979771 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:12.986055 32423 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.003935 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.003201 29396 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
W20260709 13:13:13.010413 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 187795us
I20260709 13:13:12.962286 32376 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.020094 30160 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:13.002470 32362 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:13.045457 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.046363 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.047236 29397 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:13.046648 29396 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:13.047703 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:13.024917 32170 raft_consensus.cc:3055] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:13.024704 32287 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:13.050241 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:13.050583 32287 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:13.051236 32287 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:13.051610 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:13.052210 29543 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:13.054919 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:13.055646 29545 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:13.058386 32263 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:13.059221 32263 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:13.059590 32263 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:13.059947 32263 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:13.063047 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.064036 29390 raft_consensus.cc:2410] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:13.066879 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.067584 29397 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:13.068274 32423 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:13.069689 32388 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.071990 32170 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:13.072201 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:13.072772 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.065868 32317 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.073176 29512 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:13.073458 29392 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:13.074093 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:13.074896 32228 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:13.075546 32317 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.062211 32258 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.073031 32170 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.077286 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.099045 29392 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:13.079581 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.097493 29543 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:13.099937 29463 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:13.080497 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.081064 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:13.081725 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:13.090852 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:13.041632 32362 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.095773 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:13.105921 29545 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:13.096149 29512 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:13.094130 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:13.102502 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.110172 29396 raft_consensus.cc:2393] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:13.103677 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:13.109359 32362 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:13.133455 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.119158 29388 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:13.071105 31952 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.094996 32296 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.124262 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:13.082165 32397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.029s	sys 0.025s
I20260709 13:13:13.126714 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.098155 32365 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:13.115214 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.131804 29543 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:13.134369 29395 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:13.134143 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:13.140079 29397 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:13.140425 30157 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:13.134615 29392 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:13.098850 32228 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:13.124470 32317 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:13.142503 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.138830 29389 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:13.130666 32299 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:13.148176 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.146955 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.150027 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:13.154565 29394 raft_consensus.cc:2410] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:13.155272 29396 raft_consensus.cc:2410] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:13.150900 29512 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:13.141261 32397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.029s	sys 0.026s
I20260709 13:13:13.184150 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:13.149230 32317 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:13.190388 29543 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:13.133912 32413 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.193456 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.143719 31690 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.197105 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:13.198176 29397 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:13.195055 29390 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:13.184003 32382 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.187449 32317 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:13.203091 30157 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:13.208228 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:13.213266 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.233s (SENT)
W20260709 13:13:13.237962 30123 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.344s (SENT)
I20260709 13:13:13.207515 29438 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:13.240056 29438 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:13.276968 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.278151 29438 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:13.282166 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.290047 32077 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:13.290635 32077 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.291057 32077 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:13.302601 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 151821us
I20260709 13:13:13.307847 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.308657 29393 raft_consensus.cc:2368] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4.
I20260709 13:13:13.311380 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:13.312482 29463 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:13.287868 32457 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:13.288045 32464 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:13.300482 32376 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:13.302759 32382 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.332643 32258 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.209371 32228 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.321223 32373 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:13.369302 32373 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:13.370168 32381 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:13.370404 32373 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.370924 32381 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.338761 32457 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:13.373167 32381 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:13.372824 32457 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.324517 32464 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.377882 32464 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:13.351243 32461 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:13:13.353168 32413 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.360682 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.389282 29391 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:13.363812 31690 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:13.322386 32299 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:13.367755 32365 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:13.367985 31952 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:13.350306 32462 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:13:13.376233 32263 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.324110 32148 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.391093 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 738) took 1116 ms. Trace:
I20260709 13:13:13.401615 30156 rpcz_store.cc:276] 0709 13:13:12.274788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.534770 (+259982us) service_pool.cc:224] Handling call
0709 13:13:13.386390 (+851620us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400271354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:13.390988 (+  4598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663666944}
I20260709 13:13:13.404654 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:13.405532 30156 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:13.405730 29394 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:13.391577 29390 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:13.391866 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 60250.4us
I20260709 13:13:13.392732 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1827) took 1080 ms. Trace:
I20260709 13:13:13.407383 29391 rpcz_store.cc:276] 0709 13:13:12.312807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.360205 (+1047398us) service_pool.cc:224] Handling call
0709 13:13:13.392660 (+ 32455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.398631 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:13.399578 32449 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.553s	user 0.004s	sys 0.000s
I20260709 13:13:13.464387 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:13.465365 29463 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:13.510823 31952 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.513197 31952 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.513471 32317 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.516175 32317 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.398598 32287 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.420552 32148 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.525588 32077 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:13.683310 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.662139 32471 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:13:13.675112 32370 raft_consensus.cc:3055] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:13.769994 32233 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:13.559167 29465 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:13.771482 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.617401 32296 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:13.772564 30151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:13:13.786630 30151 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.786257 32233 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.787288 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.788244 29470 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:13.773209 32287 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:13.644667 32263 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:13.545502 32365 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.790374 32370 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:13.527732 30156 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:13.558703 32299 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.775089 31952 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:13.775611 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:13.777225 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.778283 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.676504 29472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1927) took 1460 ms. Trace:
I20260709 13:13:13.787137 30151 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:13.788239 32296 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.789856 32233 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:13.773489 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:13.799391 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.800513 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.801002 29393 raft_consensus.cc:2376] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6. Re-sending same reply.
I20260709 13:13:13.801733 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.802374 29393 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:13.792747 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:13.794008 29463 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:13.794950 30155 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:13.791535 32370 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.809129 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.814914 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.826344 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.816228 29392 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:13.832077 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:13.833666 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.819960 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:13.802721 29472 rpcz_store.cc:276] 0709 13:13:12.215867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.215988 (+   121us) service_pool.cc:224] Handling call
0709 13:13:12.233290 (+ 17302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.759199 (+525909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.759233 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.759281 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:12.759316 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.676062 (+916746us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400412b54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:13.676141 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.676406 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208911104}
I20260709 13:13:13.827109 29393 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:13.526510 32148 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.828536 29469 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:13:13.837121 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.807548 32431 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.838716 29469 pending_rounds.cc:85] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 6
I20260709 13:13:13.839133 29469 pending_rounds.cc:107] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:13:13.839452 29469 raft_consensus.cc:2889] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:13.840574 29472 raft_consensus.cc:2368] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
I20260709 13:13:13.841095 30126 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:13.854099 29472 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:13.860778 29469 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:13:13.844883 31952 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.883854 29393 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:13.850510 32376 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:13.884568 29472 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 13:13:13.884378 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 480215us
I20260709 13:13:13.901082 29472 pending_rounds.cc:85] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 5
I20260709 13:13:13.901624 29472 pending_rounds.cc:107] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:13:13.901994 29472 raft_consensus.cc:2889] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:13.888728 32467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.013s
I20260709 13:13:13.861088 32233 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:13.906735 29463 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:13:13.872040 32432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.010s	sys 0.009s
I20260709 13:13:13.904112 29472 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:13:13.885660 32141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.021s	sys 0.011s
I20260709 13:13:13.927942 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:13.928851 29393 raft_consensus.cc:2376] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5. Re-sending same reply.
I20260709 13:13:13.903412 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:13.840384 32464 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:13.847585 32431 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.932552 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:13.917968 32467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.014s
W20260709 13:13:13.927618 32141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.021s	sys 0.012s
I20260709 13:13:13.900435 31952 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:13.951139 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.900995 32376 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.935251 30151 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.938170 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:13.896808 32307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.040s
I20260709 13:13:13.940588 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:13.988564 29470 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:13.947840 32464 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:13.948544 31961 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.996167 32307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.008s	sys 0.041s
I20260709 13:13:13.996384 31961 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:13.924729 32233 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:13.957882 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:13.904122 32380 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.936347 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:13.927289 32432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.011s	sys 0.009s
I20260709 13:13:13.937062 32453 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:14.001431 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:14.012497 29472 raft_consensus.cc:2368] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:13.974364 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:14.002338 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:14.003852 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 46081.6us
I20260709 13:13:13.938223 29393 raft_consensus.cc:2376] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3. Re-sending same reply.
I20260709 13:13:14.013816 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:14.014837 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.003840 32432 raft_consensus.cc:697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:13.969347 32362 consensus_meta.cc:287] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.006s
I20260709 13:13:13.997542 32376 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:14.004374 32233 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:14.238950 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.025267 32479 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:13:13.974895 32431 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:13.962179 32366 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:14.056680 32477 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 13:13:14.016920 32380 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:14.239928 32362 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:14.260979 32362 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:14.098762 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 332406us
I20260709 13:13:14.015604 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:14.207134 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:14.265695 32242 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:14.265910 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 250373us
I20260709 13:13:14.260886 32380 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:14.266363 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.267009 29467 raft_consensus.cc:2368] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:14.267572 29363 leader_election.cc:400] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
I20260709 13:13:14.267958 29363 leader_election.cc:403] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:14.011144 32279 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.213243 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.214829 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:14.215988 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 241688us
I20260709 13:13:14.218014 32453 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.222421 30151 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:14.253393 32432 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:14.257483 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 629) took 2068 ms. Trace:
I20260709 13:13:14.267773 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.206931 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.229401 32465 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:14.277917 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:14.292451 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:14.287678 29509 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.761s	user 0.006s	sys 0.013s
I20260709 13:13:14.292111 30160 rpcz_store.cc:276] 0709 13:13:12.188569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.188709 (+   140us) service_pool.cc:224] Handling call
0709 13:13:12.196907 (+  8198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.021715 (+824808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.257022 (+1235307us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b5400730354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:14.257353 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1892465920}
I20260709 13:13:14.294387 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:14.281962 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2126) took 1698 ms. Trace:
I20260709 13:13:14.295851 29392 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:14.295948 29393 raft_consensus.cc:2376] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6. Re-sending same reply.
I20260709 13:13:14.301079 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:14.301187 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:14.302251 29545 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:14.296669 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:14.298369 29509 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.771s	user 0.007s	sys 0.013s
I20260709 13:13:14.295799 29538 rpcz_store.cc:276] 0709 13:13:12.583156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.583336 (+   180us) service_pool.cc:224] Handling call
0709 13:13:12.583638 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.618247 (+ 34609us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:12.728531 (+110284us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.788567 (+ 60036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.788630 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:12.788680 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.281698 (+1493018us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b540037b9d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:14.281750 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.281885 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4206,"spinlock_wait_cycles":78997248,"thread_start_us":59551,"threads_started":1,"wal-append.queue_time_us":190856,"wal-append.run_cpu_time_us":1549,"wal-append.run_wall_time_us":1070198}
W20260709 13:13:14.303646 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 2.04172e+06us
I20260709 13:13:14.303325 29472 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:14.292037 29463 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:14.305749 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.280908 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:14.287958 32268 raft_consensus.cc:993] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:14.299113 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.307152 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:14.310750 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:14.311210 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 43816.4us
I20260709 13:13:14.311372 29392 raft_consensus.cc:2376] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6. Re-sending same reply.
I20260709 13:13:14.312227 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:14.312273 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:14.312724 29393 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:14.312906 29538 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:14.313211 29392 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:14.337256 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:14.340457 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:14.344245 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.294176 32465 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.337191 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.277540 31952 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:14.356015 29435 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:14.269029 32242 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:13:14.361328 29392 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:14.339797 32307 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:14.369683 29545 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:13:14.376339 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71735.3us
I20260709 13:13:14.378357 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:14.378669 29393 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:14.380273 29393 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:14.381865 29393 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:14.358246 32373 raft_consensus.cc:1081] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:13:14.367395 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.371421 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:14.353653 32268 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:14.357548 32431 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:14.392721 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:14.370407 32417 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:14.390733 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:14.365398 32465 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:14.294979 32453 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:14.388574 29392 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:14.391427 32268 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:14.393893 32259 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:14.397035 32382 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:14.675874 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.676916 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.385210 31952 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:14.678031 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.376703 32457 consensus_queue.cc:1059] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:13:14.389688 32299 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:14.678586 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 283193us
I20260709 13:13:14.682976 29394 raft_consensus.cc:3055] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:14.723248 29394 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:14.724687 29394 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:14.716962 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 320076us
I20260709 13:13:14.725785 29394 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.726683 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:14.716404 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1853) took 1134 ms. Trace:
I20260709 13:13:14.731253 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:14.731518 29397 rpcz_store.cc:276] 0709 13:13:13.582567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.582882 (+   315us) service_pool.cc:224] Handling call
0709 13:13:14.582667 (+999785us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:14.716326 (+133659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40065280}
I20260709 13:13:14.732787 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:14.734637 29545 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:13:14.718951 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.677676 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2003) took 1274 ms. Trace:
I20260709 13:13:14.736227 29396 rpcz_store.cc:276] 0709 13:13:13.403443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.403562 (+   119us) service_pool.cc:224] Handling call
0709 13:13:14.513311 (+1109749us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:14.677158 (+163847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.677371 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.677394 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:14.677432 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:14.677461 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.677511 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.677611 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44524928}
I20260709 13:13:14.739843 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:14.707190 32463 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.507s	user 0.002s	sys 0.008s
I20260709 13:13:14.740784 29545 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:14.742211 29542 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:14.743098 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.743287 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:14.713091 29538 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:14.744161 29542 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.709206 32268 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.744930 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:14.714915 32494 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.325s	user 0.007s	sys 0.025s
I20260709 13:13:14.799363 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:14.800417 29463 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:14.719504 32487 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.337s	user 0.005s	sys 0.004s
I20260709 13:13:14.689483 32417 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:14.754908 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:14.813962 29542 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:14.755777 32077 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:14.757596 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:14.742198 32170 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:14.759116 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:14.742583 32242 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:13:14.764343 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:14.771134 32362 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:14.775372 32454 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.928s	user 0.013s	sys 0.016s
W20260709 13:13:14.776396 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 49855.6us
I20260709 13:13:14.728143 31952 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:14.849681 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:14.851089 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 358) took 2179 ms. Trace:
I20260709 13:13:14.851148 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:14.851817 31952 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:14.790280 32493 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.853315 32493 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:14.855711 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.689167 32269 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:14.752674 29546 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 3.
I20260709 13:13:14.858881 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.860227 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:14.861304 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:14.856329 29389 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:14.862424 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1856) took 1218 ms. Trace:
I20260709 13:13:14.862810 29389 rpcz_store.cc:276] 0709 13:13:13.644067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.769950 (+125883us) service_pool.cc:224] Handling call
0709 13:13:14.855544 (+1085594us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:14.862344 (+  6800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26041088}
W20260709 13:13:14.865091 32376 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.002s
I20260709 13:13:14.865173 29546 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:14.865614 32376 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:14.856297 32493 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:14.867414 32242 consensus_queue.cc:1243] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:14.869546 29546 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:13:14.870585 29463 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:14.745831 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:14.816402 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:14.735111 32299 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:14.877133 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.001s	sys 0.009s
I20260709 13:13:14.840050 29545 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:14.842330 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:14.840644 29539 raft_consensus.cc:2368] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8.
W20260709 13:13:14.879743 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 169915us
I20260709 13:13:14.747534 31961 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:14.839813 32482 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.027s	sys 0.013s
I20260709 13:13:14.852620 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:14.883908 29543 raft_consensus.cc:2368] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8.
W20260709 13:13:14.884079 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.874583 29542 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:14.885428 29537 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:14.876999 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:14.839052 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.851606 29464 rpcz_store.cc:276] 0709 13:13:12.672340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.672513 (+   173us) service_pool.cc:224] Handling call
0709 13:13:12.672975 (+   462us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:12.685356 (+ 12381us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:12.685396 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:12.705837 (+ 20441us) log.cc:844] Serialized 52 byte log entry
0709 13:13:12.819815 (+113978us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:12.819876 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.820291 (+   415us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.498397 (+1678106us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:14.850736 (+352339us) raft_consensus.cc:1685] finished
0709 13:13:14.850761 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.851019 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14600,"raft.queue_time_us":27845,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":3681,"spinlock_wait_cycles":14072064,"thread_start_us":61057,"threads_started":1,"wal-append.queue_time_us":100346}
I20260709 13:13:14.716538 32382 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.730340 32233 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:14.880633 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.001s	sys 0.009s
I20260709 13:13:14.881819 29391 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:14.880347 32299 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:14.883430 32482 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.027s	sys 0.014s
W20260709 13:13:14.893110 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 581136us
I20260709 13:13:14.893625 29394 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:13:14.895352 29394 pending_rounds.cc:85] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 1
W20260709 13:13:14.892347 29391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1852) took 1345 ms (client timeout 1622 ms). Trace:
I20260709 13:13:14.895954 29394 pending_rounds.cc:107] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:14.887677 29540 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:14.896018 29391 rpcz_store.cc:269] 0709 13:13:13.546859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.547190 (+   331us) service_pool.cc:224] Handling call
0709 13:13:14.842125 (+1294935us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:14.892262 (+ 50137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44248448}
I20260709 13:13:14.896304 29394 raft_consensus.cc:2889] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:14.884601 29509 connection.cc:256] RPC call timeout handler was delayed by -2.5282980440001666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:13:14.897919 29509 connection.cc:256] RPC call timeout handler was delayed by -2.5264980440001636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:13:14.898334 29509 connection.cc:256] RPC call timeout handler was delayed by -2.479698044000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20260709 13:13:14.898824 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2005) took 1491 ms. Trace:
W20260709 13:13:14.911419 32478 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.694s	user 0.000s	sys 0.001s
I20260709 13:13:14.912313 32373 consensus_queue.cc:1059] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:14.913602 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2006) took 1498 ms. Trace:
I20260709 13:13:14.913709 32370 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:14.898957 29509 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.504s (SENT)
I20260709 13:13:14.914067 29390 rpcz_store.cc:276] 0709 13:13:13.414816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.415903 (+  1087us) service_pool.cc:224] Handling call
0709 13:13:14.912756 (+1496853us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:14.913034 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.913244 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.913274 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:14.913317 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:14.913344 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.913399 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.913530 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41842560}
I20260709 13:13:14.916210 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:14.888008 31961 raft_consensus.cc:3055] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:14.919085 29509 leader_election.cc:336] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.571s (SENT)
I20260709 13:13:14.891628 32382 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:14.921726 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:14.919528 29394 rpcz_store.cc:276] 0709 13:13:13.407378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.407592 (+   214us) service_pool.cc:224] Handling call
0709 13:13:14.581718 (+1174126us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:13:14.682773 (+101055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.898065 (+215292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.898616 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43330816}
I20260709 13:13:14.926131 32077 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:14.926399 29509 leader_election.cc:336] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.584s (SENT)
I20260709 13:13:14.931011 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:14.932821 29509 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.614s (SENT)
I20260709 13:13:14.921380 31952 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:14.933507 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:14.936183 29509 leader_election.cc:336] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.667s (SENT)
I20260709 13:13:14.921511 31961 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:13:14.929065 30123 leader_election.cc:336] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.175s (SENT)
I20260709 13:13:14.935709 32365 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:14.946534 29471 raft_consensus.cc:1240] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:14.934391 32228 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:14.937281 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:14.962004 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 110095us
W20260709 13:13:14.963608 29509 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.679s (SENT)
I20260709 13:13:14.924393 32417 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:14.964639 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:14.969799 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:14.973763 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:14.976114 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:14.955317 32453 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:14.999476 29509 leader_election.cc:336] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.746s (SENT)
W20260709 13:13:15.001317 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.024336 30156 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:15.027000 30156 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:14.963905 32228 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:14.962157 32307 consensus_meta.cc:287] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.003s
I20260709 13:13:15.025671 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:15.029482 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:15.031790 30157 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:15.027891 30156 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.036041 30156 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:15.040933 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 145514us
W20260709 13:13:15.041471 29509 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.781s (SENT)
I20260709 13:13:15.042048 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:15.043466 29509 leader_election.cc:336] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.784s (SENT)
W20260709 13:13:15.044613 29509 connection.cc:256] RPC call timeout handler was delayed by -2.4018833309999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:13:15.044991 29509 connection.cc:256] RPC call timeout handler was delayed by -2.3779980440001509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:13:15.050006 30156 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:13:15.050650 30156 pending_rounds.cc:85] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 7
I20260709 13:13:15.050947 30156 pending_rounds.cc:107] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:13:15.051210 30156 raft_consensus.cc:2889] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:15.053519 29509 leader_election.cc:336] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.848s (SENT)
I20260709 13:13:15.053891 29509 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:15.027510 32365 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:15.039335 32307 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
W20260709 13:13:15.042729 32279 consensus_meta.cc:287] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.002s
I20260709 13:13:15.039569 32376 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:15.040922 31952 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:14.964342 31961 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:15.068102 29509 connection.cc:256] RPC call timeout handler was delayed by -2.2133553279998068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 13:13:15.069279 32507 log.cc:927] Time spent T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:13:15.065958 32510 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:15.076534 32510 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:15.077700 32465 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.636s	user 0.014s	sys 0.000s
I20260709 13:13:15.078161 32465 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.079039 32510 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.080461 32465 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.051203 32484 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:15.070851 31961 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.082727 32204 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.083280 32204 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.059803 32228 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:15.054895 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.053109 32259 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:15.069943 32307 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:15.027036 32506 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:13:15.066424 32279 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:15.090756 32233 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:15.094353 32506 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:15.099784 32506 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:15.100226 32513 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:13:15.100665 32506 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.084728 32268 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.102025 32506 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.104018 32268 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.108765 32299 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:15.109644 32495 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.396s	user 0.002s	sys 0.007s
I20260709 13:13:15.111547 32299 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.113054 32366 raft_consensus.cc:3055] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:15.113495 32366 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:15.114318 32366 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:15.151698 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.164309 29388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 1984) took 2630 ms (client timeout 2067 ms). Trace:
W20260709 13:13:15.165123 29388 rpcz_store.cc:269] 0709 13:13:12.533696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.570935 (+ 37239us) service_pool.cc:224] Handling call
0709 13:13:15.163485 (+2592550us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54003a20d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:15.163910 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100648192}
I20260709 13:13:15.168845 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:15.170600 29395 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:15.171970 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 129223us
I20260709 13:13:15.176985 29468 raft_consensus.cc:2410] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:15.178067 29363 leader_election.cc:400] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:15.178747 29363 leader_election.cc:403] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:15.180558 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:15.181689 29470 raft_consensus.cc:2410] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:15.204044 32399 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:15.071362 29509 connection.cc:256] RPC call timeout handler was delayed by -2.167250408999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:13:15.207059 29509 connection.cc:256] RPC call timeout handler was delayed by -1.9284547919999113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2398s for a response
W20260709 13:13:15.207690 29509 connection.cc:256] RPC call timeout handler was delayed by -1.8983232860000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2424s for a response
W20260709 13:13:15.208250 29509 connection.cc:256] RPC call timeout handler was delayed by -1.5806232859999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2777s for a response
W20260709 13:13:15.208700 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3600980440000967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.326s for a response
I20260709 13:13:15.209021 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1936) took 2139 ms. Trace:
W20260709 13:13:15.209161 29509 connection.cc:256] RPC call timeout handler was delayed by -1.1919041490000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2984s for a response
W20260709 13:13:15.209753 29509 connection.cc:256] RPC call timeout handler was delayed by -1.1297386619999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 13:13:15.195791 29538 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:15.196748 30154 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:15.199412 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.213815 30155 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:15.200275 32363 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.215325 32363 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.217334 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.218407 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.220124 29463 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:15.220312 29467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 1943) took 2139 ms (client timeout 1712 ms). Trace:
W20260709 13:13:15.220918 29467 rpcz_store.cc:269] 0709 13:13:13.081060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.090565 (+  9505us) service_pool.cc:224] Handling call
0709 13:13:15.219752 (+2129187us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540004ef54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:15.220049 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679246208}
W20260709 13:13:15.223982 32502 raft_consensus.cc:670] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:13:15.227370 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.228571 30155 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:15.205401 32399 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:15.210392 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0343386619999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 13:13:15.230031 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 284277us
I20260709 13:13:15.242316 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1747) took 1245 ms. Trace:
W20260709 13:13:15.158227 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.238365 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:15.236867 32504 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:13:15.259315 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.260514 32504 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:15.229382 30154 raft_consensus.cc:1240] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:15.209650 29471 rpcz_store.cc:276] 0709 13:13:13.069713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.076354 (+  6641us) service_pool.cc:224] Handling call
0709 13:13:13.076741 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.949406 (+1872665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.208121 (+258715us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540019bed4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:15.208648 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4299405056}
I20260709 13:13:15.231237 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:15.261140 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0310739359999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.42779999999999996s for a response
I20260709 13:13:15.258342 29468 rpcz_store.cc:276] 0709 13:13:13.996921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.277571 (+280650us) service_pool.cc:224] Handling call
0709 13:13:15.241993 (+964422us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400213c54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:15.242210 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026568576}
I20260709 13:13:15.241650 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1746) took 1245 ms. Trace:
I20260709 13:13:15.243553 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:15.233664 32382 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.230274 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:15.244966 29512 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:15.266635 29470 rpcz_store.cc:276] 0709 13:13:13.996561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.861044 (+864483us) service_pool.cc:224] Handling call
0709 13:13:15.241295 (+380251us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54001e4954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:15.241521 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733294976}
I20260709 13:13:15.237190 30126 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:15.273238 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:15.234346 32502 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.239151 32363 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:15.282974 30160 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:13:15.235848 32376 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:15.286098 32299 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:15.287046 32296 consensus_queue.cc:1059] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:15.287981 29469 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.287189 32299 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:15.288833 32365 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:15.289391 32365 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:15.290391 32299 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.290813 32365 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.291529 32502 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.292814 30153 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:15.292858 29544 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:15.295228 29512 leader_election.cc:400] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:15.303817 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1941) took 2223 ms. Trace:
I20260709 13:13:15.304414 29465 rpcz_store.cc:276] 0709 13:13:13.080438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.080563 (+   125us) service_pool.cc:224] Handling call
0709 13:13:13.080844 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.789207 (+708363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.303064 (+1513857us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54002c5954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:15.303564 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099484928}
I20260709 13:13:15.287914 32242 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:15.296152 32204 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:15.298815 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.232s (SENT)
I20260709 13:13:15.313898 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:15.287017 32376 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.315569 30151 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.263317 32504 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:15.321148 32504 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.245318 32366 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.303984 29512 leader_election.cc:403] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:15.322788 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:15.281699 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:15.333494 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.303345 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 123191us
I20260709 13:13:15.351063 32502 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:15.386787 29390 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.389308 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.387045 32504 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.388700 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.396755 30156 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:15.397670 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 78687.4us
W20260709 13:13:15.398484 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.390427 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:15.387442 29363 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:15.391367 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.403661 30160 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:15.404819 32228 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.405586 32228 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.407140 32399 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:15.407913 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.410912 30151 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:13:15.388020 32517 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.269s	user 0.003s	sys 0.000s
W20260709 13:13:15.415434 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 178566us
I20260709 13:13:15.391757 32376 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:15.424170 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.427572 29471 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:15.430624 32077 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.434203 29468 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:15.430657 32382 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.430547 32506 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.439937 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:15.445117 32484 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:15.446393 32506 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.447041 32506 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.434617 32502 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.446874 31952 consensus_queue.cc:1059] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:15.444293 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:15.458776 29469 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:15.463786 29470 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:15.463675 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:15.465418 32365 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.451234 32502 raft_consensus.cc:697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:15.471647 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:15.471899 32502 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.472546 29389 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.470456 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 633) took 1699 ms. Trace:
I20260709 13:13:15.476029 32228 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.474732 30158 rpcz_store.cc:276] 0709 13:13:13.770994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.771152 (+   158us) service_pool.cc:224] Handling call
0709 13:13:13.771531 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.787913 (+ 16382us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:14.212958 (+425045us) log.cc:844] Serialized 14 byte log entry
0709 13:13:14.559244 (+346286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:14.703448 (+144204us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:14.703543 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.109044 (+405501us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:15.467778 (+358734us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5400475c54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:15.470029 (+  2251us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.470209 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":481593,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":491335,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":48840832,"thread_start_us":687433,"threads_started":3,"wal-append.queue_time_us":185418}
I20260709 13:13:15.472380 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:15.478834 30154 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:15.478693 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:15.480615 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:15.480748 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:15.481689 29392 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.483407 29396 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:15.484447 29465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:13:15.485357 29465 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership
W20260709 13:13:15.491662 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52798.1us
I20260709 13:13:15.497380 32513 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:15.498499 32242 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:15.498950 32242 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:15.500209 32242 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.502105 32242 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:15.502346 32141 raft_consensus.cc:3055] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:15.503047 32141 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:15.504073 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 60050.4us
I20260709 13:13:15.504504 32141 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.508404 32296 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:15.521371 31952 raft_consensus.cc:3055] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:15.521936 31952 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:15.523397 31952 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.525113 31952 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.506402 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:15.509150 29393 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:15.527204 32296 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:15.527889 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.511844 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.514833 29396 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:15.529058 29396 pending_rounds.cc:85] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 2
I20260709 13:13:15.528899 29465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:13:15.529331 29396 pending_rounds.cc:107] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:13:15.514065 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 148741us
I20260709 13:13:15.529606 29465 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:13:15.529706 29396 raft_consensus.cc:2889] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:15.507947 32382 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:15.514096 32374 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.533617 32374 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.508610 32228 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:13:15.536267 32272 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:15.513315 29395 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:15.541695 29395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 2004) took 2138 ms (client timeout 1621 ms). Trace:
I20260709 13:13:15.506188 32141 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.515360 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:15.549671 30123 leader_election.cc:336] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.177s (SENT)
W20260709 13:13:15.551433 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 58623.9us
I20260709 13:13:15.550570 29390 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:15.542657 29395 rpcz_store.cc:269] 0709 13:13:13.403737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.404643 (+   906us) service_pool.cc:224] Handling call
0709 13:13:15.168340 (+1763697us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:15.541608 (+373268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43052416}
I20260709 13:13:15.556473 29392 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:15.551107 32374 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.553859 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:15.565696 29388 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:15.567188 32515 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:15.569585 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:15.569800 32513 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:15.563004 32279 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:15.576810 29512 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:15.586886 32484 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.587426 32484 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.587793 32484 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.588001 30155 raft_consensus.cc:2410] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:15.590828 32431 raft_consensus.cc:993] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:15.590662 32299 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:15.590662 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:15.591849 32264 raft_consensus.cc:1081] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:15.592024 32299 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:15.592546 29538 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.593948 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:15.596885 29438 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:15.592545 32299 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:15.598783 31642 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:15.599315 31642 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.599787 31642 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.599576 32299 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.601300 29468 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:15.601812 32272 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:15.602680 32366 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:15.601300 29465 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:15.604327 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 57956.4us
I20260709 13:13:15.588037 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:15.606073 29363 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:15.612962 29538 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:15.601327 32299 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:15.644821 32513 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:15.645797 32513 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:15.647234 32513 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.634239 29394 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:15.656736 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:15.657330 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 51383us
I20260709 13:13:15.627537 32228 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:15.666474 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.617687 32382 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:13:15.630744 31961 consensus_queue.cc:1059] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:13:15.672873 31961 raft_consensus.cc:3055] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:15.673418 31961 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:15.674610 32264 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:15.676965 29465 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:13:15.650404 32370 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:15.679010 32370 raft_consensus.cc:697] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:15.678620 31961 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.680680 31961 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.680485 32370 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.686700 29540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:13:15.687626 29540 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.688098 29540 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.692818 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:15.694636 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:15.695983 29543 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:15.697193 32382 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:15.697688 32382 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:15.698104 32382 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.698625 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:15.700492 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:15.701361 29468 raft_consensus.cc:2368] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8.
I20260709 13:13:15.702086 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.702872 29472 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:15.702943 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:15.704016 29468 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:15.704612 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:15.705775 29471 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:15.706990 29467 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:15.623814 32506 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.700533 29546 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:15.623760 32296 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:13:15.736472 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.737977 29471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:13:15.738771 29471 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:13:15.714357 32228 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:15.746971 29435 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:15.767642 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.770267 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.771714 29468 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:15.771809 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:15.780448 32502 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.791536 29389 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:15.753203 32264 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:13:15.794901 29468 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:15.777740 32077 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:15.798728 29467 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:15.791819 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:15.800168 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:15.816380 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:15.800299 32205 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:15.797427 32506 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:15.823007 30155 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.823825 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:15.785940 32502 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.830960 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:15.831076 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.838562 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:15.841182 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.837847 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.848600 29468 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:15.856160 29471 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.857326 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.858038 29468 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:15.840077 32205 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:15.862726 32457 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:15.863358 32457 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:15.863222 32205 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.864501 32457 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:15.866881 29291 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 284) took 19456 ms (client timeout 15000 ms). Trace:
I20260709 13:13:15.869702 29466 raft_consensus.cc:2393] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:15.866390 32228 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.850090 32204 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:15.875299 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.876534 32376 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:15.877287 32504 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:15.878156 29463 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:15.878836 32233 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:15.887161 31642 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:15.937904 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.946480 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:15.895454 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 307541us
I20260709 13:13:15.899385 29544 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:15.896054 29466 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:15.950021 30151 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:15.905520 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:15.906162 29469 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:15.951249 29468 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:15.906317 32204 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:15.873970 32484 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:15.910125 29540 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:15.914057 32382 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:15.918283 32502 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:15.923233 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.928789 30155 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:15.893926 29538 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:15.952884 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:15.955899 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:15.960598 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65512.5us
I20260709 13:13:15.961855 32170 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:15.961737 29435 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:15.963663 29470 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:15.964443 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:15.970489 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.867391 29291 rpcz_store.cc:269] 0709 13:12:56.410941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.411449 (+   508us) service_pool.cc:224] Handling call
0709 13:13:15.866589 (+19455140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:11.635472 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:11.860185 (+224713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:11.862346 (+  2161us) write_op.cc:435] Acquired schema lock
0709 13:13:11.867312 (+  4966us) tablet.cc:662] Decoding operations
0709 13:13:12.083539 (+216227us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:12.083616 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:12.083643 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:13:12.084470 (+   827us) tablet.cc:701] Row locks acquired
0709 13:13:12.084489 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:12.084652 (+   163us) write_op.cc:270] Start()
0709 13:13:12.084777 (+   125us) write_op.cc:276] Timestamp: P: 1783602792084602 usec, L: 0
0709 13:13:12.084801 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:13:12.108014 (+ 23213us) log.cc:844] Serialized 3181 byte log entry
0709 13:13:12.986349 (+878335us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e58970ac 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b
0709 13:13:14.270301 (+1283952us) op_driver.cc:464] REPLICATION: finished
0709 13:13:14.962426 (+692125us) write_op.cc:301] APPLY: starting
0709 13:13:14.965998 (+  3572us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:15.043446 (+ 77448us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:15.047877 (+  4431us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:15.087205 (+ 39328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:15.087471 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:13:15.087529 (+    58us) write_op.cc:312] APPLY: finished
0709 13:13:15.087841 (+   312us) log.cc:844] Serialized 59 byte log entry
0709 13:13:15.105090 (+ 17249us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:15.105297 (+   207us) write_op.cc:454] Released schema lock
0709 13:13:15.105380 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:15.105969 (+   589us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:15.106014 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":681709,"apply.run_cpu_time_us":13844,"apply.run_wall_time_us":147336,"num_ops":7,"prepare.queue_time_us":812252,"prepare.run_cpu_time_us":62868,"prepare.run_wall_time_us":1576282,"raft.queue_time_us":710091,"raft.run_cpu_time_us":43279,"raft.run_wall_time_us":664323,"replication_time_us":2185264,"spinlock_wait_cycles":31774464,"thread_start_us":2460424,"threads_started":5,"wal-append.queue_time_us":1100353,"wal-append.run_cpu_time_us":47916,"wal-append.run_wall_time_us":1744476}]]}
W20260709 13:13:15.981390 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 105200us
W20260709 13:13:15.984771 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.985747 29540 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:15.987468 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:15.988430 29469 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:15.988847 29469 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:15.991647 29546 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:16.004208 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.004314 29543 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:15.999420 30154 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:15.979359 32502 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:13:16.014333 32530 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:13:16.004029 32536 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:13:16.018625 31952 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.985988 32506 consensus_queue.cc:1059] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:13:16.021832 32506 raft_consensus.cc:3055] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:16.022255 32506 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:16.023393 32506 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:16.024477 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.024905 32506 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:16.026325 32204 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:16.027007 32510 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:16.028507 30158 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:16.030326 29542 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:16.033557 29545 raft_consensus.cc:2410] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:13:16.000826 32170 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:16.033309 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:16.038996 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.039881 29389 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:16.053613 32534 consensus_queue.cc:1059] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:13:16.061304 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.062129 29389 raft_consensus.cc:2368] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
I20260709 13:13:16.071700 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.072638 29394 raft_consensus.cc:2368] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
W20260709 13:13:16.073850 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 68610.7us
I20260709 13:13:16.080267 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.081480 29392 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:16.081744 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.082588 29388 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:16.086745 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.087684 29389 raft_consensus.cc:2410] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:16.091872 31642 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:16.093815 32170 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.050668 32510 raft_consensus.cc:697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:16.094357 32484 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:16.101671 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 112368us
W20260709 13:13:16.108840 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.120595 30126 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:16.127286 29388 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:16.127236 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.130007 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.131033 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.132580 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:16.134181 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.151839 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.153191 29389 raft_consensus.cc:2368] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
W20260709 13:13:16.154217 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 50570.1us
I20260709 13:13:16.160988 29471 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:16.100849 32504 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:13:16.164793 29509 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.165953 29394 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:16.176715 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.183069 31952 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:16.183658 29389 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:16.164521 32382 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:16.187147 32504 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:16.187650 32504 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:16.188699 32504 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.179666 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:16.191408 32204 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.192423 32204 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:16.166684 32534 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:16.194530 32204 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:16.195240 32534 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:16.195761 32534 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:16.196053 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.196815 29391 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:13:16.197934 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.204854 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:16.205041 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 150481us
W20260709 13:13:16.212924 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 72738.2us
I20260709 13:13:16.220288 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.221405 29390 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:16.221536 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:16.204713 32484 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:16.223285 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.115268 32510 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:16.227172 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.228309 29388 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:16.228495 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.217972 32205 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:16.246662 32205 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:16.247170 29390 raft_consensus.cc:1240] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:16.248452 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.227133 32504 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.249738 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.250783 29394 raft_consensus.cc:2410] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:13:16.247200 32205 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:16.252059 29395 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:16.253348 29396 raft_consensus.cc:1240] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:16.254985 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.259049 31952 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:16.271315 29392 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:16.266819 29469 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:16.275759 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.277012 29388 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:16.275305 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47035.4us
W20260709 13:13:16.275987 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 60346.6us
W20260709 13:13:16.286479 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 62348.8us
I20260709 13:13:16.287930 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.289064 31952 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:16.289748 29509 leader_election.cc:400] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 3. Current term is 4.
I20260709 13:13:16.295888 30154 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:16.308075 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.309533 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.310968 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.313246 29393 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:16.317972 29469 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:16.334859 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:16.335825 30158 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:16.339695 32205 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:16.340488 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50930.2us
W20260709 13:13:16.341293 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.341652 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:16.315972 29360 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:16.342341 29471 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:16.343231 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.343955 29397 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:16.346743 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67964.9us
I20260709 13:13:16.344781 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:16.351117 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.304100 32170 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:16.357429 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.358352 29397 raft_consensus.cc:2376] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6. Re-sending same reply.
I20260709 13:13:16.359664 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.360419 32548 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.361146 32548 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.347617 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:16.380781 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.402664 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.350224 32484 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.408639 30158 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:16.352479 32506 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:16.416250 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 68725.5us
I20260709 13:13:16.424190 29469 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:16.424376 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.390491 32204 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:16.427618 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.432726 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.425632 29512 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:16.442595 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.450467 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:16.451252 29392 raft_consensus.cc:2376] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6. Re-sending same reply.
I20260709 13:13:16.400954 32170 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:16.385456 32515 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:13:16.458962 29438 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:16.393692 32242 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:13:16.391038 32279 consensus_queue.cc:1059] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:13:16.456614 32484 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.474241 32272 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.462860 32299 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:16.482910 32373 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:16.483227 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83047.6us
I20260709 13:13:16.485258 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:16.485759 29392 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:16.489392 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:16.462689 32366 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:13:16.511770 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 59434.6us
I20260709 13:13:16.483268 32170 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.519496 32228 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:16.522192 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:16.524695 29388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
W20260709 13:13:16.524749 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.525523 29388 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.526011 29388 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:16.527354 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.535634 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 172529us
I20260709 13:13:16.506186 32299 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:16.488068 32534 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.545588 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.546535 29391 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:16.540300 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:16.511027 32205 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:16.527388 32457 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:16.565196 30126 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.225s (SENT)
I20260709 13:13:16.579192 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:16.580780 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.232s (SENT)
I20260709 13:13:16.581394 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.528964 32530 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:13:16.582897 32233 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:16.583061 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 56395us
I20260709 13:13:16.583827 30158 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:16.549564 31642 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.510207 32272 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:16.598685 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.550202 32506 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:16.577293 32457 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.583164 32530 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:16.604660 32272 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:16.563108 32212 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:13:16.608189 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:16.598102 30123 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.606748 32299 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:16.608353 29388 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:16.615185 29388 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:16.607898 29438 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:16.621692 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 99644.8us
I20260709 13:13:16.595180 32504 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:16.586707 32548 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:16.597043 32279 raft_consensus.cc:3055] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:16.627123 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:16.609169 32530 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:16.609813 32457 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:16.629369 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:16.619010 32233 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.643021 30155 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:16.643879 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.645937 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52684.8us
W20260709 13:13:16.650364 32555 log.cc:927] Time spent T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:13:16.651048 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:16.651755 32554 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:16.651837 29389 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:16.654681 32376 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:16.655134 32376 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:16.632429 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:16.658277 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 77532.8us
I20260709 13:13:16.625633 32504 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:16.631733 29343 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7ffbae1cdd164f7181ae5fbf7ecf65d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:16.634830 32373 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:16.627588 32279 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:16.672736 32534 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:16.672776 32373 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.673962 32373 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:16.673758 32279 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.675405 32279 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:16.668411 32504 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:16.679242 32530 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:16.680182 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71754.2us
I20260709 13:13:16.681216 32530 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.681370 32205 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:16.683965 29396 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:16.684188 29394 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:16.684672 32233 consensus_queue.cc:1059] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:16.686630 32233 raft_consensus.cc:3055] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:16.688841 32233 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:16.661610 32548 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.689963 32233 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.690676 32506 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.631588 31952 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:16.669080 29343 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0585fb6756aa496392b1ee0371aa9804 already in progress
W20260709 13:13:16.671267 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63469.5us
I20260709 13:13:16.655702 32212 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:16.698877 30126 leader_election.cc:336] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.137s (SENT)
I20260709 13:13:16.700985 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.671289 29392 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:16.651079 32557 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:16.630991 32204 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.669157 29393 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:16.681164 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.685441 32534 consensus_queue.cc:1059] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:13:16.699712 29343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0585fb6756aa496392b1ee0371aa9804 already in progress
W20260709 13:13:16.736267 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 291287us
W20260709 13:13:16.742789 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.745262 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.747057 29389 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:16.747215 29393 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:13:16.753813 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54972.1us
I20260709 13:13:16.742798 32233 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:16.760354 29542 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:13:16.760773 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.762074 29363 leader_election.cc:336] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.557s (SENT)
I20260709 13:13:16.763710 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.775429 30155 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:16.664016 32376 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.776906 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:16.778894 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 97862.7us
I20260709 13:13:16.791000 29545 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:16.764835 32502 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:16.744840 31642 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:13:16.753324 31952 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:16.835654 32569 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:13:16.836443 31952 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:16.838057 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.821153 32205 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.838905 32205 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.820535 29538 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:16.844025 32566 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:13:16.844539 32376 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:16.783361 32565 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:16.852321 29393 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:13:16.853955 32299 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:16.792575 32382 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.824807 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.854928 32382 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:16.825862 32510 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:16.857627 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 100922us
I20260709 13:13:16.841006 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.842170 32205 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:16.867020 29538 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:16.857584 32484 raft_consensus.cc:2764] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:16.868755 32510 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:16.869477 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:16.873580 29543 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:13:16.875600 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 158799us
I20260709 13:13:16.877874 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:16.881058 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:16.882624 29363 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.558s (SENT)
I20260709 13:13:16.883222 32382 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:16.883291 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.876808 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:16.885061 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:16.885771 29388 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:16.887115 29465 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:16.888737 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:16.891528 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.880154 31952 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.911444 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:16.888623 32515 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.923682 29509 leader_election.cc:400] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
I20260709 13:13:16.924108 29509 leader_election.cc:403] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:13:16.925516 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 44993.5us
I20260709 13:13:16.926414 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:16.896303 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:16.895893 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:16.893992 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:16.927731 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50958.4us
I20260709 13:13:16.892189 32373 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:16.943877 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.930233 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:16.934722 32564 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:16.940192 32580 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:16.921311 32504 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.946723 32580 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:16.947242 32580 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:16.948468 32504 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:16.940783 32296 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
I20260709 13:13:16.941985 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:16.950763 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 71847.3us
W20260709 13:13:16.951645 29363 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.570s (SENT)
I20260709 13:13:16.952044 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.952908 30126 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:16.945727 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.941774 32510 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:16.957109 32366 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.957672 32504 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:16.962630 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:16.970629 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 64802.6us
I20260709 13:13:16.971040 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:16.971944 29468 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.971913 29509 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.981839 29470 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:13:16.982895 29363 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.621s (SENT)
I20260709 13:13:16.983460 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.984424 32279 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:16.985432 29363 leader_election.cc:336] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.705s (SENT)
I20260709 13:13:16.985929 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:16.927342 32534 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:16.934049 32548 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.999928 29469 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:17.004261 29463 raft_consensus.cc:2368] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 9.
I20260709 13:13:17.004675 29472 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:16.972816 32515 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:17.000768 32376 consensus_queue.cc:1059] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:13:17.013360 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83236.4us
I20260709 13:13:16.973224 32504 raft_consensus.cc:697] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:16.994388 32534 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:17.001962 32279 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.942135 32457 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:17.073115 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 87716.4us
I20260709 13:13:16.996811 32484 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:17.080739 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.081251 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 78656us
I20260709 13:13:17.011619 32502 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:17.089959 29468 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:17.019434 32565 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.021363 32534 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:16.993468 32564 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.100881 29509 leader_election.cc:400] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
W20260709 13:13:17.109724 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.024290 32242 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:13:17.116182 32242 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:17.116604 32242 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:17.117545 32242 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.119062 32504 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.089027 32484 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:17.121337 32484 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.124009 32571 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:13:17.128561 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 176477us
W20260709 13:13:17.131192 29363 leader_election.cc:336] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.792s (SENT)
W20260709 13:13:17.131603 30126 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.116s (SENT)
W20260709 13:13:17.134349 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.134922 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:17.135938 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 239557us
I20260709 13:13:17.094664 32370 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.149325 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.152882 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 132968us
W20260709 13:13:17.158178 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.141225 32299 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.171427 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.159322 32242 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:17.159111 32272 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.141093 32581 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:13:17.165114 32141 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 13:13:17.179422 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51519.9us
I20260709 13:13:17.180678 32590 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:17.192549 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 55276us
I20260709 13:13:17.105396 32565 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.184809 29509 leader_election.cc:400] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:17.195920 29509 leader_election.cc:403] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:17.184248 32272 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:17.200242 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 68686us
I20260709 13:13:17.147986 32370 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:17.210633 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.216900 32583 raft_consensus.cc:3055] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:17.217386 32583 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:17.218369 32583 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:17.223765 30126 leader_election.cc:336] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.140s (SENT)
W20260709 13:13:17.226877 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 64437.7us
I20260709 13:13:17.228000 29435 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:17.279680 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.199965 32272 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.219931 32583 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:17.296267 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72542us
I20260709 13:13:17.187676 32299 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.209873 32296 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
W20260709 13:13:17.299872 29363 leader_election.cc:336] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.836s (SENT)
I20260709 13:13:17.209252 32205 raft_consensus.cc:3055] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:17.230731 32373 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:17.338750 32296 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:17.339453 32296 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.342000 32296 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:17.333889 32205 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:17.343427 32205 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.324378 32382 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.344873 32205 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:17.345238 32382 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.324036 32502 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.336414 32599 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:13:17.347048 32502 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.315594 32170 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:13:17.349275 32484 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.351742 32484 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:17.359851 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.331282 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 103397us
I20260709 13:13:17.332257 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:17.374102 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 149088us
I20260709 13:13:17.377250 32515 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:17.378155 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 193509us
I20260709 13:13:17.371306 32457 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:17.388511 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:17.392053 32546 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:17.392648 32546 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:17.393102 32546 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:17.394632 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.397727 32299 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:17.400038 32530 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:17.405058 32272 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.405928 32564 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:17.407656 32502 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:17.410951 31952 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:17.412182 32370 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:17.413852 32548 raft_consensus.cc:3055] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:17.459730 29543 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:17.460119 32548 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:17.461180 32548 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.462289 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.414517 32598 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:17.416554 31961 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:17.462294 32548 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:17.419912 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:17.421015 32524 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:17.464874 32524 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.465335 32524 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.422657 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.423507 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.467518 29542 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:17.424443 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.468981 29538 raft_consensus.cc:2368] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:13:17.424070 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:17.424728 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.470876 29546 raft_consensus.cc:2410] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:17.424816 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.471681 32272 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:17.430903 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:17.433238 32233 consensus_meta.cc:287] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 13:13:17.433537 29290 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.423692 32592 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:13:17.473838 29290 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 4, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 4 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.434165 31642 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:17.434702 32600 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:13:17.424259 32580 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.424371 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.442108 32595 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.446940 32382 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:17.452443 32565 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:17.453215 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 170867us
I20260709 13:13:17.453734 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:17.463645 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.464102 31961 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:17.419492 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:17.425531 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:17.482331 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 62927.9us
I20260709 13:13:17.476573 32564 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.478533 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:17.480989 30151 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:17.486006 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.487664 30154 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:17.488117 29363 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.839s (SENT) [suppressed 44 similar messages]
I20260709 13:13:17.488348 29541 raft_consensus.cc:2368] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:17.483822 32595 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.491655 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:17.493191 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:17.493407 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72951.4us
I20260709 13:13:17.494799 29471 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:17.480278 32212 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:13:17.496181 29360 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:17.486215 32592 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:17.501624 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:17.502985 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.508929 29390 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:17.513851 29466 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:17.478571 31642 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.518407 29388 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:17.506597 32565 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:17.519412 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:17.518407 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:17.522498 29394 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.522504 29389 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:17.510984 29537 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:17.478986 32534 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.526751 32299 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:17.527664 32530 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:17.528267 32530 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.531267 30155 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:13:17.533423 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.485950 32598 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:13:17.547106 32530 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:17.547931 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.490170 32564 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.490113 32590 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:13:17.515303 32592 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.555796 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:17.557650 29390 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:17.558985 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.559785 29541 raft_consensus.cc:2368] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
I20260709 13:13:17.487943 32370 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:13:17.560238 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:17.579454 29470 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:17.581104 30160 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:17.561034 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.561772 30158 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:17.575582 30151 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:13:17.575361 29537 raft_consensus.cc:1240] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:13:17.533099 32565 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:17.596632 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 89391.6us
I20260709 13:13:17.596710 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:17.589470 29394 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:17.599428 29438 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:17.602391 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.611716 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.635257 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:17.665386 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.581840 32592 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:17.677776 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 78921.4us
I20260709 13:13:17.695533 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.696766 29537 raft_consensus.cc:2410] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:13:17.698046 30126 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:17.595889 32565 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:17.476399 29290 catalog_manager.cc:5697] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 5, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:17.597002 32228 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.690162 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 90343.2us
I20260709 13:13:17.595889 32204 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.705449 29543 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:17.706413 29537 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:17.702960 29512 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:17.690497 32530 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:17.705065 32382 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:13:17.708580 32204 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.786906 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:17.787699 29543 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:17.788386 32204 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:17.600764 32579 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:13:17.723322 29290 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 6, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 6 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.789847 32242 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:17.790228 32242 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:17.790453 29290 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 6, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 6 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.708962 32376 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:17.726632 32228 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.667703 31642 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:17.582687 31961 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:17.738063 30126 leader_election.cc:336] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.027s (SENT)
I20260709 13:13:17.872761 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:17.739610 32603 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:17.743964 32564 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:17.745613 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:17.897538 30151 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:17.747607 32565 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.697808 32299 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:13:17.755935 32595 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:17.760421 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.762950 32279 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:17.766957 32546 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.925403 32546 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:17.925794 32606 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 13:13:17.768422 32534 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:17.771677 32607 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 13:13:17.926796 32534 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:17.773453 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.927634 29470 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:17.773569 32513 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.775233 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.783589 29471 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:17.699796 32170 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.785627 32604 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:17.789196 32204 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:13:17.727069 32580 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:17.793464 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.793442 30160 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:17.795495 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:17.801409 29544 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:17.801003 29290 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 2 to 5, term changed from 3 to 4, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to <none>, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:17.802593 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:17.830722 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:17.855336 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 60804.5us
I20260709 13:13:17.862306 29543 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:17.776968 32530 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:17.791168 32242 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.884302 32603 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.953015 32604 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.953693 32603 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:17.953548 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:17.954322 29290 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.956004 32604 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:17.956852 29290 catalog_manager.cc:5697] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130), no longer has a pending config: VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130), VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131), VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:17.959102 29541 raft_consensus.cc:2368] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:17.960079 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.960752 29541 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:17.962570 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.963011 29538 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:17.963749 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:17.971680 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.982700 29546 raft_consensus.cc:1217] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 13:13:17.985042 29546 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 5. Ops: [3.2-3.2]
W20260709 13:13:17.990334 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.984397 29544 raft_consensus.cc:1217] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:13:17.991607 29544 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:13:17.991888 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 253908us
I20260709 13:13:17.998912 29546 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:18.006333 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.919975 32564 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:17.934195 31961 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:17.965935 32170 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.972790 32382 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.049561 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:18.025528 29544 raft_consensus.cc:1217] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Deduplicated request from leader. Original: 5.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:13:18.054275 29544 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:13:18.015565 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:17.846940 32524 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:18.061816 30123 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.805s (SENT)
I20260709 13:13:18.069998 29538 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:18.019548 30126 leader_election.cc:400] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 9.
I20260709 13:13:18.075754 29290 catalog_manager.cc:5697] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 4, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:17.988684 32592 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:18.047075 32170 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.043267 32564 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:17.989068 32513 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:17.953560 32530 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.095396 29540 raft_consensus.cc:2368] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:13:18.105844 29465 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:18.124997 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:18.057114 32228 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:18.118010 31952 raft_consensus.cc:476] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:13:18.099613 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:18.148346 29537 raft_consensus.cc:2410] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:18.071622 32382 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.139459 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:18.151270 29472 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:18.140249 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:18.153280 29468 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:18.135756 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.157150 32589 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:18.158138 32579 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.158849 32579 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:18.158881 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:18.161199 29546 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:18.165174 32592 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:18.139139 29463 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:18.147037 32612 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:18.138317 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:18.167277 32612 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.168069 29470 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:18.170311 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:18.094203 30126 leader_election.cc:403] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.170998 29537 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:18.178083 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:18.179214 29544 raft_consensus.cc:2368] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:13:18.153918 29290 catalog_manager.cc:5697] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:18.181581 29438 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:18.187551 29539 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:18.187649 32580 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.190366 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:18.157203 32382 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:18.199734 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 495766us
I20260709 13:13:18.198405 29468 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:18.199635 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.201243 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 186081us
W20260709 13:13:18.208738 30126 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.805s (SENT)
I20260709 13:13:18.209424 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:18.209539 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:18.197821 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:18.210410 29538 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:18.212373 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:18.212931 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:18.218920 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.219261 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:18.221931 29537 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:18.220924 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:18.223968 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:18.224599 29388 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:18.230310 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:18.227556 29360 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:18.204049 32376 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 9.
I20260709 13:13:18.176771 32592 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:13:18.243631 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:18.238039 29546 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:18.227969 32599 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:18.199604 32546 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:13:18.220500 32548 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:18.256290 29544 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:18.258996 29545 raft_consensus.cc:1240] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:18.240707 32565 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:18.256644 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:18.273974 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:18.229736 32581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.059s	sys 0.152s
I20260709 13:13:18.275388 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:18.204536 32580 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.263273 29290 catalog_manager.cc:5697] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.273000 32534 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:13:18.248353 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 286022us
I20260709 13:13:18.269055 29543 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:18.300007 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:18.312229 29392 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:18.314103 30160 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:18.272758 32279 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:13:18.240660 31952 consensus_queue.cc:1059] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:13:18.262538 32524 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:18.231384 32228 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:13:18.301232 32581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.059s	sys 0.152s
I20260709 13:13:18.255005 32599 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.331128 32228 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:18.352574 32228 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:18.353207 29290 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:18.355221 29290 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 4, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:18.357393 29290 catalog_manager.cc:5697] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 4, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:18.359522 29290 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 5, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 5 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:18.361441 32619 log.cc:927] Time spent T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:13:18.365200 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:18.362458 32513 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:18.362555 29392 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:18.366917 29290 catalog_manager.cc:5697] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 3, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:18.322507 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:18.346092 32599 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:18.345834 32603 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.464593 30151 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:13:18.429915 29361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.005s	sys 0.030s
W20260709 13:13:18.514933 29361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.033s
W20260709 13:13:18.399336 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.516628 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.517132 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.393555 29472 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
W20260709 13:13:18.469146 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.447161 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:18.370748 29290 catalog_manager.cc:5697] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
W20260709 13:13:18.533473 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 86471us
I20260709 13:13:18.534677 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:18.627091 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.644682 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 110134us
W20260709 13:13:18.378461 32622 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:18.709903 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:18.539567 32376 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:18.713955 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 183770us
I20260709 13:13:18.454586 30153 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:18.597779 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.532092 31642 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.717970 29290 catalog_manager.cc:5697] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 6, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 6 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.382500 32579 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:18.427569 32242 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:18.383247 31952 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:18.649048 32604 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.722713 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:18.513679 32534 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.381229 32564 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:18.376765 32612 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:18.380548 32580 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:18.382715 32628 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.636528 32548 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:18.384531 32382 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:18.792766 29438 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:18.823056 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.833709 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:18.835917 29389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.041s	sys 0.075s
I20260709 13:13:18.423795 32524 raft_consensus.cc:476] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:13:18.532764 32595 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:18.823709 32565 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:18.821986 29290 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 5, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:18.869124 31952 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:18.949064 29389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.044s	sys 0.076s
W20260709 13:13:18.941344 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 154254us
I20260709 13:13:18.870285 32610 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.964067 29472 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:18.963511 29290 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
W20260709 13:13:18.973357 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.941622 32279 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:19.011318 29360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.025s	sys 0.028s
W20260709 13:13:18.980039 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 94565.1us
I20260709 13:13:18.956873 32580 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:19.019685 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:18.944200 32630 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:18.798372 32376 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.877667 32604 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.976445 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:19.016415 29360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.025s	sys 0.029s
I20260709 13:13:18.940914 32382 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:18.940558 32548 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.006399 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:19.047500 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:18.879997 31642 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.943508 32628 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:18.959087 32595 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:19.030531 29468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.104s	sys 0.227s
W20260709 13:13:19.065898 29468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.104s	sys 0.227s
I20260709 13:13:19.065869 30158 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:18.951784 32373 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:19.034078 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.953299 32366 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:13:19.004719 32579 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:19.038511 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 810994us
I20260709 13:13:19.028702 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:19.031085 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:19.021288 32603 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:19.079553 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48627.9us
W20260709 13:13:19.070022 29512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.031s
W20260709 13:13:19.080806 29512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.007s	sys 0.031s
I20260709 13:13:19.031054 32631 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.035784 32581 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:19.088711 32618 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
W20260709 13:13:19.091377 32629 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:13:19.093232 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2216) took 1179 ms. Trace:
I20260709 13:13:19.093676 29541 rpcz_store.cc:276] 0709 13:13:17.913945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.983159 (+ 69214us) service_pool.cc:224] Handling call
0709 13:13:17.983560 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.984293 (+   733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.984322 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.985019 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.248074 (+263055us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:18.248117 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.248190 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.092917 (+844727us) raft_consensus.cc:1685] finished
0709 13:13:19.092949 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.093128 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":135,"thread_start_us":262608,"threads_started":1,"wal-append.queue_time_us":474840}
I20260709 13:13:19.044538 32580 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:19.049294 32548 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:19.022897 32279 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:19.070410 30126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.027s
W20260709 13:13:19.104300 30126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.011s	sys 0.027s
W20260709 13:13:19.104914 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 570346us
W20260709 13:13:19.081677 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.050366 32623 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:19.096174 32628 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:18.876784 32534 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:19.081758 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 540684us
I20260709 13:13:19.106501 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:19.146235 29470 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:19.074092 29394 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:19.005017 32610 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.099849 32212 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:19.098837 29435 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:19.151979 32604 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:19.153165 32642 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:19.154667 32641 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:19.084781 32373 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:19.135105 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.173882 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 281336us
I20260709 13:13:19.052788 32630 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.137782 32564 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:19.135758 32581 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:19.170249 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71493.3us
I20260709 13:13:19.086650 32579 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.171070 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:19.098479 32631 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.160336 32212 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:19.231030 32212 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:19.231417 32581 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.096647 31952 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.235489 31952 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.236959 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1989) took 1012 ms. Trace:
W20260709 13:13:19.237450 32640 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:19.179608 32370 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:19.220566 32564 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.208956 32643 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:19.237457 29468 rpcz_store.cc:276] 0709 13:13:18.224493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.226372 (+  1879us) service_pool.cc:224] Handling call
0709 13:13:18.226727 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.315289 (+ 88562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.315329 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.317564 (+  2235us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.066736 (+749172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:19.066782 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.066872 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.236616 (+169744us) raft_consensus.cc:1685] finished
0709 13:13:19.236645 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.236834 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88052,"raft.queue_time_us":97786,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":18971,"thread_start_us":661975,"threads_started":1,"wal-append.queue_time_us":816187}
I20260709 13:13:19.225046 29463 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:19.253229 32515 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:19.253890 32515 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:19.255004 32515 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.256161 32515 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:19.257191 32564 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:19.259101 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2213) took 1455 ms. Trace:
I20260709 13:13:19.259603 29539 rpcz_store.cc:276] 0709 13:13:17.804021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.999267 (+195246us) service_pool.cc:224] Handling call
0709 13:13:18.031623 (+ 32356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.194983 (+163360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.258719 (+1063736us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003a7d54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:19.259008 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316246912}
I20260709 13:13:19.266047 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2208) took 1465 ms. Trace:
I20260709 13:13:19.266630 29545 rpcz_store.cc:276] 0709 13:13:17.800705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.801762 (+  1057us) service_pool.cc:224] Handling call
0709 13:13:18.251680 (+449918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.259437 (+  7757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.265732 (+1006295us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400062050. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:19.265945 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033790848}
I20260709 13:13:19.284010 29394 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:19.285104 29542 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:19.138420 32623 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.178682 32641 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.215395 32628 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:19.360482 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 146270us
I20260709 13:13:19.362260 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:19.372567 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.374672 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 268258us
W20260709 13:13:19.378401 29509 connection.cc:256] RPC call timeout handler was delayed by -1.6888619060000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:13:19.383239 29509 connection.cc:256] RPC call timeout handler was delayed by -1.5907619059998979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:13:19.383643 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4494619059998968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 13:13:19.384001 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3261619059999248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:13:19.379756 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.374044 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 211663us
W20260709 13:13:19.391350 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.173465 32382 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.406335 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:19.287189 32370 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:19.398765 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 221127us
I20260709 13:13:19.427101 29463 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
W20260709 13:13:19.391687 31961 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.311s	user 0.016s	sys 0.001s
I20260709 13:13:19.446698 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 774) took 1213 ms. Trace:
I20260709 13:13:19.447944 29512 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:19.451614 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.173441 32642 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:19.456305 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.416914 32621 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:19.465710 29391 raft_consensus.cc:2410] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:19.451030 30155 rpcz_store.cc:276] 0709 13:13:18.232854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.233004 (+   150us) service_pool.cc:224] Handling call
0709 13:13:18.250035 (+ 17031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.250282 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:18.299321 (+ 49039us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.252475 (+953154us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b18002ed200. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e854123a 00007f61e89aba2a
0709 13:13:19.446264 (+193789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.446335 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:19.446385 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.446478 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.446611 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34255,"prepare.queue_time_us":49095,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2732,"spinlock_wait_cycles":11820416,"thread_start_us":159228,"threads_started":1}
I20260709 13:13:19.460305 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.467270 29394 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:19.461251 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 244859us
I20260709 13:13:19.469604 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:19.478948 30158 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:19.366640 32628 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.289294 32580 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.500861 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:19.505752 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.416600 32605 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:13:19.457468 32653 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.283703 32643 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.530381 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:19.531587 29468 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:19.491636 32632 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.423s	user 0.001s	sys 0.001s
I20260709 13:13:19.532541 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:19.519430 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 50686.1us
W20260709 13:13:19.515439 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 108463us
W20260709 13:13:19.534721 30126 leader_election.cc:336] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.215s (SENT)
W20260709 13:13:19.523051 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.474159 32382 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:19.537285 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.539472 32644 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 13:13:19.541350 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.542104 29363 connection.cc:256] RPC call timeout handler was delayed by -1.6523889669999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:13:19.542469 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2072) took 1303 ms. Trace:
I20260709 13:13:19.542719 31961 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.543306 31961 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.542866 29389 rpcz_store.cc:276] 0709 13:13:18.238857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.239029 (+   172us) service_pool.cc:224] Handling call
0709 13:13:18.257267 (+ 18238us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:18.960870 (+703603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.960910 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:18.973212 (+ 12302us) log.cc:844] Serialized 52 byte log entry
0709 13:13:19.289141 (+315929us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:19.289220 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.289327 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.542178 (+252851us) raft_consensus.cc:1685] finished
0709 13:13:19.542205 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.542361 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126209,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":59,"thread_start_us":956624,"threads_started":2,"wal-append.queue_time_us":345945}
I20260709 13:13:19.545863 31961 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:19.546777 32279 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:19.530056 32581 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:19.547623 32581 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.548029 32581 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:19.550905 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2079) took 1086 ms. Trace:
I20260709 13:13:19.551879 32279 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:19.552518 32279 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.551352 29392 rpcz_store.cc:276] 0709 13:13:18.464494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.609158 (+144664us) service_pool.cc:224] Handling call
0709 13:13:18.721146 (+111988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.802478 (+ 81332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.802520 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.803645 (+  1125us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.357610 (+553965us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:19.357677 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.357790 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.550668 (+192878us) raft_consensus.cc:1685] finished
0709 13:13:19.550695 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.550840 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1757,"raft.queue_time_us":70319,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":30769,"thread_start_us":404970,"threads_started":1,"wal-append.queue_time_us":599117}
I20260709 13:13:19.556155 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.556975 29392 raft_consensus.cc:2368] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
I20260709 13:13:19.558108 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.559043 29388 raft_consensus.cc:2393] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:19.563623 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.564570 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.584165 29394 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:19.567976 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.492312 32376 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:19.478291 32660 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:19.437418 32373 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.587111 29388 raft_consensus.cc:2410] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:13:19.542354 32626 log.cc:927] Time spent T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.671s	user 0.000s	sys 0.001s
W20260709 13:13:19.593955 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.623345 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.513710 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:19.621277 29463 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:19.622953 29509 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:19.622932 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:19.629354 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:19.630168 29388 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.566751 32610 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:19.638972 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.639948 29394 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
W20260709 13:13:19.643500 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 202329us
I20260709 13:13:19.653797 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:19.654702 29392 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.660315 29388 raft_consensus.cc:2410] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:19.663625 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:19.684471 29394 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.627223 32534 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:19.641494 32655 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.656392 31961 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.664330 32656 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:19.662901 32603 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:19.617002 32370 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.566887 32653 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.684098 32579 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:19.725785 29466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1988) took 1924 ms. Trace:
I20260709 13:13:19.725229 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:19.746742 29468 raft_consensus.cc:2393] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:19.756131 29392 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:13:19.762387 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.696077 32631 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:19.772014 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:19.766047 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:19.788101 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.691809 32621 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:19.706643 31642 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:19.805190 29388 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:19.811093 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:19.812474 30151 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:19.744818 29466 rpcz_store.cc:276] 0709 13:13:17.792848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.793013 (+   165us) service_pool.cc:224] Handling call
0709 13:13:17.860706 (+ 67693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.923895 (+ 63189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.923930 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.924462 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.264399 (+339937us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:18.264454 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.264527 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.541514 (+1276987us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:19.709823 (+168309us) raft_consensus.cc:1685] finished
0709 13:13:19.709851 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.717165 (+  7314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159024,"raft.queue_time_us":65145,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":51675,"spinlock_wait_cycles":47699200,"thread_start_us":339519,"threads_started":1,"wal-append.queue_time_us":606524}
I20260709 13:13:19.804203 29394 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:13:19.709347 32599 consensus_meta.cc:287] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.288s	user 0.018s	sys 0.000s
I20260709 13:13:19.823654 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:19.709146 32534 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:13:19.833273 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:19.843577 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:19.845832 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:19.850576 30154 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:19.768910 32579 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:19.835448 30158 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:19.850364 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:19.712109 31961 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.819730 31952 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:19.716596 32603 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:19.806180 32641 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:19.837162 32170 consensus_meta.cc:287] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.702s	user 0.015s	sys 0.002s
I20260709 13:13:19.708858 32655 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:19.831847 32660 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:19.874677 30156 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEARNER]: Advancing to term 7
I20260709 13:13:19.911170 32681 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.914990 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:19.914721 32681 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:19.914134 32676 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:13:19.895396 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 358466us
I20260709 13:13:19.896310 30151 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:13:19.930954 30151 pending_rounds.cc:85] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 5
I20260709 13:13:19.931289 30151 pending_rounds.cc:107] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:13:19.931694 30151 raft_consensus.cc:2889] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.932126 30151 pending_rounds.cc:107] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:13:19.932439 30151 raft_consensus.cc:2889] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.934578 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:19.895879 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 273056us
W20260709 13:13:19.902961 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.938488 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.875119 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:19.976918 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.847712 32628 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.002156 29394 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:13:19.873984 32664 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:13:20.019490 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 88211.7us
W20260709 13:13:20.022816 29542 consensus_meta.cc:287] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.733s	user 0.016s	sys 0.004s
I20260709 13:13:20.023365 29542 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:19.872825 30153 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:20.031970 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.032779 29394 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.837800 32599 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:20.019263 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:19.911011 32694 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.040526 30158 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:20.040781 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:20.035144 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:20.041682 30154 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:19.911473 32675 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:20.035637 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 98786.7us
I20260709 13:13:19.894675 32642 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:20.045073 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:20.050702 30155 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
W20260709 13:13:20.056579 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.867659 32579 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:20.055172 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:19.867063 32630 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.021705 32623 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:20.072449 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.072764 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:20.077520 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.083730 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:19.919325 32170 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.084514 29472 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:20.090765 29472 raft_consensus.cc:614] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:20.056160 32638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.004s	sys 0.010s
W20260709 13:13:20.084910 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.074515 32642 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:20.055779 32610 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:20.090094 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.142841 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.046558 32656 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:20.087949 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:20.101889 29394 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:20.146665 30156 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:20.147770 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:20.104720 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:20.105576 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:20.105487 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:20.107198 32689 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:20.107594 32678 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.187165 32656 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.187959 32678 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:20.135676 32242 consensus_meta.cc:287] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.240s	user 0.014s	sys 0.000s
I20260709 13:13:20.108429 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:20.108945 32684 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:13:20.109843 32677 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:13:20.129722 32605 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:20.154019 32581 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.001s
I20260709 13:13:20.117847 32681 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.126785 32660 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.058210 32675 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:20.129004 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:20.103386 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:20.132477 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2222) took 1130 ms. Trace:
I20260709 13:13:20.065106 32643 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:20.053135 32694 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:20.139508 30126 leader_election.cc:336] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.685s (SENT)
I20260709 13:13:20.225955 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:20.144544 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.148504 29394 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:20.149362 29468 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
W20260709 13:13:20.098042 32638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.005s	sys 0.011s
I20260709 13:13:20.183334 32654 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:20.192144 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 104293us
I20260709 13:13:20.110855 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:20.196791 29393 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:20.057185 32621 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.206226 32673 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:20.131462 32642 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.218425 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:20.208773 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2233) took 1176 ms. Trace:
W20260709 13:13:20.111145 32657 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:13:20.219590 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 2074) took 1961 ms. Trace:
I20260709 13:13:20.222257 29544 rpcz_store.cc:276] 0709 13:13:19.002584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.002724 (+   140us) service_pool.cc:224] Handling call
0709 13:13:19.023915 (+ 21191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.283505 (+259590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.283548 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.297946 (+ 14398us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.536591 (+238645us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:19.536633 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.536709 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.132230 (+595521us) raft_consensus.cc:1685] finished
0709 13:13:20.132253 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.132401 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128428,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":164,"thread_start_us":330190,"threads_started":2,"wal-append.queue_time_us":255617}
I20260709 13:13:20.150600 32610 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:20.161877 32382 consensus_meta.cc:287] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.614s	user 0.013s	sys 0.007s
I20260709 13:13:20.232211 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:20.233840 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 104950us
W20260709 13:13:20.373639 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.491199 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:20.503306 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.500363 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:20.503805 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.491472 30154 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
W20260709 13:13:20.491828 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 352338us
W20260709 13:13:20.506930 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.996s (SENT)
I20260709 13:13:20.311882 32653 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:20.226660 32605 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:20.508167 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:20.252723 31961 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.250373 32681 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:20.221047 32581 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.509375 32228 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:20.510025 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:20.233358 32683 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:13:20.231494 32242 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.536424 32242 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.511250 32656 raft_consensus.cc:2764] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:20.494587 32673 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:20.539109 32673 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:20.512756 32695 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:20.514801 32700 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:20.524247 32599 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.516322 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:20.516577 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:20.499369 29541 rpcz_store.cc:276] 0709 13:13:19.032153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.095366 (+ 63213us) service_pool.cc:224] Handling call
0709 13:13:19.095826 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.444264 (+348438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.445591 (+  1327us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.452256 (+  6665us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.660739 (+208483us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:19.660799 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.669469 (+  8670us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.208499 (+539030us) raft_consensus.cc:1685] finished
0709 13:13:20.208523 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.208697 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":260889,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187,"thread_start_us":517612,"threads_started":2,"wal-append.queue_time_us":371849}
I20260709 13:13:20.504419 29391 rpcz_store.cc:276] 0709 13:13:18.247054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.247202 (+   148us) service_pool.cc:224] Handling call
0709 13:13:20.207427 (+1960225us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000a69d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:20.208547 (+  1120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738214656}
I20260709 13:13:20.518028 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:20.522356 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 290211us
I20260709 13:13:20.520341 30154 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:20.365551 32643 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:20.556411 32678 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.558023 32565 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.558719 32565 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:20.559480 32603 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:20.486927 32212 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.255s	user 0.013s	sys 0.013s
I20260709 13:13:20.499003 32642 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:20.534750 32635 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:13:20.552778 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:20.712083 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 159374us
I20260709 13:13:20.559337 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:20.311203 32665 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 13:13:20.563077 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 56171.6us
I20260709 13:13:20.639588 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2234) took 1603 ms. Trace:
W20260709 13:13:20.560086 32616 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 2.363s	user 0.014s	sys 0.010s
W20260709 13:13:20.707235 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 190725us
I20260709 13:13:20.550933 32564 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:20.723093 29394 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:20.763509 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1874) took 1203 ms. Trace:
I20260709 13:13:20.727157 32697 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:20.729410 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1774) took 1133 ms. Trace:
I20260709 13:13:20.569100 32643 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:20.724035 30126 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.825s (SENT)
I20260709 13:13:20.786592 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:20.787084 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:20.787709 30156 raft_consensus.cc:2410] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:20.787992 32643 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:20.788183 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 64201.4us
I20260709 13:13:20.788713 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.789150 32643 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.718628 29540 rpcz_store.cc:276] 0709 13:13:19.035815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.098985 (+ 63170us) service_pool.cc:224] Handling call
0709 13:13:19.140428 (+ 41443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.156252 (+ 15824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.156301 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.162257 (+  5956us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.506997 (+344740us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:19.507063 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.507150 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.639260 (+1132110us) raft_consensus.cc:1685] finished
0709 13:13:20.639289 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.639481 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15303,"raft.queue_time_us":216636,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":336231,"threads_started":1,"wal-append.queue_time_us":582869}
I20260709 13:13:20.789659 32643 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.792484 32643 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.794714 32643 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.795385 32643 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.798185 32643 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.798478 32614 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:20.799172 32614 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.799705 32614 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:20.801879 32696 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:20.803318 32170 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.565819 32701 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.196s
I20260709 13:13:20.803797 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.639128 32370 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:20.782121 32694 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:20.722795 32515 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.466s	user 0.012s	sys 0.006s
I20260709 13:13:20.730285 31961 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:20.764050 29394 rpcz_store.cc:276] 0709 13:13:19.560402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.558982 (+998580us) service_pool.cc:224] Handling call
0709 13:13:20.763409 (+204427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.829914 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.830905 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 425) took 1149 ms. Trace:
I20260709 13:13:20.831296 29394 rpcz_store.cc:276] 0709 13:13:19.682042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.829588 (+1147546us) service_pool.cc:224] Handling call
0709 13:13:20.830834 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.832065 29388 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:20.789625 29391 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:20.832823 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 421) took 1230 ms. Trace:
I20260709 13:13:20.833240 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1878) took 1254 ms. Trace:
I20260709 13:13:20.818933 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:20.817054 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.833863 29391 rpcz_store.cc:276] 0709 13:13:19.578623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.719744 (+1141121us) service_pool.cc:224] Handling call
0709 13:13:20.833153 (+113409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.834302 29543 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:20.818310 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.720974 32700 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:20.785831 29470 rpcz_store.cc:276] 0709 13:13:19.596015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.596149 (+   134us) service_pool.cc:224] Handling call
0709 13:13:19.596531 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.616350 (+ 19819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.616390 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.627949 (+ 11559us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.815857 (+187908us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:19.815903 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.815982 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.729171 (+913189us) raft_consensus.cc:1685] finished
0709 13:13:20.729197 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.729338 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":19664,"thread_start_us":150221,"threads_started":1,"wal-append.queue_time_us":875079}
I20260709 13:13:20.838326 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:20.840225 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:20.835698 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:20.837612 29540 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:20.843116 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:20.845263 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:20.844671 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.853744 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:20.825915 32548 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.687s	user 0.010s	sys 0.007s
I20260709 13:13:20.854636 29543 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:20.677891 32212 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.855823 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.858349 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.858424 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.859090 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:20.866308 32675 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:20.866838 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.867811 29540 raft_consensus.cc:2410] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:20.868760 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:20.869797 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.865404 29545 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:20.862779 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 429) took 1018 ms. Trace:
I20260709 13:13:20.870767 29539 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:20.871628 29394 rpcz_store.cc:276] 0709 13:13:19.844652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.842852 (+998200us) service_pool.cc:224] Handling call
0709 13:13:20.862690 (+ 19838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.871752 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:20.872946 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:20.873725 29545 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:20.875137 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2064) took 3362 ms. Trace:
I20260709 13:13:20.875581 32564 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.825655 32370 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:20.876242 32564 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.875545 29396 rpcz_store.cc:276] 0709 13:13:17.512628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.512761 (+   133us) service_pool.cc:224] Handling call
0709 13:13:17.513139 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:17.533563 (+ 20424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.533599 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:17.556273 (+ 22674us) log.cc:844] Serialized 52 byte log entry
0709 13:13:17.783642 (+227369us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b48001c2858. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ed8caaa1 00007f61ed8c1b37 00007f61ed8c19ca 00007f61ed9b926f 00007f61ed9b8f37 00007f61ed9cd55c 00007f61ed9cd508 00007f61ed9cd488 00007f61ed9cd443 00007f61ed9cc6ec 00007f61ec8f6a96
0709 13:13:17.861874 (+ 78232us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:17.918355 (+ 56481us) log.cc:844] Serialized 14 byte log entry
0709 13:13:17.918686 (+   331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.918793 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.481577 (+2562784us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:20.874847 (+393270us) raft_consensus.cc:1685] finished
0709 13:13:20.874874 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.875037 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53496,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":257410,"raft.run_cpu_time_us":8059,"raft.run_wall_time_us":244146,"spinlock_wait_cycles":24630528,"thread_start_us":171686,"threads_started":1,"wal-append.queue_time_us":516306}
I20260709 13:13:20.878392 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.878880 32564 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.879190 29396 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:20.879674 32564 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.880345 29391 raft_consensus.cc:2368] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:20.880803 29540 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:20.861016 32242 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.879722 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 422) took 1263 ms. Trace:
I20260709 13:13:20.886150 32694 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.886198 29396 rpcz_store.cc:276] 0709 13:13:19.616576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.878132 (+1261556us) service_pool.cc:224] Handling call
0709 13:13:20.879662 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.887072 32694 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:20.887658 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.888414 29396 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.889578 32694 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.855320 32655 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.890559 32581 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.838068 31961 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.891450 31961 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:20.891894 32694 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:20.892494 32694 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:20.899293 29347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 50420.1us
I20260709 13:13:20.885509 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1875) took 1308 ms. Trace:
I20260709 13:13:20.900110 29391 rpcz_store.cc:276] 0709 13:13:19.577609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.834684 (+1257075us) service_pool.cc:224] Handling call
0709 13:13:20.885438 (+ 50754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.901522 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:20.902570 32694 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.903092 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.844372 32643 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.904455 32643 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.904909 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.880638 32564 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.785903 32697 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.878201 32610 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.911968 32697 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.913684 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:20.915769 29391 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:20.917212 29544 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:20.881887 29392 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:20.828516 32605 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:20.918305 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.919066 29544 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:20.929239 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.833201 29388 rpcz_store.cc:276] 0709 13:13:19.602815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.803468 (+1200653us) service_pool.cc:224] Handling call
0709 13:13:20.832754 (+ 29286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.930298 29543 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:20.864696 32548 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.916520 32595 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.920078 32643 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.936414 32548 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.914978 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.938172 32279 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:20.939459 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.941187 29540 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:20.923187 32212 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:20.896574 29363 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.541s (SENT)
I20260709 13:13:20.946605 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:20.946945 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.948169 29396 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:20.948271 29544 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:20.951530 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:20.952839 29388 raft_consensus.cc:2410] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:13:20.942194 32617 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 2.715s	user 0.007s	sys 0.009s
I20260709 13:13:20.955425 29396 raft_consensus.cc:1217] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:13:20.960584 29396 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:20.959606 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:20.963639 30126 leader_election.cc:336] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.410s (SENT)
I20260709 13:13:20.964341 29544 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:20.957394 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1891) took 1371 ms. Trace:
I20260709 13:13:20.965036 29388 rpcz_store.cc:276] 0709 13:13:19.586235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.951188 (+1364953us) service_pool.cc:224] Handling call
0709 13:13:20.957295 (+  6107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.966706 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:20.966989 29388 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:20.967955 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1883) took 1387 ms. Trace:
I20260709 13:13:20.970206 29388 rpcz_store.cc:276] 0709 13:13:19.580132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.966157 (+1386025us) service_pool.cc:224] Handling call
0709 13:13:20.966571 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.967644 (+  1073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.967885 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.944208 32564 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:20.973407 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1877) took 1395 ms. Trace:
I20260709 13:13:20.976155 29396 rpcz_store.cc:276] 0709 13:13:19.578306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.954317 (+1376011us) service_pool.cc:224] Handling call
0709 13:13:20.955263 (+   946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.963025 (+  7762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.973318 (+ 10293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.983476 29544 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:13:20.984776 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2058) took 3481 ms. Trace:
I20260709 13:13:20.963337 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:20.972586 29438 connection.cc:256] RPC call timeout handler was delayed by -1.4195242220000637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:13:20.976915 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80381.2us
I20260709 13:13:20.958861 32279 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:20.979707 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:20.992317 30156 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:20.979609 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:20.991338 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:20.993299 30160 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:20.993395 29470 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:20.994416 31642 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.995359 31642 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:20.973805 32546 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.002727 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.001004 29543 raft_consensus.cc:2410] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:21.006184 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.008631 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:21.009565 30151 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:20.986307 29397 rpcz_store.cc:276] 0709 13:13:17.502933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.503068 (+   135us) service_pool.cc:224] Handling call
0709 13:13:17.517412 (+ 14344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.547293 (+ 29881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.547329 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.547990 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.007343 (+459353us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.007391 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.007472 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.941306 (+2933834us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:20.980324 (+ 39018us) raft_consensus.cc:1685] finished
0709 13:13:20.980350 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.984671 (+  4321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13148,"raft.queue_time_us":22041,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":17297,"spinlock_wait_cycles":18463488,"thread_start_us":458892,"threads_started":1,"wal-append.queue_time_us":635773}
I20260709 13:13:21.014469 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.015901 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.017089 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.018198 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.019351 29468 raft_consensus.cc:2410] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:21.022779 29466 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:21.025211 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.032977 32565 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.033890 32603 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.034699 32681 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:21.035312 32681 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:21.037554 32681 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:20.999768 32212 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.041358 32212 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.014163 32546 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.042761 29464 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:21.044878 32546 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:21.045449 32212 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:21.002251 32700 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.046701 29471 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:21.047509 32700 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:21.050154 32700 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:21.008399 32666 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:13:21.050982 31642 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:21.029484 32673 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.055480 32673 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:21.055644 32688 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:21.056071 32688 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:21.034458 32603 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.056996 32688 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.058990 32603 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:21.060051 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4007744050002202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 13:13:21.060424 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3908744050002042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 13:13:21.060599 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2224) took 2057 ms. Trace:
W20260709 13:13:21.060724 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3314744050001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:13:21.061091 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3314744050001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:13:21.061445 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3260744050000994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:13:21.062083 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2873744050000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 13:13:21.062532 29509 connection.cc:256] RPC call timeout handler was delayed by -1.283774405000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:13:21.062915 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2459744050001973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:13:21.061610 32675 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:21.064004 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:21.063686 32675 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:21.067090 32675 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:21.068562 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.069752 32370 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:21.063328 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2270744050001667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 13:13:21.071424 29509 connection.cc:256] RPC call timeout handler was delayed by -1.1163744050002151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:13:21.071789 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0857744050001656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:13:21.072548 29509 connection.cc:256] RPC call timeout handler was delayed by -1.0443744050000987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:13:21.075865 29509 leader_election.cc:400] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5.
W20260709 13:13:21.078786 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.079587 29360 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:20.972549 29388 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:21.083200 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1884) took 1502 ms. Trace:
W20260709 13:13:21.088769 29392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 426) took 1387 ms (client timeout 1587 ms). Trace:
W20260709 13:13:21.141566 29392 rpcz_store.cc:269] 0709 13:13:19.705615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.823265 (+117650us) service_pool.cc:224] Handling call
0709 13:13:21.088495 (+1265230us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000a50d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:21.088669 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330350464}
I20260709 13:13:21.090343 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2084) took 2211 ms. Trace:
I20260709 13:13:21.142956 29390 rpcz_store.cc:276] 0709 13:13:18.878706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.282804 (+404098us) service_pool.cc:224] Handling call
0709 13:13:19.288476 (+  5672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.566078 (+277602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.566127 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.566190 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:19.566238 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.090056 (+1523818us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000e6ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:21.090112 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.090273 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637812480}
I20260709 13:13:21.144732 30156 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:21.145515 29390 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:13:21.096474 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.082566 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:21.147326 32564 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:21.147878 32564 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.148324 32564 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:21.146420 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1888) took 1564 ms. Trace:
W20260709 13:13:21.150696 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 68279.8us
W20260709 13:13:21.066859 32704 log.cc:927] Time spent T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
I20260709 13:13:21.158108 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:21.159085 30160 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:21.160563 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:21.161235 29542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2231) took 2051 ms (client timeout 1998 ms). Trace:
I20260709 13:13:21.161486 29468 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:21.163916 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 90371.6us
I20260709 13:13:21.167234 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2227) took 2136 ms. Trace:
I20260709 13:13:21.089933 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:21.167609 29467 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:21.161700 29542 rpcz_store.cc:269] 0709 13:13:19.024770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.028159 (+  3389us) service_pool.cc:224] Handling call
0709 13:13:21.075764 (+2047605us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540037afd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:21.075901 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543458048}
I20260709 13:13:21.171305 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.058370 32688 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:21.063294 32565 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:21.204511 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.154877 29388 rpcz_store.cc:276] 0709 13:13:19.580449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.971751 (+1391302us) service_pool.cc:224] Handling call
0709 13:13:20.972243 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.082736 (+110493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.083103 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:21.206537 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 424) took 1557 ms. Trace:
I20260709 13:13:21.206925 29388 rpcz_store.cc:276] 0709 13:13:19.648912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.205531 (+1556619us) service_pool.cc:224] Handling call
0709 13:13:21.205877 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.206109 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.206138 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:21.206189 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:21.206251 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.206310 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.206430 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:21.081439 29396 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:13:21.151274 29390 rpcz_store.cc:276] 0709 13:13:19.581607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.144582 (+1562975us) service_pool.cc:224] Handling call
0709 13:13:21.145163 (+   581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.146062 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.146345 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:21.061019 29546 rpcz_store.cc:276] 0709 13:13:19.003310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.003897 (+   587us) service_pool.cc:224] Handling call
0709 13:13:19.004219 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.004472 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:19.337712 (+333240us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.060084 (+1722372us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b18003cbf80. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61e8999060 00007f61e89ab716 00007f61e89bc287
0709 13:13:21.060198 (+   114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:21.060253 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:21.060307 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.060384 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.060514 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58726,"prepare.queue_time_us":354062,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":247701,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":15453,"spinlock_wait_cycles":89057664,"thread_start_us":725801,"threads_started":3,"wal-append.queue_time_us":216765,"wal-append.run_cpu_time_us":1068,"wal-append.run_wall_time_us":1002085}
I20260709 13:13:21.199345 29470 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:21.209828 29360 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:21.135959 32279 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:21.140020 32589 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:21.218055 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.221593 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:21.236426 29390 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:21.208783 29396 pending_rounds.cc:85] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 4
I20260709 13:13:21.237282 29396 pending_rounds.cc:107] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:21.237598 29396 raft_consensus.cc:2889] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.238368 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1885) took 1657 ms. Trace:
I20260709 13:13:21.239578 29396 rpcz_store.cc:276] 0709 13:13:19.580752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.980966 (+1400214us) service_pool.cc:224] Handling call
0709 13:13:20.981332 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.238110 (+256778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.238308 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:21.224001 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.243168 29472 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:21.168152 29537 rpcz_store.cc:276] 0709 13:13:19.006378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.006594 (+   216us) service_pool.cc:224] Handling call
0709 13:13:19.006997 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.239492 (+232495us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:19.498500 (+259008us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.810965 (+312465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.811029 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:19.811080 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.142184 (+1331104us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54000f3cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:21.142255 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.142508 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75248,"prepare.queue_time_us":119613,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":131765,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":25318,"spinlock_wait_cycles":540232192,"thread_start_us":446078,"threads_started":2,"wal-append.queue_time_us":735803}
W20260709 13:13:21.233868 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 244225us
I20260709 13:13:21.166608 32693 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.061391 31961 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:21.298528 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 61155.3us
I20260709 13:13:21.263514 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:21.301963 29390 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:21.305804 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.306475 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:21.306926 29363 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.703s (SENT)
I20260709 13:13:21.307075 29388 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:21.316161 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:21.357668 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:21.358839 30157 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 533) took 1591 ms (client timeout 1820 ms). Trace:
I20260709 13:13:21.359143 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:21.359380 30157 rpcz_store.cc:269] 0709 13:13:19.768306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.768493 (+   187us) service_pool.cc:224] Handling call
0709 13:13:21.357275 (+1588782us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:21.358743 (+  1468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30991744}
I20260709 13:13:21.361012 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.361119 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:21.160508 32580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.013s	sys 0.010s
I20260709 13:13:21.325485 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:21.310218 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:21.325768 29363 leader_election.cc:336] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.716s (SENT)
I20260709 13:13:21.303921 32693 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:21.324747 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 115001us
W20260709 13:13:21.357961 32663 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 1.205s	user 0.002s	sys 0.000s
I20260709 13:13:21.370069 30156 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:21.371297 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 428) took 1565 ms. Trace:
I20260709 13:13:21.371407 32693 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:21.353863 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:21.371714 29388 rpcz_store.cc:276] 0709 13:13:19.805557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.208026 (+1402469us) service_pool.cc:224] Handling call
0709 13:13:21.208402 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.309007 (+100605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.371028 (+ 62021us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54000a5ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:21.371225 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226431232}
I20260709 13:13:21.372164 32628 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:21.373050 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:21.387810 29388 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:21.362973 30152 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:21.392083 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:21.391968 32564 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.393180 30152 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:21.393875 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.394212 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:21.273949 29391 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:21.315487 29396 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:21.314174 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 143263us
I20260709 13:13:21.363047 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:21.364123 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 54008.8us
I20260709 13:13:21.340602 32687 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:13:21.366763 32548 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:21.324882 32565 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:21.367013 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:21.368641 32614 consensus_meta.cc:287] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.568s	user 0.014s	sys 0.000s
I20260709 13:13:21.338713 32673 consensus_queue.cc:1059] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:13:21.373176 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:21.374483 32636 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 2.290s	user 0.000s	sys 0.016s
I20260709 13:13:21.376152 32669 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:21.376849 30155 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:21.236791 32279 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:21.325621 31961 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:21.385425 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:21.386669 32642 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.008s
I20260709 13:13:21.336580 29394 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:21.365864 32580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.013s	sys 0.015s
I20260709 13:13:21.382975 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.340107 32579 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:21.263651 32589 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:21.395120 30152 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:21.354290 29468 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
W20260709 13:13:21.397192 30123 connection.cc:256] RPC call timeout handler was delayed by -1.4902543299999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3046s for a response
I20260709 13:13:21.412093 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:21.402921 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:21.417068 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 91331.2us
I20260709 13:13:21.412709 29465 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:21.435909 29363 leader_election.cc:336] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.772s (SENT)
W20260709 13:13:21.403317 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.437702 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.438154 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.397536 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:21.407099 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:21.417152 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 45351.5us
I20260709 13:13:21.412360 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:21.417444 29388 raft_consensus.cc:2410] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:21.482075 29391 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:21.407864 30159 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:21.490895 30123 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:21.514911 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2073) took 3275 ms. Trace:
I20260709 13:13:21.394428 32564 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:21.515592 29395 rpcz_store.cc:276] 0709 13:13:18.239348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.239505 (+   157us) service_pool.cc:224] Handling call
0709 13:13:18.256112 (+ 16607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.256442 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.256474 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.274232 (+ 17758us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.797940 (+523708us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:18.798005 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.798118 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.366721 (+2568603us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:21.489666 (+122945us) raft_consensus.cc:1685] finished
0709 13:13:21.489698 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.514776 (+ 25078us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127216,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":44802432,"thread_start_us":466319,"threads_started":1,"wal-append.queue_time_us":707339}
I20260709 13:13:21.411082 32279 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:21.397442 32690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.019s	sys 0.027s
I20260709 13:13:21.407651 32674 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.413961 32204 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:21.399139 32700 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.418923 32515 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:21.534926 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 122904us
W20260709 13:13:21.536274 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.410041 32565 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:21.405174 32548 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:21.404907 32675 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.407747 32681 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:21.540246 32690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.019s	sys 0.028s
I20260709 13:13:21.534041 32595 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:21.556411 32595 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.556864 32595 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:21.557305 32681 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:21.405155 32693 consensus_queue.cc:1059] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:13:21.558913 32693 raft_consensus.cc:3055] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:21.559288 32693 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:13:21.559847 32682 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 1.074s	user 0.005s	sys 0.000s
I20260709 13:13:21.525612 30156 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:21.560278 32693 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.555202 32675 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:21.561424 32693 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:21.562558 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:21.567032 30156 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:21.552547 32548 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:21.550060 32700 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:21.555451 32712 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:21.555171 32565 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.559732 32681 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:21.552644 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 116776us
W20260709 13:13:21.595044 29363 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.775s (SENT)
I20260709 13:13:21.410873 32669 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.546703 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:21.406927 32614 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.579595 32700 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:21.584393 32703 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.806s	user 0.003s	sys 0.013s
I20260709 13:13:21.414527 32642 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:21.545748 32662 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:21.533265 32621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.031s	sys 0.033s
W20260709 13:13:21.598379 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 289080us
I20260709 13:13:21.603490 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:21.563122 32675 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:21.541555 32674 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:21.606933 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:21.591444 32589 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:21.614589 29469 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:21.615643 29467 raft_consensus.cc:606] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:21.616109 29467 raft_consensus.cc:614] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:21.600977 32621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.031s	sys 0.034s
I20260709 13:13:21.627642 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:21.695801 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 68256.2us
W20260709 13:13:21.711561 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 116570us
I20260709 13:13:21.716432 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:21.611651 32700 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:21.721036 29471 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:21.724031 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:21.725564 29463 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:21.731386 30156 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:21.732971 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:21.735525 29363 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.821s (SENT)
I20260709 13:13:21.636286 32515 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:21.699712 32646 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:21.752465 32646 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.753098 32646 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.752640 29363 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:21.821251 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.716917 32666 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:21.854050 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:21.857736 30156 raft_consensus.cc:2410] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:13:21.858637 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 443546us
I20260709 13:13:21.743386 32564 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:21.743012 32660 consensus_queue.cc:1059] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:13:21.863288 32515 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:21.756031 32580 consensus_queue.cc:1059] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
W20260709 13:13:21.883669 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 148204us
I20260709 13:13:21.861785 32696 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:21.888579 29363 leader_election.cc:336] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.839s (SENT)
I20260709 13:13:21.891916 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:21.883620 32564 raft_consensus.cc:697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:21.911080 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:21.933951 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:21.954774 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:21.971572 29541 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:21.971635 29545 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:21.942355 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:21.943131 29546 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:21.911684 29363 leader_election.cc:336] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.845s (SENT)
I20260709 13:13:21.975199 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:21.974725 29542 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:21.954644 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:21.981529 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:21.982191 29543 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:21.971979 29537 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.905189 32660 raft_consensus.cc:3055] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:21.909832 32717 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.362s	user 0.001s	sys 0.001s
W20260709 13:13:21.990967 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 79321.4us
W20260709 13:13:21.991237 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 593759us
W20260709 13:13:21.994012 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 224761us
I20260709 13:13:21.995004 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:21.996492 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.913060 32635 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:21.996593 29363 leader_election.cc:336] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.857s (SENT)
I20260709 13:13:22.005961 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:22.009157 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.013104 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:21.988646 32515 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:21.907049 32696 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:22.021777 29363 leader_election.cc:336] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.913s (SENT)
I20260709 13:13:22.022338 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:22.024160 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:22.005224 32723 log.cc:927] Time spent T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:13:21.995543 32669 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:22.032042 29539 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:21.993336 32660 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:22.048300 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:22.060813 32715 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 13:13:22.061681 32714 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:13:22.063123 29363 leader_election.cc:336] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.931s (SENT)
W20260709 13:13:22.063489 29394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1881) took 2484 ms (client timeout 2935 ms). Trace:
I20260709 13:13:22.066105 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 1999) took 2257 ms. Trace:
W20260709 13:13:22.067232 32728 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:13:22.069003 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.070271 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 391) took 1080 ms. Trace:
I20260709 13:13:22.082151 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.070854 32515 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:22.021662 32729 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:22.008112 32604 raft_consensus.cc:3055] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:22.019852 32722 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:13:22.011142 32614 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:22.089100 29393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 2077) took 3834 ms (client timeout 2196 ms). Trace:
I20260709 13:13:22.080427 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:22.147933 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.081177 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 423) took 2459 ms. Trace:
I20260709 13:13:22.093475 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:22.158702 29397 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:22.050737 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.111127 29539 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:22.157819 29392 rpcz_store.cc:276] 0709 13:13:19.621611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.147656 (+1526045us) service_pool.cc:224] Handling call
0709 13:13:21.148098 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.149359 (+  1261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.149406 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.150162 (+   756us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.420081 (+269919us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:21.420124 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.420191 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.080876 (+660685us) raft_consensus.cc:1685] finished
0709 13:13:22.080910 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.081094 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"thread_start_us":267766,"threads_started":1,"wal-append.queue_time_us":459671}
I20260709 13:13:22.087893 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2100) took 1361 ms. Trace:
I20260709 13:13:22.088688 30151 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:22.097051 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.163301 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.163758 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 669) took 1084 ms. Trace:
I20260709 13:13:22.164276 29392 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:22.156492 29393 rpcz_store.cc:269] 0709 13:13:18.254280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.364845 (+110565us) service_pool.cc:224] Handling call
0709 13:13:22.088902 (+3724057us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400172ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:22.089025 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4210585344}
I20260709 13:13:22.165833 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:22.140148 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.163260 29388 rpcz_store.cc:276] 0709 13:13:20.726693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.443325 (+716632us) service_pool.cc:224] Handling call
0709 13:13:21.443710 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.443973 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:21.870161 (+426188us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.085913 (+215752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.085966 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:22.086018 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.086088 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.087800 (+  1712us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9242,"prepare.queue_time_us":605440,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"thread_start_us":560923,"threads_started":2}
W20260709 13:13:22.169562 29394 rpcz_store.cc:269] 0709 13:13:19.579537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.872684 (+1293147us) service_pool.cc:224] Handling call
0709 13:13:22.063277 (+1190593us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001c5cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:22.063413 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064647424}
I20260709 13:13:22.172150 29394 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:22.089632 29469 rpcz_store.cc:276] 0709 13:13:20.990192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.990427 (+   235us) service_pool.cc:224] Handling call
0709 13:13:20.998819 (+  8392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.615417 (+616598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.069970 (+454553us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54001e4e54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:22.070200 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415242496}
I20260709 13:13:22.177066 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:22.164181 30151 rpcz_store.cc:276] 0709 13:13:21.079009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.079209 (+   200us) service_pool.cc:224] Handling call
0709 13:13:22.048073 (+968864us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b58000b3498. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:13:22.163679 (+115606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78258048}
I20260709 13:13:22.184710 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.190129 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:22.191190 29465 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:22.074316 32595 consensus_meta.cc:287] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 13:13:22.114282 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2087) took 2669 ms. Trace:
I20260709 13:13:22.197365 29389 rpcz_store.cc:276] 0709 13:13:19.445120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.544922 (+ 99802us) service_pool.cc:224] Handling call
0709 13:13:19.545318 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.545666 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.545695 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.546221 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.368998 (+1822777us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b1800373540. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:13:21.648971 (+279973us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:21.649041 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.649158 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.113892 (+464734us) raft_consensus.cc:1685] finished
0709 13:13:22.113917 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.114185 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":767,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14213,"spinlock_wait_cycles":35292928,"thread_start_us":279533,"threads_started":1,"wal-append.queue_time_us":2335923}
I20260709 13:13:22.168591 29463 rpcz_store.cc:276] 0709 13:13:19.808504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.808888 (+   384us) service_pool.cc:224] Handling call
0709 13:13:19.845346 (+ 36458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.726147 (+1880801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.065795 (+339648us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54003b5954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:22.066028 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4323446528}
I20260709 13:13:22.191960 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.023589 32731 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:22.194625 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 143993us
W20260709 13:13:22.116158 32548 consensus_meta.cc:287] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.007s
I20260709 13:13:22.203702 29438 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:22.205030 29438 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.206378 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.210526 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:22.211051 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 147952us
W20260709 13:13:22.211865 29363 leader_election.cc:336] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.012s (SENT)
I20260709 13:13:22.212307 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:22.078833 32735 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:22.215072 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:22.091933 32675 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:22.060883 32696 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:22.155699 32666 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:22.220103 29394 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:22.077659 32642 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:22.223869 29393 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:22.237768 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 156443us
I20260709 13:13:22.219069 29469 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:22.225461 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.185540 32604 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:22.173503 32729 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:22.247825 32729 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.248811 32642 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:22.217988 32651 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:22.238257 32515 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:22.252614 32515 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:22.253778 32713 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.642s	user 0.000s	sys 0.003s
I20260709 13:13:22.253250 32666 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.254740 32651 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:22.247116 32696 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:22.210696 32595 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.220284 32546 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:22.264797 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 663) took 2202 ms. Trace:
I20260709 13:13:22.265362 30155 rpcz_store.cc:276] 0709 13:13:20.055575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.067740 (+ 12165us) service_pool.cc:224] Handling call
0709 13:13:20.088154 (+ 20414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.409194 (+1321040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.257491 (+848297us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400680bd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:22.257747 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2963071232}
W20260709 13:13:22.267925 32565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.004s	sys 0.014s
W20260709 13:13:22.269788 32565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.004s	sys 0.014s
I20260709 13:13:22.049240 32564 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.223167 32675 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:22.307096 29541 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:22.275605 29389 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:22.275769 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2102) took 1195 ms. Trace:
I20260709 13:13:22.219633 32589 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:13:22.219201 32366 consensus_queue.cc:1059] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:13:22.148948 32660 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.218554 32548 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.264303 32546 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.273175 32530 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:22.260516 32696 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:22.340931 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2096) took 1615 ms. Trace:
W20260709 13:13:22.355443 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.341604 29391 rpcz_store.cc:276] 0709 13:13:21.080490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.483534 (+403044us) service_pool.cc:224] Handling call
0709 13:13:21.529436 (+ 45902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.529805 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:21.884682 (+354877us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.275108 (+390426us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.275304 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.275359 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:22.275425 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.275522 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.275689 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":546607,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":3299,"raft.queue_time_us":207,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6709,"thread_start_us":723782,"threads_started":2}
I20260709 13:13:22.279958 32605 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:22.354259 29396 rpcz_store.cc:276] 0709 13:13:20.725585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.404548 (+678963us) service_pool.cc:224] Handling call
0709 13:13:21.544864 (+140316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.545125 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:21.891054 (+345929us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.340461 (+449407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.340530 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:22.340586 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.340685 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.340851 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19691,"prepare.queue_time_us":531738,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":43643,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":360,"thread_start_us":718708,"threads_started":2}
W20260709 13:13:22.349722 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.365200 29389 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:13:22.352118 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 147171us
I20260709 13:13:22.353497 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2103) took 1195 ms. Trace:
I20260709 13:13:22.347337 32675 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:22.366917 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.354971 32696 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:22.355866 32546 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:22.366556 29395 rpcz_store.cc:276] 0709 13:13:21.158103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.533150 (+375047us) service_pool.cc:224] Handling call
0709 13:13:21.538519 (+  5369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.538775 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:21.885751 (+346976us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.204399 (+318648us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.352884 (+148485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.352993 (+   109us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:22.353063 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.353203 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.353405 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13791,"prepare.queue_time_us":546271,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":99000,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"thread_start_us":791427,"threads_started":3,"wal-append.queue_time_us":360840}
I20260709 13:13:22.410791 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 790) took 1100 ms. Trace:
W20260709 13:13:22.384948 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 165053us
W20260709 13:13:22.383302 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 171445us
I20260709 13:13:22.417585 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:22.418684 29363 leader_election.cc:336] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.027s (SENT)
I20260709 13:13:22.419080 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:22.371387 32660 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:22.427011 29363 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.069s (SENT)
I20260709 13:13:22.417102 30152 rpcz_store.cc:276] 0709 13:13:21.310924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.855764 (+544840us) service_pool.cc:224] Handling call
0709 13:13:21.856182 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.856469 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:22.218744 (+362275us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.410325 (+191581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.410396 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:22.410476 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.410559 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.410715 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":949,"prepare.queue_time_us":136181,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":4270,"thread_start_us":506122,"threads_started":2}
I20260709 13:13:22.386636 32366 raft_consensus.cc:2764] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:13:22.375465 32735 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:22.432581 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 231188us
I20260709 13:13:22.438709 29509 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:22.440474 29363 leader_election.cc:336] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.107s (SENT)
I20260709 13:13:22.441102 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:22.442598 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.443312 32565 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:22.443887 32747 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:13:22.443967 32565 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:22.449131 32744 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:13:22.450906 32565 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:22.451493 32752 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.459167 32687 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:22.459637 32687 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:22.460011 32687 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:22.430657 32589 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:13:22.445382 32739 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 13:13:22.464758 32548 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:22.362461 32651 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.420518 32605 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:13:22.431583 32694 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:22.448025 29537 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:22.485965 29397 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:22.479028 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 61575.6us
I20260709 13:13:22.493839 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:22.498905 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 58455.5us
W20260709 13:13:22.501448 29363 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.111s (SENT)
W20260709 13:13:22.503145 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 88998.2us
I20260709 13:13:22.507019 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:22.503048 32646 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.746s	user 0.014s	sys 0.002s
I20260709 13:13:22.498839 32595 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:22.505614 32548 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.514394 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:22.519613 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.505838 32366 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:22.532842 29464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39036 (request call id 395) took 1533 ms (client timeout 1842 ms). Trace:
W20260709 13:13:22.533417 29464 rpcz_store.cc:269] 0709 13:13:20.996944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.997097 (+   153us) service_pool.cc:224] Handling call
0709 13:13:22.528167 (+1531070us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54003b6354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:22.530250 (+  2083us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57129856}
W20260709 13:13:22.537766 32279 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.996s	user 0.012s	sys 0.004s
I20260709 13:13:22.529589 32694 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:22.542603 29363 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.115s (SENT)
I20260709 13:13:22.532900 32548 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.543994 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:22.549057 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:22.552700 32719 log.cc:927] Time spent T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.941s	user 0.004s	sys 0.000s
I20260709 13:13:22.554109 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 429) took 1652 ms. Trace:
W20260709 13:13:22.555065 32759 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:22.554543 29540 rpcz_store.cc:276] 0709 13:13:20.901569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.967844 (+ 66275us) service_pool.cc:224] Handling call
0709 13:13:20.982693 (+ 14849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.002483 (+ 19790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.002548 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.003288 (+   740us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.414685 (+411397us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:21.761273 (+346588us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.761584 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.761696 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.551968 (+790272us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:22.553753 (+  1785us) raft_consensus.cc:1685] finished
0709 13:13:22.553879 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.554035 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20165,"prepare.queue_time_us":516905,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":1432,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":16606,"spinlock_wait_cycles":36110592,"thread_start_us":673810,"threads_started":2,"wal-append.queue_time_us":533119}
I20260709 13:13:22.557333 32694 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:22.558060 29538 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:22.558822 32603 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.534627 32366 raft_consensus.cc:697] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:22.559396 32603 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.560527 32366 consensus_queue.cc:237] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:22.531335 32735 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:22.564507 30126 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.842s (SENT) [suppressed 37 similar messages]
I20260709 13:13:22.567157   300 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:22.567549 32725 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.613s	user 0.000s	sys 0.002s
I20260709 13:13:22.567718   300 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:22.568161   300 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:22.538297 32279 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.570163 32674 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:22.571259 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 788) took 1332 ms. Trace:
I20260709 13:13:22.575273 29388 raft_consensus.cc:2410] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:13:22.577519 29363 leader_election.cc:336] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.174s (SENT)
I20260709 13:13:22.578130 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:22.571719 30160 rpcz_store.cc:276] 0709 13:13:21.238722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.238930 (+   208us) service_pool.cc:224] Handling call
0709 13:13:21.317340 (+ 78410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:21.317940 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.317983 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:21.318863 (+   880us) log.cc:844] Serialized 52 byte log entry
0709 13:13:21.745635 (+426772us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:21.745680 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.747952 (+  2272us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.566803 (+818851us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:22.570897 (+  4094us) raft_consensus.cc:1685] finished
0709 13:13:22.570921 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.571181 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":12625664,"thread_start_us":426281,"threads_started":1,"wal-append.queue_time_us":566227}
I20260709 13:13:22.566099 32548 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:22.587872 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.590312 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.591223 29464 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:22.587531 32515 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:22.594414 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.594493   303 consensus_queue.cc:1059] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:13:22.529829 32646 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.607278 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.615605 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.623245 30156 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:22.623034 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.625173 29397 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:22.605958 32515 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.627720 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:22.630527 29391 raft_consensus.cc:2376] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7. Re-sending same reply.
I20260709 13:13:22.548417 32764 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:13:22.634747 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.635634 29395 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:22.635885 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:22.648151 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.634654 32515 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:22.609933   304 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:13:22.813463 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.814622 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.822499 29395 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:22.814988 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:22.817819 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 134092us
W20260709 13:13:22.819603 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.827500 29391 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:22.838752 29397 raft_consensus.cc:2376] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6. Re-sending same reply.
W20260709 13:13:22.840147 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 237449us
I20260709 13:13:22.843449 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:22.844336 29395 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:22.821527 32729 consensus_meta.cc:287] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.012s
W20260709 13:13:22.826927   311 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.122s	user 0.000s	sys 0.005s
I20260709 13:13:22.851826 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:22.828639 32693 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.257s	user 0.025s	sys 0.001s
W20260709 13:13:22.850991 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.826848 32564 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:22.830611 32675 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:22.832792 32755 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.234s	user 0.000s	sys 0.005s
W20260709 13:13:22.860791 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.858218 32646 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:22.848202 32279 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:22.863137 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:22.858778 32515 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:22.859001 32589 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:13:22.867633   300 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:22.874467 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.862823 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:22.883580 29395 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:22.885066 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.887106 29395 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:22.860244 32729 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:22.904762 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.905143 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:22.891043 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.905963 29472 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:22.906133 29469 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:22.896556 32687 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:22.903208 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:22.909265 30123 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:22.911875 30123 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:22.890992 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.906180 29391 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:22.899612   307 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:13:22.913597 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.914579 29391 raft_consensus.cc:2410] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:22.915431 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.916019 29391 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:22.916831 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.917841 32548 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.918671 29395 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:22.919603 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.896461 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 673) took 1448 ms. Trace:
W20260709 13:13:22.919797 29363 connection.cc:256] RPC call timeout handler was delayed by -1.0793558980001308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
I20260709 13:13:22.920552 30156 rpcz_store.cc:276] 0709 13:13:21.448126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.887479 (+439353us) service_pool.cc:224] Handling call
0709 13:13:21.889139 (+  1660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.623921 (+734782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.896169 (+272248us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54006ea354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:22.896387 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687250816}
W20260709 13:13:22.921149 29363 connection.cc:256] RPC call timeout handler was delayed by -1.044255898000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:13:22.925992 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 76754.7us
I20260709 13:13:22.907936 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.928282 29397 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:22.929001 29393 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:22.929559 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.931625 30123 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:22.932780 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:22.933807 29395 raft_consensus.cc:2393] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:22.937510 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:22.936715 32693 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.938957 32692 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:22.939420 32692 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.938691   304 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:22.939862 32692 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:22.940213 32729 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:22.939152 32693 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:22.943112 32546 consensus_meta.cc:287] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.523s	user 0.014s	sys 0.000s
I20260709 13:13:22.943674 32546 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:22.944664 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.945544 32693 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:22.946269   313 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:22.946923 32589 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:22.946934   313 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:22.948293   313 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.948909   300 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:22.927143 32696 consensus_meta.cc:287] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.006s
I20260709 13:13:22.949905 32696 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.952116 32696 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:22.953233 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:22.954880 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:22.956926 32763 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:22.957182 32764 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:22.957341 32763 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:22.957826 32763 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.959709 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2094) took 2234 ms. Trace:
I20260709 13:13:22.960100 29390 rpcz_store.cc:276] 0709 13:13:20.724966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.958740 (+2233774us) service_pool.cc:224] Handling call
0709 13:13:22.959105 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.959321 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.959348 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.959393 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:22.959426 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.959483 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.959639 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.963426 30156 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:22.967744 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:22.968164 32687 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:22.968875 32720 log.cc:927] Time spent T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 1.247s	user 0.004s	sys 0.000s
I20260709 13:13:22.969069 29463 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:22.971554 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 543) took 1983 ms. Trace:
I20260709 13:13:22.971663 32675 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:22.971969 30158 rpcz_store.cc:276] 0709 13:13:20.987806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.987938 (+   132us) service_pool.cc:224] Handling call
0709 13:13:20.988286 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.989847 (+  1561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.989877 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.990405 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.408345 (+417940us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:21.408387 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.408464 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.968016 (+1559552us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:22.971202 (+  3186us) raft_consensus.cc:1685] finished
0709 13:13:22.971228 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.971477 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1847,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":10075,"spinlock_wait_cycles":12159360,"thread_start_us":373386,"threads_started":1,"wal-append.queue_time_us":585661}
W20260709 13:13:22.974669 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 536086us
I20260709 13:13:22.975641 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:22.976966 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:22.977988 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.979012 32765 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:22.979352 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.979666 32765 raft_consensus.cc:697] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:22.980485   302 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:22.981315   302 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:22.980780 32765 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:22.982482 32595 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:22.957823 32764 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:22.984308 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:22.984683 32764 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.986795 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:22.988867 29471 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:22.990551 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 405) took 1358 ms. Trace:
I20260709 13:13:22.993330 32731 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.993965 32731 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:22.995868 29470 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:22.996414 32731 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:22.995904 29360 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.983529 32603 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:22.997964 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:22.998804 30156 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:22.999549 32564 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:22.999810 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 667) took 1921 ms. Trace:
I20260709 13:13:23.000006 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:23.000320 32564 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:23.001361   301 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:23.002097 32279 raft_consensus.cc:3055] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:23.002554 32279 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:23.003137 32660 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:23.003631 32279 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:23.005155 32279 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.006173 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.972743 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:22.978271 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:22.991007 29471 rpcz_store.cc:276] 0709 13:13:21.631934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.855180 (+223246us) service_pool.cc:224] Handling call
0709 13:13:21.855683 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.989421 (+1133738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.990226 (+   805us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540032c3d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:22.990473 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605096832}
I20260709 13:13:23.010787 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:23.011602 29392 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:23.012571 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:23.016808 29395 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:23.018528 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:23.019274 29395 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:23.016356 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:23.023586 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:23.024328 29388 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:23.024799 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:23.025627 29391 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:23.031195 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58539.4us
I20260709 13:13:23.032153 30123 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:23.028975 32515 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:23.036188 29397 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:23.047111 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:23.047951 30126 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.200s (SENT)
I20260709 13:13:23.048583 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:23.038024 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:23.052901 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 182984us
I20260709 13:13:22.946208 32546 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:23.053118 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:23.063661 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:23.053222 29388 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
W20260709 13:13:23.059422 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 81265.8us
I20260709 13:13:23.066154 29509 leader_election.cc:400] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:23.066576 29509 leader_election.cc:403] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:23.051108 32666 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:23.082963 32666 raft_consensus.cc:697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:23.084161 32666 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:23.046327 32693 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:23.086669 29541 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:23.088932 29391 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:23.098517 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:23.060770 32673 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:13:23.096004 29540 raft_consensus.cc:1240] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:23.060998 32605 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:23.113667 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2252) took 1162 ms. Trace:
I20260709 13:13:23.074066 32660 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:23.121793 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:23.122507 29463 raft_consensus.cc:606] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:23.122737 30158 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:23.124125 29360 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:23.116336 32603 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:23.130986 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:23.113150 32655 raft_consensus.cc:3055] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:23.140354 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:23.141698 29542 raft_consensus.cc:2376] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8. Re-sending same reply.
I20260709 13:13:23.116081 29546 rpcz_store.cc:276] 0709 13:13:21.951225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.974309 (+ 23084us) service_pool.cc:224] Handling call
0709 13:13:22.004453 (+ 30144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.057594 (+ 53141us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:22.114997 (+ 57403us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.340461 (+225464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.340530 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:22.340595 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.967544 (+626949us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18003ffb80. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61ec87558f 00007f61e58b4571 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd
0709 13:13:23.113395 (+145851us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b54003a7854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:23.113452 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.113584 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27647,"prepare.queue_time_us":59066,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":50007,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":29138,"spinlock_wait_cycles":130081536,"thread_start_us":210525,"threads_started":1,"wal-append.queue_time_us":307715}
I20260709 13:13:23.142822 29395 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:23.118510 32212 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:23.146844 29544 pending_rounds.cc:85] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 7
I20260709 13:13:23.151024 29544 pending_rounds.cc:107] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:13:23.151376 29544 raft_consensus.cc:2889] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.160167 30158 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:23.147284 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:23.148101 29540 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:23.120908 32688 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:23.138332 32635 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:23.180955 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:23.182605 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:23.146296 32655 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:23.176697 32651 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.151691 32212 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:23.126617 32731 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:13:23.132867 32758 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:13:23.338984 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 156506us
I20260709 13:13:23.385722 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a320582e5c548dd888eb981df817079"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:23.386665 29472 raft_consensus.cc:606] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:23.305850 32733 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.193255 32696 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:23.145449 32763 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:23.341862 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 149348us
I20260709 13:13:23.180138 32564 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 13:13:23.305560 32707 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:23.145978 32681 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:23.391144 32735 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:23.336843 32635 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:23.404078 32735 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:23.404853 32692 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:23.403759 32681 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:23.406170 32681 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.404721 32635 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:23.374783 32729 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:23.429710 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.349758 32170 consensus_queue.cc:1059] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:13:23.449738 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54987.7us
I20260709 13:13:23.453953 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:23.423668 32735 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:23.460218   303 consensus_queue.cc:1059] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:23.460067 32692 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:23.423418 32729 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:23.426582 32693 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:13:23.492503 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 444537us
I20260709 13:13:23.406867 32212 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:23.478946 32729 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:23.488751 32548 consensus_meta.cc:287] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.003s
I20260709 13:13:23.000334 30153 rpcz_store.cc:276] 0709 13:13:21.078253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.093242 (+ 14989us) service_pool.cc:224] Handling call
0709 13:13:21.218781 (+125539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.299500 (+ 80719us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:21.746313 (+446813us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.999127 (+1252814us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b18000c01c0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e854123a
0709 13:13:22.999367 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.999429 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:22.999485 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.999576 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.999736 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":628170,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4771,"raft.queue_time_us":5993,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":18480896,"thread_start_us":627676,"threads_started":2,"wal-append.queue_time_us":455554}
I20260709 13:13:23.614864 32548 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:23.691242   322 log.cc:927] Time spent T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:13:23.692483 32699 raft_consensus.cc:3055] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:23.693096 32699 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:23.695166   325 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:13:23.447666 32655 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:23.699076 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:23.686599 32725 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:13:23.700254 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:23.700911 29509 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48426 dropped due to backpressure: service queue is full with 50 items
I20260709 13:13:23.743516 29543 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:23.761483 32655 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:23.734880   301 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.683840 32595 consensus_meta.cc:287] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.701s	user 0.014s	sys 0.000s
I20260709 13:13:23.743290 32212 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.736291 32758 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:23.793774 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:23.797788 29543 raft_consensus.cc:2410] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:23.694198 32699 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:23.802790 32765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.012s	sys 0.060s
I20260709 13:13:23.796942 32595 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.805485 32763 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:23.725896 32693 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:23.851807 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.822337 32765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.012s	sys 0.061s
I20260709 13:13:23.833057 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:23.838083 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:23.841866   334 log.cc:927] Time spent T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:13:23.861755 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:23.793617   301 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:23.844362   327 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:13:23.847041 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2230) took 4805 ms. Trace:
I20260709 13:13:23.857016 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:23.850587 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:23.850885 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.853997 30155 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:23.865332 30158 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 5: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:23.805922 32758 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:23.864184 29538 rpcz_store.cc:276] 0709 13:13:19.022094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.047916 (+ 25822us) service_pool.cc:224] Handling call
0709 13:13:19.048332 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.558459 (+3510127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.826939 (+1268480us) spinlock_profiling.cc:243] Waited 3.51 s on lock 0x7b54001b8354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:23.827208 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8070632192}
I20260709 13:13:23.780849 32604 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:23.762588 29509 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48426 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2287)
W20260709 13:13:23.905061 29389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.003s	sys 0.010s
W20260709 13:13:23.905638 29389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.004s	sys 0.010s
I20260709 13:13:23.855643 32733 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:23.864686 32735 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:13:23.903775 32604 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.925239 30156 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:23.884423 32765 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:13:23.933907 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 439655us
W20260709 13:13:23.941809 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.956054 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.971694 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:23.929314 32603 consensus_meta.cc:287] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.788s	user 0.013s	sys 0.002s
I20260709 13:13:23.982257 29471 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:23.994644 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 1.07189e+06us
I20260709 13:13:23.970170 32595 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.984030 32548 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:24.023445 30156 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:23.981850 32603 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:24.028930 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2016) took 1452 ms. Trace:
W20260709 13:13:24.032466 29392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.004s	sys 0.012s
I20260709 13:13:24.029582 29468 rpcz_store.cc:276] 0709 13:13:22.576520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.576712 (+   192us) service_pool.cc:224] Handling call
0709 13:13:22.586061 (+  9349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.586300 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:22.815254 (+228954us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.026160 (+1210906us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b180034f0c0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e854123a
0709 13:13:24.028550 (+  2390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.028615 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:24.028664 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.028737 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.028860 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15131,"prepare.queue_time_us":240680,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":9386880,"thread_start_us":270499,"threads_started":2,"wal-append.queue_time_us":93017,"wal-append.run_cpu_time_us":1299,"wal-append.run_wall_time_us":1015826}
I20260709 13:13:23.982867 29509 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48426 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2287)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2288)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2289)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2290)
W20260709 13:13:24.032917 29392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.004s	sys 0.012s
I20260709 13:13:24.041761 29509 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:48432 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2287)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2288)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2289)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2290)
I20260709 13:13:24.046732 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:24.024724 32548 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:24.059096   345 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:13:24.059583   338 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:13:24.060730   332 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.026679 32595 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:24.028724 32646 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:13:24.067646 32548 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:24.032893 32605 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:13:24.046840   303 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:13:24.112994 29396 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:24.071177   341 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:13:24.094321   301 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:24.103557 29509 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48426 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2287)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2288)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2289)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2290)
I20260709 13:13:24.125689 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.127182 29542 raft_consensus.cc:2368] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7.
W20260709 13:13:24.127475   319 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.784s	user 0.003s	sys 0.003s
I20260709 13:13:24.128311 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.129120 29542 raft_consensus.cc:2376] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7. Re-sending same reply.
I20260709 13:13:24.133522 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.107458   332 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:24.136185   332 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:24.137914 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.138837 29544 raft_consensus.cc:2376] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6. Re-sending same reply.
I20260709 13:13:24.140043 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.141083 29544 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:24.142935 29537 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:24.145848 32675 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:24.146309 32675 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:24.147830 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.147336 32675 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:13:24.148540 32279 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.143s	user 0.012s	sys 0.006s
I20260709 13:13:24.149129 32675 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:24.149191 32279 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.154524 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 801) took 1139 ms. Trace:
I20260709 13:13:24.154939 30155 rpcz_store.cc:276] 0709 13:13:23.015110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.015539 (+   429us) service_pool.cc:224] Handling call
0709 13:13:23.052638 (+ 37099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.865477 (+812839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.154220 (+288743us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54007a0154. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:24.154422 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842288000}
I20260709 13:13:24.145239 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.156911 29537 raft_consensus.cc:2368] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:24.142004 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.158821 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.130329 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.161319 29542 raft_consensus.cc:2410] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:13:24.107430 32758 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:24.178083 29395 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:13:24.178831 29395 pending_rounds.cc:85] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 7
I20260709 13:13:24.178537 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.179144 29395 pending_rounds.cc:107] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:13:24.179486 29395 raft_consensus.cc:2889] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:24.149927 32279 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:24.178112 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.187232 29542 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:24.188717 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.170083 29391 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:24.189826 29542 raft_consensus.cc:2410] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:24.191347 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.192313 29395 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:24.192966 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.192889 29544 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:24.195283 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.196362 29544 raft_consensus.cc:2368] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:13:24.196544 29396 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:13:24.197726 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:24.199196 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.200011 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.233449 29537 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:24.202050   346 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:13:24.205350 32699 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.206326 32766 raft_consensus.cc:3055] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:24.207540 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.211350 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:24.212446 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.217374 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.243768 29542 raft_consensus.cc:2410] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:13:24.241583 29545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.010s	sys 0.027s
I20260709 13:13:24.237293 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:24.245448 29545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.011s	sys 0.027s
I20260709 13:13:24.231175 29544 raft_consensus.cc:2376] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5. Re-sending same reply.
I20260709 13:13:24.242049 29543 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:24.250684 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.242149 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:24.253968 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:24.255162 29435 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:24.260720 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.262786 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.264756 29538 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:24.266089 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.266948 29538 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:24.268098 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.268821 29538 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 1.
I20260709 13:13:24.269954 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2267) took 1196 ms. Trace:
I20260709 13:13:24.269933 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:24.272928 29394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.017s	sys 0.013s
W20260709 13:13:24.274123 29394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.017s	sys 0.013s
I20260709 13:13:24.276108 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.278165 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.276964 29542 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:24.281257 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:24.283406 30155 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:24.283649 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.287403 29544 raft_consensus.cc:2368] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5.
I20260709 13:13:24.241729 32766 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:24.287549 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:24.307093 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2129) took 1293 ms. Trace:
I20260709 13:13:24.288606 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:24.307487 29392 rpcz_store.cc:276] 0709 13:13:23.013856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.029994 (+ 16138us) service_pool.cc:224] Handling call
0709 13:13:23.030268 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.030485 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:23.452401 (+421916us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.306661 (+854260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.306726 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:24.306779 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.306860 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.307012 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":210360,"prepare.run_cpu_time_us":8464,"prepare.run_wall_time_us":27167,"spinlock_wait_cycles":9526016,"thread_start_us":1242773,"threads_started":3,"wal-append.queue_time_us":679327}
I20260709 13:13:24.296531 29395 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:24.297760 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:24.316206 29388 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:24.286919 32614 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:24.333940 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:24.270684 29545 rpcz_store.cc:276] 0709 13:13:23.073170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.073308 (+   138us) service_pool.cc:224] Handling call
0709 13:13:23.101062 (+ 27754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.101298 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:23.517640 (+416342us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.269534 (+751894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.269605 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:24.269668 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.269758 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.269885 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14265,"prepare.queue_time_us":669196,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":24007,"thread_start_us":1088779,"threads_started":2}
W20260709 13:13:24.304920 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.287111 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2125) took 1274 ms. Trace:
I20260709 13:13:24.336637 29389 rpcz_store.cc:276] 0709 13:13:23.012567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.013336 (+   769us) service_pool.cc:224] Handling call
0709 13:13:23.044611 (+ 31275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.044909 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:23.916982 (+872073us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.286545 (+369563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.286615 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:24.286680 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.286764 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.287029 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18329,"prepare.queue_time_us":322831,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"thread_start_us":1222516,"threads_started":2}
I20260709 13:13:24.338142 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:24.302264 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 271451us
I20260709 13:13:24.339290 29544 raft_consensus.cc:2368] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:13:24.309162 30123 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:24.309387 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.274992 32204 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:24.288990 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.269997 32707 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:24.335035 29396 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
W20260709 13:13:24.343516 30126 leader_election.cc:336] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.630s (SENT)
I20260709 13:13:24.343899 29538 raft_consensus.cc:2410] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:24.346247 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:24.347529 30126 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.664s (SENT)
I20260709 13:13:24.348145 29542 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:24.349941 29363 leader_election.cc:336] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.689s (SENT)
I20260709 13:13:24.350395 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:24.350757 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.351495 29542 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:24.348896 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:24.354387 30126 leader_election.cc:336] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.727s (SENT)
I20260709 13:13:24.354902 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:24.355402 29388 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
W20260709 13:13:24.359094 29363 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.257s (SENT)
I20260709 13:13:24.359392 29540 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:24.359715 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:24.360423 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.361310 29540 raft_consensus.cc:2410] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:24.362262 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:24.362816 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.342598 32614 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:24.363492 29542 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:24.364430 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.364351 32614 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:24.365777 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.353063 32666 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:24.367156 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:24.347918 32643 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:24.368198 32643 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.369948 32564 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:24.376505 32595 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:24.376636 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.378132 32279 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:24.378892 32279 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:24.384022 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.386204 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:24.387178 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.386981 32766 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:24.387985 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1784) took 1003 ms. Trace:
I20260709 13:13:24.388355 29539 rpcz_store.cc:276] 0709 13:13:23.385201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.386827 (+1001626us) service_pool.cc:224] Handling call
0709 13:13:24.387919 (+  1092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.388453 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.389550 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.389770 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.389777 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:24.393054 30158 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:24.394759 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:24.395649 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:24.396076 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.364508 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.397302 29542 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:24.397332 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.398960 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2276) took 1243 ms. Trace:
I20260709 13:13:24.399930 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:24.401319 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 67452.5us
W20260709 13:13:24.367189   354 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:24.366365 29538 raft_consensus.cc:2376] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9. Re-sending same reply.
W20260709 13:13:24.405174 32681 consensus_meta.cc:287] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.998s	user 0.008s	sys 0.011s
I20260709 13:13:24.405622 32681 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:24.406591 32204 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:24.406678 32595 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:24.406860 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 52514.4us
I20260709 13:13:24.407724 32735 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:24.405970 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2278) took 1231 ms. Trace:
I20260709 13:13:24.408331 32735 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:24.407778 32204 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:24.408507 29538 rpcz_store.cc:276] 0709 13:13:23.174948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.405054 (+1230106us) service_pool.cc:224] Handling call
0709 13:13:24.405365 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.405571 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.405597 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.405640 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:24.405680 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.405742 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.405903 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.409736 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2271) took 1270 ms. Trace:
I20260709 13:13:24.410307 29539 raft_consensus.cc:2368] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 3. Current term is 4.
I20260709 13:13:24.410857 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2283) took 1014 ms. Trace:
I20260709 13:13:24.410145 29541 rpcz_store.cc:276] 0709 13:13:23.139491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.139677 (+   186us) service_pool.cc:224] Handling call
0709 13:13:23.156588 (+ 16911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.156951 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.156982 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.843390 (+686408us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18003ffa00. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e729aa11 00007f61e72aa372 00007f61e89dca01 00007f61e89a143a
0709 13:13:23.844165 (+   775us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b2c000d87c8. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e729aa11 00007f61e72aa372 00007f61e89dca01 00007f61e89a143a 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2
0709 13:13:23.844844 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 13:13:24.070395 (+225551us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:24.070491 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.070605 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.409462 (+338857us) raft_consensus.cc:1685] finished
0709 13:13:24.409508 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.409667 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10728,"raft.queue_time_us":483,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11020,"spinlock_wait_cycles":41320960,"thread_start_us":225119,"threads_started":1,"wal-append.queue_time_us":556412}
I20260709 13:13:24.399372 29542 rpcz_store.cc:276] 0709 13:13:23.155885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.398036 (+1242151us) service_pool.cc:224] Handling call
0709 13:13:24.398340 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.398605 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.398635 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.398687 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:24.398726 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.398783 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.398890 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:24.407670 30126 leader_election.cc:336] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 3.046s (SENT)
I20260709 13:13:24.421165 30126 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:24.411250 29538 rpcz_store.cc:276] 0709 13:13:23.396660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.409803 (+1013143us) service_pool.cc:224] Handling call
0709 13:13:24.410144 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.410349 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.410380 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.410587 (+   207us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:24.410626 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.410684 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.410796 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.423518 29538 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:24.429433 29538 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:24.457855 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.459290 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51651.5us
I20260709 13:13:24.468225 29539 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:24.466912 32707 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:24.471822 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:24.472384 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2277) took 1315 ms. Trace:
I20260709 13:13:24.472798 29545 rpcz_store.cc:276] 0709 13:13:23.157331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.398424 (+1241093us) service_pool.cc:224] Handling call
0709 13:13:24.471861 (+ 73437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.472075 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.472100 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.472143 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:24.472178 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.472228 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.472325 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.475145 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2285) took 1005 ms. Trace:
I20260709 13:13:24.475646 29541 rpcz_store.cc:276] 0709 13:13:23.469638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.413281 (+943643us) service_pool.cc:224] Handling call
0709 13:13:24.474298 (+ 61017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.474697 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.474741 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.474799 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:24.474848 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.474929 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.475083 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.478643 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:24.479534 29546 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:24.472853 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 70199.2us
I20260709 13:13:24.484526 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1813) took 1055 ms. Trace:
I20260709 13:13:24.484997 29542 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:24.484921 29546 rpcz_store.cc:276] 0709 13:13:23.428971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.456779 (+1027808us) service_pool.cc:224] Handling call
0709 13:13:24.484453 (+ 27674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.486006 32681 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:24.462368 32766 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:24.495464 32707 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:24.496289 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:24.409358 32735 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:24.497778 32735 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:24.472739 32595 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:24.550391 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 58351.3us
I20260709 13:13:24.481849 32604 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:24.552181 32733 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.547323 32546 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:13:24.553181   304 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:13:24.559044   348 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:13:24.572687 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:24.615216 29390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.019s	sys 0.033s
W20260709 13:13:24.749395 29390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.027s	sys 0.037s
I20260709 13:13:24.749357 31642 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:24.646924 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.705803 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:24.706046 30126 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.833s (SENT)
I20260709 13:13:24.751902 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:24.638188 29393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.019s
W20260709 13:13:24.694607 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.744342 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 386827us
W20260709 13:13:24.568270 32212 consensus_meta.cc:287] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.020s
W20260709 13:13:24.755360 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49358.8us
I20260709 13:13:24.761199 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2133) took 1745 ms. Trace:
I20260709 13:13:24.752300 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1800) took 1360 ms. Trace:
W20260709 13:13:24.753087 29393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.015s	sys 0.026s
I20260709 13:13:24.751024 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2126) took 1738 ms. Trace:
I20260709 13:13:24.766088 29390 rpcz_store.cc:276] 0709 13:13:23.012943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.014541 (+  1598us) service_pool.cc:224] Handling call
0709 13:13:23.014872 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.015077 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:23.494850 (+479773us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.750050 (+1255200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.750136 (+    86us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:24.750208 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.750313 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.750929 (+   616us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159504,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":338807,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7610,"thread_start_us":1630054,"threads_started":3,"wal-append.queue_time_us":619894}
I20260709 13:13:24.758756 31642 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:24.762246 29543 rpcz_store.cc:276] 0709 13:13:23.391514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.705344 (+1313830us) service_pool.cc:224] Handling call
0709 13:13:24.752198 (+ 46854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.754933 32693 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:24.570307 32729 consensus_meta.cc:287] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.957s	user 0.015s	sys 0.002s
W20260709 13:13:24.686867   361 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:13:24.662112   356 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.530s	user 0.000s	sys 0.005s
W20260709 13:13:24.749243 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 176648us
I20260709 13:13:24.580535   368 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:24.780642   347 raft_consensus.cc:993] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:24.786079 29465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:13:24.621794   313 raft_consensus.cc:3055] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:24.801242 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.804124 29509 connection.cc:256] RPC call timeout handler was delayed by -1.9709146129998771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:13:24.765103   369 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:24.733695 32681 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:24.685561 32564 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:24.758951 32735 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:24.815835 30126 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.955s (SENT)
I20260709 13:13:24.817257 29465 raft_consensus.cc:606] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:13:24.907740 29465 raft_consensus.cc:614] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:24.761801 29394 rpcz_store.cc:276] 0709 13:13:23.015578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.114575 (+ 98997us) service_pool.cc:224] Handling call
0709 13:13:23.115014 (+   439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:23.116778 (+  1764us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:23.520777 (+403999us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.279832 (+759055us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:24.288204 (+  8372us) log.cc:844] Serialized 52 byte log entry
0709 13:13:24.289349 (+  1145us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:24.293766 (+  4417us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.760667 (+466901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.760808 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.760862 (+    54us) raft_consensus.cc:1685] finished
0709 13:13:24.760876 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.761097 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26422,"prepare.queue_time_us":313933,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":109,"raft.queue_time_us":172227,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":4794,"thread_start_us":1443391,"threads_started":3,"wal-append.queue_time_us":900413}
W20260709 13:13:24.819875 29509 connection.cc:256] RPC call timeout handler was delayed by -1.7936146129998178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:13:24.908226 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 92438.3us
W20260709 13:13:24.908598 29509 connection.cc:256] RPC call timeout handler was delayed by -1.7936146129998178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:13:24.909070 29509 connection.cc:256] RPC call timeout handler was delayed by -1.6109146129997498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:13:24.909155 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.988s (SENT)
I20260709 13:13:24.909886 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:24.569902 32604 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:24.821391 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 462314us
I20260709 13:13:24.764195 32731 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:24.846822 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.792265 32758 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:24.594192 32548 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:24.812007 31642 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:24.909413 29509 connection.cc:256] RPC call timeout handler was delayed by -1.5956146129997251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260709 13:13:24.968518 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4921146129997851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
I20260709 13:13:24.969679 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:24.765152 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2136) took 1743 ms. Trace:
W20260709 13:13:24.916213 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.917061 29363 leader_election.cc:336] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.270s (SENT)
I20260709 13:13:24.971930 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:24.935446 29468 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:24.820977 32669 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:24.956602 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.764098 32733 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:24.991863 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 248038us
I20260709 13:13:24.803267 32729 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:24.971033 29393 rpcz_store.cc:276] 0709 13:13:23.022087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.430237 (+408150us) service_pool.cc:224] Handling call
0709 13:13:23.447116 (+ 16879us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:23.473418 (+ 26302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.473606 (+   188us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:23.510778 (+ 37172us) log.cc:844] Serialized 52 byte log entry
0709 13:13:24.103163 (+592385us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:24.118793 (+ 15630us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.764759 (+645966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.764866 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.764916 (+    50us) raft_consensus.cc:1685] finished
0709 13:13:24.764933 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.765081 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10988,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":258976,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":15105,"thread_start_us":1047442,"threads_started":2,"wal-append.queue_time_us":641525}
I20260709 13:13:24.858803 32370 raft_consensus.cc:1081] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:24.819505   313 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:24.813428 32603 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.003400 29438 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:25.007985 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 90967.8us
W20260709 13:13:25.008762 29363 leader_election.cc:336] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.355s (SENT)
I20260709 13:13:25.009187 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:24.925724   347 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:24.991598   331 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:13:24.924701 32693 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:24.997006 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:25.000504 32635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.012s	sys 0.013s
I20260709 13:13:25.032583 29540 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:25.055298 32766 consensus_meta.cc:287] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.564s	user 0.013s	sys 0.002s
W20260709 13:13:25.055935   377 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:13:25.056803 32766 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:25.057263 32766 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.057606 32766 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:25.060411 32621 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:25.061048 32621 raft_consensus.cc:697] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:24.909163 32681 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:25.012781 32675 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.863s	user 0.013s	sys 0.006s
I20260709 13:13:24.820261   368 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.013001   372 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.927058 32735 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:24.922374 32564 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:25.054286 32635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.013s	sys 0.013s
I20260709 13:13:25.092155 32635 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.967298 32731 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.093339 32564 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:24.922681   369 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:24.989885 32758 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.004753 32603 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.002394 32669 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.026069   347 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:25.113430 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 143824us
W20260709 13:13:25.094980   301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.042s	sys 0.094s
I20260709 13:13:25.062142 32621 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:25.119481   375 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:13:25.125686 29537 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:25.119817 32735 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:25.126937   301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.042s	sys 0.094s
I20260709 13:13:25.149597 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:25.106979   313 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:25.160653 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.178264 30157 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:25.153192 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:25.169467 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:25.141223 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2281) took 1796 ms. Trace:
I20260709 13:13:25.183563 29544 rpcz_store.cc:276] 0709 13:13:23.344723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.407944 (+1063221us) service_pool.cc:224] Handling call
0709 13:13:24.408243 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.408472 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:24.409088 (+   616us) log.cc:844] Serialized 14 byte log entry
0709 13:13:25.140726 (+731638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.140796 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:25.140891 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.140995 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.141141 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":163,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":192700,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":731121,"threads_started":2,"wal-append.queue_time_us":653826}
I20260709 13:13:25.182698 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:25.193017 29509 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:25.153434 32366 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.155241 32604 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.185505 32735 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.190728 32733 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.155548 32675 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:13:25.217626   395 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:25.218161 32758 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:25.210307   392 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:13:25.196265 32548 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:25.216300 32707 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:25.227116   380 log.cc:927] Time spent T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:13:25.228005   381 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:13:25.229378 32669 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.234026   379 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.234740   379 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:25.239638 29537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2280) took 1904 ms (client timeout 2094 ms). Trace:
W20260709 13:13:25.240116 29537 rpcz_store.cc:269] 0709 13:13:23.335370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.241483 (+906113us) service_pool.cc:224] Handling call
0709 13:13:25.239427 (+997944us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400061154. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:25.239565 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861814528}
I20260709 13:13:25.241724 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:25.242515 30157 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:25.244597 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:25.245541   366 consensus_queue.cc:1059] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:25.246996 32564 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:25.247418 32564 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.247786 32564 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:25.248346 32681 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.238073   379 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.251304 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 1824) took 1321 ms. Trace:
I20260709 13:13:25.251449 29538 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:25.251746 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.251744 29540 rpcz_store.cc:276] 0709 13:13:23.930481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.376270 (+445789us) service_pool.cc:224] Handling call
0709 13:13:25.251053 (+874783us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b540036c254. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:25.251232 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506091904}
W20260709 13:13:25.258575   386 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:25.209110 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:25.208561 32366 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.263106 32366 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.215204 32604 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:25.264791 32604 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:25.265342 32604 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.266814 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.267107 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:25.268209 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.269632 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.269943   300 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.270488 29472 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:25.268244 32603 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:25.275120   347 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.209458 32729 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:25.276304   368 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.276937   300 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.277439 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.279327   300 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.283397 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:25.293159 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 284403us
W20260709 13:13:25.293964 29363 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.365s (SENT)
I20260709 13:13:25.294428 29363 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:25.252902 32731 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:25.350267 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.351248 32604 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:25.354837 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 344035us
I20260709 13:13:25.356353   369 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:25.359661 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.344609   404 log.cc:927] Time spent T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:13:25.367192 32564 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.373643 32548 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.372005   341 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.417093   341 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.428417   341 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.439934   376 raft_consensus.cc:3055] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:25.509152   409 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.510838   409 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.408926 32766 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:25.492393 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.476291 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 294360us
I20260709 13:13:25.532656 32564 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:25.498880 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 188461us
I20260709 13:13:25.534881   409 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.534829   366 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.536303   366 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:25.483202 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 126731us
W20260709 13:13:25.480636 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 287466us
I20260709 13:13:25.410924 32548 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.541887   369 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.542044   368 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.543641   369 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:25.544979   368 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:25.382865 32614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.005s	sys 0.017s
I20260709 13:13:25.548225   341 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.547833   408 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:25.550696   368 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.551591 32548 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:25.554792   406 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:25.505079   301 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:25.559368   369 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:25.563938 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1584441700001662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 13:13:25.563853   341 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:25.570117 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1044441700003063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:13:25.570693 29363 connection.cc:256] RPC call timeout handler was delayed by -1.072189101000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2795s for a response
W20260709 13:13:25.571161 29363 connection.cc:256] RPC call timeout handler was delayed by -1.01098910099995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2863s for a response
I20260709 13:13:25.571990 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.572263 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:25.442075   376 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:25.576252   376 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.581933 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:25.583150 30153 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:25.586767 32614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.005s	sys 0.017s
I20260709 13:13:25.591019 29463 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:13:25.592092   409 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.593282   409 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.598292 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2030) took 1197 ms. Trace:
I20260709 13:13:25.603181   367 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.602291 29463 rpcz_store.cc:276] 0709 13:13:24.399396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.405910 (+  6514us) service_pool.cc:224] Handling call
0709 13:13:24.406274 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:25.591745 (+1185471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.594111 (+  2366us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400214654. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:25.596370 (+  2259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2722369920}
I20260709 13:13:25.604276   367 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.606209   402 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.606312   301 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.606806   368 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.607403   402 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.607825   368 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.608362 29545 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:25.604754   341 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:25.607546   301 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.595510 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:25.599010 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 65969.8us
I20260709 13:13:25.616770 29546 raft_consensus.cc:2410] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:13:25.614913 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.627221 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.655977 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.610363   402 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.610167   367 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.619012   313 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.612409   366 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.621637   369 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:25.668010 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 57133.4us
I20260709 13:13:25.619122 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.620224 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.622367 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.610244   368 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.666078 29291 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 6, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.617717 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.626936 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.618396 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.675875 29393 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 3.
I20260709 13:13:25.683331 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:25.683983 29538 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:25.684638 30151 raft_consensus.cc:2410] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:25.617017 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.616070 32766 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.698694 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:25.705137 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:25.707262 29396 raft_consensus.cc:2410] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:25.705291   396 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:25.712222 29391 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:25.712786 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.709872 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.713758 29540 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:25.714237 29394 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:25.716148 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.718642   366 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.723685 29392 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.706804   369 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.727162 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:25.730846 29390 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:25.732558 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:25.734568 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 64357.6us
I20260709 13:13:25.737323 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:25.739020 29538 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:25.738032 29394 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.727924   366 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.743832 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:25.745716   376 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:25.749002 29397 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:25.750079 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.755142 29546 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:25.757539 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:25.758934   409 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.770167   301 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.770388   341 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.777272 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.770653 32681 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.779902   341 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.780508 32681 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:25.781021 32548 raft_consensus.cc:670] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 13:13:25.779335 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.787993 29390 raft_consensus.cc:2393] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:25.791471 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:25.795526 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.798993 29540 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:25.800938   418 log.cc:927] Time spent T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:13:25.807539 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.799642 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.814483 32548 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.808813   341 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.822126 32548 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.812203 29291 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 3 to 5, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 5 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:25.824376   420 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 13:13:25.835103 29545 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:25.836373 29542 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:25.840952 29390 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:25.847013 32681 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:25.849646 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.851150 29468 raft_consensus.cc:2410] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:25.857439 32614 consensus_queue.cc:1059] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:25.858669   369 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.864691 29397 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:25.867269 29390 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:13:25.830895 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:25.831447   419 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:13:25.833863 32548 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.868907 29546 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:25.833021 29291 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 5, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 5 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.871471 29291 catalog_manager.cc:5697] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:25.873123 32204 consensus_queue.cc:1059] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:25.874096 29291 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 6, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 6 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:25.876145 29291 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 6, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.878785   366 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:25.879002 29291 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 3, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 3 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.887734 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.830099 29391 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:25.894418 29392 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:25.898455 32614 raft_consensus.cc:3055] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:25.899096 32614 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:25.900312 32614 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:25.903331 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.902362 32614 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:25.907292   301 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:25.908207   301 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.913111 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:25.903811 29291 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.917367 29541 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:25.919189 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.920154 29542 raft_consensus.cc:2410] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:13:25.916410   301 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:25.920897 29546 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:25.913375 30153 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
W20260709 13:13:25.941212 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 66982.5us
I20260709 13:13:25.947621   313 raft_consensus.cc:3055] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.948303   313 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:25.947677 29394 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:25.954282 29538 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:25.936483 29291 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:25.962244 32766 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.963100 32766 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:25.965004 29290 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 296) took 19020 ms (client timeout 15000 ms). Trace:
W20260709 13:13:25.965543 29290 rpcz_store.cc:269] 0709 13:13:06.957473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.957807 (+   334us) service_pool.cc:224] Handling call
0709 13:13:25.964663 (+19006856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:20.209693 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:20.802910 (+593217us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:20.802970 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:13:20.802991 (+    21us) tablet.cc:662] Decoding operations
0709 13:13:20.885924 (+ 82933us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:20.886040 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:20.886074 (+    34us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:13:20.887761 (+  1687us) tablet.cc:701] Row locks acquired
0709 13:13:20.887824 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:13:20.888038 (+   214us) write_op.cc:270] Start()
0709 13:13:20.888213 (+   175us) write_op.cc:276] Timestamp: P: 1783602800887947 usec, L: 0
0709 13:13:20.888232 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:13:20.889139 (+   907us) log.cc:844] Serialized 8024 byte log entry
0709 13:13:22.619708 (+1730569us) op_driver.cc:464] REPLICATION: finished
0709 13:13:23.258358 (+638650us) write_op.cc:301] APPLY: starting
0709 13:13:23.343660 (+ 85302us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:23.406837 (+ 63177us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:23.444486 (+ 37649us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:24.034656 (+590170us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:24.130637 (+ 95981us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:13:24.130712 (+    75us) write_op.cc:312] APPLY: finished
0709 13:13:24.131339 (+   627us) log.cc:844] Serialized 139 byte log entry
0709 13:13:24.566159 (+434820us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.592308 (+ 26149us) write_op.cc:454] Released schema lock
0709 13:13:24.609738 (+ 17430us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:24.624960 (+ 15222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.627382 (+  2422us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":109766,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":517974,"apply.run_cpu_time_us":40939,"apply.run_wall_time_us":1442012,"num_ops":20,"prepare.queue_time_us":415015,"prepare.run_cpu_time_us":53805,"prepare.run_wall_time_us":1463268,"raft.queue_time_us":294826,"raft.run_cpu_time_us":41070,"raft.run_wall_time_us":470298,"replication_time_us":1699319,"thread_start_us":1767825,"threads_started":5,"wal-append.queue_time_us":1166071,"wal-append.run_cpu_time_us":36414,"wal-append.run_wall_time_us":3042924}]]}
I20260709 13:13:25.971725 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:25.972358 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:25.973021 29545 raft_consensus.cc:2376] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8. Re-sending same reply.
I20260709 13:13:25.973459 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.974102 29546 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:25.953472   313 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:25.975894 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.977190   313 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.977623 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:25.978304 29544 raft_consensus.cc:2376] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7. Re-sending same reply.
I20260709 13:13:25.979594 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.980499 29543 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:25.981900 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:25.983052 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.983915 29463 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:25.987206 32681 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:25.979519 29390 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:25.988106 32681 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:25.988672 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.989398 29388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a320582e5c548dd888eb981df817079"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:13:25.990306 29388 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:25.990420 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:25.990784 29388 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.991073 29545 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:25.991247 29468 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:25.971163 29291 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 5, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 5 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.994333 32204 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:25.995404 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:25.995829   408 raft_consensus.cc:3055] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.996110 29541 raft_consensus.cc:2376] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8. Re-sending same reply.
I20260709 13:13:25.996326   408 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:25.993005 29291 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.997960 29542 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:26.002414 29463 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:26.001464 29291 catalog_manager.cc:5697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 1 to 4, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 4 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.004957 29291 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 8 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:26.009307   369 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.009986   369 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:26.010325 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:25.997747   408 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:26.016192 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:26.017207 29538 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 4.
I20260709 13:13:26.020267 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.023707 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.033846 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.033897 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.015372 32766 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:26.037560 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.038544 32548 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:26.038046 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:26.039330 29393 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:26.039944 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.045001 32681 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:26.046571   408 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.052052 29388 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:26.058115 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:26.063817 29472 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:26.061210 32548 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.074191 29388 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:26.079232 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.083616 29468 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:26.087325 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:26.087706 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.089262 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.082798 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:26.093724 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.096145 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.097234 29470 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:26.099409   369 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:26.100205 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.079327   376 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:26.108651 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.109864 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.109954 29465 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:26.111392 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.113785 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.114666 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.119520 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.120146 29468 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:26.124679 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.118742 32681 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.125986 32681 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:26.128912 32681 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:26.129607 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.112938   376 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:26.130926 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.132309 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.134284 29388 raft_consensus.cc:1240] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:26.130923 29363 leader_election.cc:336] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.589s (SENT)
I20260709 13:13:26.139605 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:26.142377 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:26.143603 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.144372 29390 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:26.156844   366 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:26.163661 32548 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:26.165953   376 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.171162 29538 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.177006 29538 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:26.179106 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:26.179774 29538 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
W20260709 13:13:26.180734   422 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:13:26.190115 29545 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:26.196895 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.205483 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:26.206230 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.208176 29472 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:26.208722 29388 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 3.
I20260709 13:13:26.208921 29396 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:26.217118 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:26.218317 30153 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:26.223919 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:26.230229 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 99332us
I20260709 13:13:26.232445 30126 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:26.233771 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:26.234663 32548 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:26.236292 32548 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:26.236668 32548 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.237026 32548 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:26.238708   341 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:26.239185   341 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.239549   341 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:26.249732   425 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:13:26.259907 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.261231 29388 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.261436 30151 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:26.262715 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:26.267026 29396 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:26.269013 29540 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:13:26.272889 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.272359 30151 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:13:26.297250 29363 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.649s (SENT)
I20260709 13:13:26.305702 29438 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:26.306171 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:26.307523 29540 pending_rounds.cc:85] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 4
I20260709 13:13:26.315568 32604 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:26.316135 32604 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.316516 32604 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.313477   301 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:26.317346   301 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:26.310413 29540 pending_rounds.cc:107] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:26.319221 29540 raft_consensus.cc:2889] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:26.337409 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49368.8us
I20260709 13:13:26.313504   369 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:26.340588 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 106867us
I20260709 13:13:26.313570 32614 consensus_queue.cc:1059] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:13:26.351253   366 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.349917   376 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.395357 29393 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:13:26.398671 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 50890.1us
W20260709 13:13:26.404229 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47735.9us
I20260709 13:13:26.407126 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:26.399531   366 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.423192   406 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:26.411151   376 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.422981   301 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:26.460350   366 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:26.462352 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:26.457644 32548 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.444702   406 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.484512 30151 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:26.424266 32204 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:13:26.487979 29360 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:26.426707   303 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
W20260709 13:13:26.495242   429 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:13:26.500250 32204 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:26.500861 32204 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:26.502875   430 log.cc:927] Time spent T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.214s	user 0.006s	sys 0.000s
W20260709 13:13:26.506038 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.507036   433 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
W20260709 13:13:26.495357 29363 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.795s (SENT)
I20260709 13:13:26.508055 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:26.502244 32204 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:26.509552 29363 leader_election.cc:336] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.863s (SENT)
I20260709 13:13:26.488984   406 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:26.511324 32204 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:26.527413   443 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:13:26.528165   376 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:26.529340   440 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:26.530607 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:26.528255 32548 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:26.530236   440 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.531992 32548 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:26.532665 32548 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.533715   440 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:26.541168 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.531986 29363 connection.cc:256] RPC call timeout handler was delayed by -1.3503734829998848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 13:13:26.543434 29363 connection.cc:256] RPC call timeout handler was delayed by -1.3404734829998688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 13:13:26.543855 29363 connection.cc:256] RPC call timeout handler was delayed by -1.223473482999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:13:26.544297 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1379734829999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 13:13:26.550746 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:26.551358   313 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.006s
I20260709 13:13:26.551731 32599 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:26.552158 32599 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:26.549553   440 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.552917   440 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.553140 32599 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:26.554932   441 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.555526   440 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:26.555745   441 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.559571   341 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.562048   341 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:26.565335 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.565706 32599 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.569262 30151 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
W20260709 13:13:26.570370   438 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:13:26.575965 29360 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:26.529203   376 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:26.519717   301 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:26.591599 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 227008us
I20260709 13:13:26.599026 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:26.601264 29389 raft_consensus.cc:2410] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:13:26.568677   441 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:26.608948 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:26.609649 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.591698   301 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.615129   376 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:26.602294   366 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:26.618521 32548 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:26.621953 29395 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:26.625507 29397 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:26.621546 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 199166us
I20260709 13:13:26.634114   376 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.640729 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.651286   406 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.656261 29393 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:26.632241   301 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.660629 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.661129 30151 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:26.655721   441 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:26.656836   376 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.669955 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:26.672295   444 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:13:26.673095 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.681252   366 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.631943 32604 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:26.684156 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.695928 29388 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
W20260709 13:13:26.689531 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 263335us
I20260709 13:13:26.686261 32604 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:26.682237   366 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:26.709703 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:26.717470 29472 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:26.712174   406 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:26.668051   369 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:13:26.713701 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:26.701316   441 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:26.726046 29395 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:26.730468 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.731556 29468 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:26.726989 29393 raft_consensus.cc:2376] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7. Re-sending same reply.
I20260709 13:13:26.733031 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.736203 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:26.737322 29464 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:26.763586 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.764720 29397 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:26.778184 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.783898 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:26.785125 31642 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:26.785549 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:26.786698 32763 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:26.787130 32763 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:26.787534 32763 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:26.789466   452 consensus_queue.cc:1059] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:26.791064 32621 raft_consensus.cc:3055] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.791491 32621 raft_consensus.cc:740] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:26.792608 32621 consensus_queue.cc:260] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:26.794283 32621 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.803397 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:26.729863   303 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:13:26.805980 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:26.808971 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:26.810031 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:26.832976 29397 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:26.814646 32763 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:26.821969 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.804811 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:26.828924 29395 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:26.833222 29472 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:26.834175 29390 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:26.836408 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:26.837601   451 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:26.838958   441 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:26.933825 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.294804 30152 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:26.892041 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 89643us
W20260709 13:13:26.866329 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.166998 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.345048 29397 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:27.346669 29545 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:26.956787 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:27.352265 30151 raft_consensus.cc:2410] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:26.968118 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:27.358469 30126 leader_election.cc:336] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.033s (SENT)
I20260709 13:13:27.358491 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:27.359117 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:27.359745 30155 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:27.360183   440 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:27.360785 30126 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.074s (SENT)
W20260709 13:13:27.362003 30126 leader_election.cc:336] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.204s (SENT)
I20260709 13:13:27.363003 29466 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:27.364161 32763 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:27.365726 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 529429us
I20260709 13:13:27.366101   457 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:27.367918 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:27.369177 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:27.370769 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.085289 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:27.267401 32204 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.036919   454 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:26.854784   366 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:27.370179   376 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.665s	user 0.024s	sys 0.017s
W20260709 13:13:27.391322 29509 connection.cc:256] RPC call timeout handler was delayed by -1.656923549999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3783s for a response
I20260709 13:13:27.373986 32548 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:27.371330   369 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:27.384248 32681 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.395745 32681 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:27.093343   301 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:27.400607   301 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:27.401543 29396 raft_consensus.cc:2393] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:27.402333 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:27.402134 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 183569us
I20260709 13:13:27.382552 32204 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:27.405306 32204 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:27.406378 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:27.408016 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:27.413369 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:27.410983 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:27.415719 30159 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:27.414475   465 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:13:27.425150 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:27.425845 30160 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.408965   376 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:27.445605 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 83629.8us
I20260709 13:13:27.443213 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:27.446461 29388 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:27.446571 29539 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:27.446578 30126 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.224s (SENT)
I20260709 13:13:27.449616 32681 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:27.451052 30126 leader_election.cc:336] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.235s (SENT)
W20260709 13:13:27.449836   464 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:13:27.455101   440 consensus_queue.cc:1059] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:27.456507 32548 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:27.456964 32548 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:27.458118 32548 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:27.482676 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 71649.2us
W20260709 13:13:27.494622 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 82993.4us
W20260709 13:13:27.518805 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 125421us
I20260709 13:13:27.524232 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:27.526473 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 65032.1us
I20260709 13:13:27.527779 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:27.525398 29463 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:27.528848   301 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:13:27.529139   366 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:27.537179   366 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:27.538801 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:27.539278   459 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.645s	user 0.015s	sys 0.003s
I20260709 13:13:27.539752   366 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:27.544417   454 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:27.544960   454 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:27.548631 32548 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:27.552947   376 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:27.533098 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:27.558238 29464 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:27.559111 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:27.559792 30156 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:27.564811 30123 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.607s (SENT)
I20260709 13:13:27.575870 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:27.580021   440 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:27.586572 29509 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.058s (SENT) [suppressed 39 similar messages]
I20260709 13:13:27.587281 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:27.588433   441 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:27.589604 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 45902.7us
I20260709 13:13:27.591645 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:27.591711 29539 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:13:27.599882 29363 connection.cc:256] RPC call timeout handler was delayed by -1.398759623999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:13:27.602342 29472 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:13:27.602850 29472 pending_rounds.cc:85] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 7
I20260709 13:13:27.603098 29472 pending_rounds.cc:107] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:13:27.603389 29472 raft_consensus.cc:2889] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:27.605386   454 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:27.606808 30160 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:27.611220 29466 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:13:27.651583 30156 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:27.651744 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:27.655951 29360 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:27.656399 29363 leader_election.cc:336] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.569s (SENT)
I20260709 13:13:27.657042 29360 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:27.657294 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.663551 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:27.666837 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.667277 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.671450 29541 raft_consensus.cc:2410] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:13:27.669281 30123 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:27.664193   451 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:27.667519 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.673736 29539 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 5: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:27.669303 29546 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:27.676865 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.678035 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.678475 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:27.667804 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 283749us
I20260709 13:13:27.679337 29538 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:27.679363 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.682794 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.684506 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.686072 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.687736 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.689069 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:27.695356 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 103788us
I20260709 13:13:27.696115 29545 raft_consensus.cc:2410] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:13:27.696501 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.697429 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.697616 29539 raft_consensus.cc:2393] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:27.697969 29538 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:27.668476 32766 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:27.663412   366 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:27.699872 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:27.705279 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53680.9us
I20260709 13:13:27.708192   452 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:27.710691   366 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:27.712164   366 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:27.685710   457 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:27.714861 32766 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:27.717165   441 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:27.717762   441 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:27.663226   479 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:27.679947   440 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:27.661345 32548 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:13:27.717996 32766 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:27.718837   479 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:27.689500   376 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:27.682286   451 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:27.732434 32599 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:27.733363 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:27.736560 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80178.5us
I20260709 13:13:27.714164   457 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:27.740577 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.763402 29544 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:27.740660 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.745316 29438 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:27.763417 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:27.767221 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.746800 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.724359   440 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:27.747253 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.748754 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.771068 29545 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:27.750967 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.731676   479 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:27.752439 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.781049 29390 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:27.753664 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 84536us
I20260709 13:13:27.754528 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:27.753247 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.782406 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.783739 29395 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:27.782868 29543 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.782550 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:27.787602 30123 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:27.787837 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:27.788512 29397 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.790098 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.783046 29541 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:27.797672 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.800535 29545 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
W20260709 13:13:27.800662 29363 leader_election.cc:336] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.680s (SENT)
I20260709 13:13:27.802289 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:27.772249   440 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:27.783353 32621 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:27.808471 30156 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:13:27.815567 29541 raft_consensus.cc:2393] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:27.810276 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:27.816578 29393 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:27.788276   471 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:27.796634 32548 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:27.823133 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 89866.7us
I20260709 13:13:27.828677 30126 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:27.829958 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.830998 29545 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:27.831815 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:27.833645 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 43826us
I20260709 13:13:27.845731 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.818862   369 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:27.819185 30153 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Advancing to term 8
I20260709 13:13:27.849004 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.850162 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:27.853132 29541 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.853003 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:27.819718   486 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:27.856735 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:27.857353 29392 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:27.830567 32621 raft_consensus.cc:697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:27.831322 32548 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:27.863530 29363 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.809s (SENT)
I20260709 13:13:27.872682 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:27.862702 29544 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:27.864897 29397 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:27.866832 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:27.874980 29542 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:27.867621 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:27.866832 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:27.870662 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.875813 29545 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:27.877885 29537 raft_consensus.cc:2393] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:27.851737   454 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:27.862342   487 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:27.796110   441 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:27.877611 32548 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:27.915366 32621 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:27.836392   451 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:27.913125 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 84499.1us
I20260709 13:13:27.930317 30126 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:27.952790 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:27.877879   486 raft_consensus.cc:697] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:27.901119   369 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:27.972481 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 118900us
W20260709 13:13:27.976217 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 116292us
I20260709 13:13:27.969331 32763 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.980290 32763 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:27.981304   503 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:27.981812   503 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.982204   503 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:27.964115   495 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:27.928915   487 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.004752   493 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.007306   486 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.011571   440 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.014617   457 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:28.004984 29343 auto_rebalancer.cc:893] Removing replace marker failed: Leader has not yet committed an operation in its own term
W20260709 13:13:28.018616 29363 leader_election.cc:336] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.856s (SENT)
I20260709 13:13:28.065379 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:28.018826 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:28.018141 29543 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2.
I20260709 13:13:28.028769 30153 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:28.041327   491 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:28.050537 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 77356.9us
I20260709 13:13:28.061039 32763 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.087411 32681 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:28.087986 32681 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:28.088470 32681 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:28.100415 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 52870.7us
I20260709 13:13:28.101550 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:28.119921   301 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:28.121232   301 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.126850   440 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:28.127231   476 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:28.127875   476 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.128345   487 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:28.128984 29343 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:13:28.129395 29343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:13:28.130151   366 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:28.064926   493 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:28.135888   493 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:28.046780   500 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.064010   495 raft_consensus.cc:697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:28.128353   476 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.154807   500 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:28.185156 29541 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:28.188668   495 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:28.191191 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 172584us
I20260709 13:13:28.178010   500 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.198889 30156 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:28.200152 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 127400us
W20260709 13:13:28.212347 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 94972.3us
W20260709 13:13:28.215436 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 196892us
I20260709 13:13:28.221534 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.233453 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.236651 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:28.237017 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.237560 29395 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.239900 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.240765 29389 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:28.243494 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.244611 29393 raft_consensus.cc:2393] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:28.254364 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.252100 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:28.255743 29388 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.257083 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:28.257925 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.259822 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.260651 29393 raft_consensus.cc:2393] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 2: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:28.223057   457 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.265506 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:28.210156   487 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:13:28.271942 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.269245 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:28.272708 29394 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:28.275842 29388 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:13:28.277311 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 64137us
I20260709 13:13:28.287299   472 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:28.290978 29395 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:28.216353   503 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.294462   301 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.234592   366 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:13:28.276621   457 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.337507 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:28.345440 30156 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:28.282589   491 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:28.289592   376 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:28.359930 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.362885 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:28.368291 29466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea2318003a42fea9088b490db583f1"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:28.369756 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:28.370127   515 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:13:28.371071 29391 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:28.371807 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:28.393296 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.396083 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:28.344159 32621 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.321134 32548 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.543597 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:28.496940 29464 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:28.533926 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 277161us
I20260709 13:13:28.375998 29466 raft_consensus.cc:606] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:28.415860 29360 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:28.564559 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 148817us
I20260709 13:13:28.355618   491 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:28.534974   476 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:28.578310 29363 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:28.391920   376 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:28.588173 29469 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:28.621064   483 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:28.621909   483 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:28.624069   483 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:28.626998   500 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.592841   376 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.630613   476 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:28.573354 32621 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:28.420823   301 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:28.577664   369 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:28.647399 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 395582us
W20260709 13:13:28.648941   479 consensus_meta.cc:287] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.859s	user 0.012s	sys 0.004s
I20260709 13:13:28.659781   369 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:28.670732   369 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.671456   512 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:28.671986 32621 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:28.676484   500 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:28.657032   301 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:28.657181   303 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:28.678018   301 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.700757 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:28.664752   476 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:13:28.701126 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:28.705911 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:28.664775   509 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:13:28.708786 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:28.709638 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:28.673085   479 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:28.711175 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 155802us
I20260709 13:13:28.714398   313 raft_consensus.cc:993] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:28.714938   313 raft_consensus.cc:1081] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:28.719650   369 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.722963   369 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.722692   510 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:13:28.724368   482 raft_consensus.cc:3055] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:28.724773   482 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:28.713078   472 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:28.713198   454 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:28.698875   303 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.707815   301 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:28.737167 29466 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:28.735395 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:28.709115   474 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:28.740506 29463 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:28.746537 29471 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:28.738356 32681 consensus_meta.cc:287] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.647s	user 0.014s	sys 0.003s
I20260709 13:13:28.753064 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:28.725840   482 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.756206 30157 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:28.756444 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:28.760978 29469 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:28.756973 30154 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:28.755115 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:28.757965 30151 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:28.757792 29538 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:28.758966 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:28.774719 32621 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.744956   369 raft_consensus.cc:2764] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:13:28.776461 30160 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:28.779244 30155 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:28.780828 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:28.783856 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:28.784479 29546 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:28.782652 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 101787us
I20260709 13:13:28.709589   494 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:13:28.761555 32681 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:28.785660   451 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:28.784377 29360 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:28.766139   510 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:13:28.806840 29471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:28.807552 29471 raft_consensus.cc:606] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:28.775373 32621 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.786296   366 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:13:28.809859 32621 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.787899   479 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.810400   366 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:28.810954   376 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.793259   303 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.790686   524 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:13:28.794026   502 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:28.794968   482 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.794781   500 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:28.795329 29537 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:28.795862   457 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.796657   512 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:28.805740   451 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.811477   366 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:28.793797   519 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:28.816425   500 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:28.822717   473 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.822866   500 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:28.823462   473 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.824249   500 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.822933 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:28.829279 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:28.836476 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:28.838447 29542 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:28.840207 29395 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:28.840359 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.841213 29390 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:28.801677   487 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:13:28.844506 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:28.918987 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 101528us
W20260709 13:13:28.858840 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 65591us
I20260709 13:13:28.914145 29538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36373f233812459591c31993a4959894"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:13:28.857712 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:28.850005 29546 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:28.937143 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:28.850237 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 65945.4us
I20260709 13:13:28.940970 29538 raft_consensus.cc:606] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:28.850476 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 69721.6us
I20260709 13:13:28.942341 29545 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:28.945129 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:28.830010   519 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:28.946645 29537 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:28.846716   500 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:28.968451 29397 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:13:28.975801 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:28.977723 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.858222   472 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:28.980572 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:28.837397   483 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:28.847997   451 raft_consensus.cc:697] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:28.962425   440 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:28.933547   473 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:28.948148   519 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:29.012100 29397 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:28.948257   454 consensus_queue.cc:1059] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:13:28.999609   440 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:28.997449 32763 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:29.018069 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:29.001776 32766 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:29.035279 29396 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:29.037789 29396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ea2318003a42fea9088b490db583f1"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:13:29.039664 29396 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.040171 29396 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:29.040385 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.043550 32604 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:29.043668   491 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:29.044440 32604 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:29.047101 32681 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:29.036938   473 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:29.047912   473 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:29.048364   473 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.054570   483 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:29.054863   376 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:29.057122 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:29.037503   527 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:28.969439   366 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:29.070104 29393 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:13:29.071877 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:29.072467 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:29.071712 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:29.080181 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:29.056347   491 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:29.085608 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 70500.9us
I20260709 13:13:29.092851 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:29.075551 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:29.097738   451 consensus_queue.cc:237] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.098978   512 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.101835 32548 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:29.071714 29396 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.104084 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:29.104861 29394 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:29.073891 29393 pending_rounds.cc:85] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 7
I20260709 13:13:29.107131 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:29.107625 29393 pending_rounds.cc:107] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:13:29.108033 29393 raft_consensus.cc:2889] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.109005 32604 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:29.109658 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:29.112066 29363 connection.cc:256] RPC call timeout handler was delayed by -1.5613201559999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:13:29.112466 29363 connection.cc:256] RPC call timeout handler was delayed by -1.4371201559999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:13:29.113796 29363 connection.cc:256] RPC call timeout handler was delayed by -1.4227201559999685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260709 13:13:29.114148 29396 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:29.116000 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:29.116076 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:29.116634 29396 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.117419 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:29.119469 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:29.123828 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:29.124491 29394 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.120180 29393 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
W20260709 13:13:29.128508 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 143987us
I20260709 13:13:29.129470 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:29.130877 29393 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:29.130221 29464 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:29.138536 29393 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:29.121254   509 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.120366 32681 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.143376 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:29.147445 29469 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:29.147838 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:29.103541   527 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.154870   527 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:29.144186   509 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.155905   509 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.087529   440 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:29.161974 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:29.168484 29394 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:29.172425 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:29.173034 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:29.179258 29396 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
W20260709 13:13:29.180711 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.181687 32763 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:29.146958 32681 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:29.183851 29463 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:29.178574 29438 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:29.147505   408 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:13:29.203467 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80920.2us
I20260709 13:13:29.196769 32681 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.207962 29472 raft_consensus.cc:2410] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:13:29.209518 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:29.210592 29363 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.671s (SENT)
I20260709 13:13:29.192238 32763 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:29.220403 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 91171us
I20260709 13:13:29.216037 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:29.181763   531 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:29.225028   499 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:29.225594   499 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:29.226042   499 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.209277   493 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.233408   493 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.233907   493 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.208527   440 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:29.189881   512 consensus_queue.cc:1175] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "88760af579b54a6393c6251aa3c6b870" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:29.244714 32763 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.223843 32766 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.247200 32766 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:29.247707 32766 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.269733 30160 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:29.273293 29392 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
W20260709 13:13:29.278127 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 61847.2us
W20260709 13:13:29.281430 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 60203us
W20260709 13:13:29.284256 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.288982 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:29.296808   452 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:29.294341 30126 leader_election.cc:336] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 3.168s (SENT)
I20260709 13:13:29.302919 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:29.306886 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:29.307652 29389 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.278594   301 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.354481 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:29.314553   487 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:29.358855 30159 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:29.359797 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:29.361740 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67427.3us
I20260709 13:13:29.387801 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:29.391681 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 186681us
I20260709 13:13:29.372705 30151 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:29.400578 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:29.403808 29363 connection.cc:256] RPC call timeout handler was delayed by -1.3543201559998579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 13:13:29.404275 29363 connection.cc:256] RPC call timeout handler was delayed by -1.3372201560000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 13:13:29.404546 29363 connection.cc:256] RPC call timeout handler was delayed by -1.2742201559999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:13:29.404845 29363 connection.cc:256] RPC call timeout handler was delayed by -1.2625201559999368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:13:29.405107 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1824201560000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:13:29.405355 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1536201559999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:13:29.405606 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1365201559999605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 13:13:29.405851 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1185201559999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:13:29.406107 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1032201559999066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:13:29.406349 29363 connection.cc:256] RPC call timeout handler was delayed by -1.0789201559998673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 13:13:29.411909 29389 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:29.416132 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53721.7us
I20260709 13:13:29.418993   500 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:29.423642   531 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:29.426791   524 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:29.427207   539 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:13:29.426618   303 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:29.427572   524 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:29.401975   535 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:29.443243   535 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.478804 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:29.488461 29363 leader_election.cc:336] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.707s (SENT)
I20260709 13:13:29.488987 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:29.489835 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:29.493954 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.411916   473 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.493023   535 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:29.527395 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 64301.8us
I20260709 13:13:29.430366   524 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:29.443957   519 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:29.532711   538 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:13:29.488520   500 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:13:29.554623 29363 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.845s (SENT)
I20260709 13:13:29.488025   491 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:13:29.550107 29471 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:13:29.521737   457 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.547315 32548 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:29.569340 29471 pending_rounds.cc:85] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 6
I20260709 13:13:29.571022 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:29.578343 32548 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:29.533074   503 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:29.590582 29471 pending_rounds.cc:107] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 13:13:29.587235 29363 leader_election.cc:336] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.026s (SENT)
I20260709 13:13:29.592499 29471 raft_consensus.cc:2889] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.592706 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:29.593560 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 302597us
I20260709 13:13:29.587908 30152 raft_consensus.cc:2410] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:29.531627   499 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:29.527221   537 consensus_queue.cc:1059] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.274s
I20260709 13:13:29.533903 32766 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.586357   552 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.584074   473 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:29.669390 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:29.591336   376 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.598970   524 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.550736   509 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.657793 32204 raft_consensus.cc:3055] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:29.676101 29465 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:29.580735   493 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:29.680862 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 93646.6us
I20260709 13:13:29.663658   503 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.690472   473 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:29.674626   552 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.692770   552 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:29.586231 32548 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:29.695700 29363 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.160s (SENT)
I20260709 13:13:29.700155 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:29.678272 32204 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:29.722066 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:29.732739 29395 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:29.742193 32766 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:29.751271 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63238.1us
W20260709 13:13:29.755468 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.735903   473 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:29.718585   376 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.699667   503 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:29.811167 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 332475us
W20260709 13:13:29.849615 29363 leader_election.cc:336] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.179s (SENT)
I20260709 13:13:29.865576 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:29.847630 32681 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.010s
I20260709 13:13:29.866142 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:29.876369 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:29.770229   550 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:29.932101 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 210176us
W20260709 13:13:29.863755   538 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:13:29.887882 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:29.884099 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:29.888113 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:29.937942 29466 raft_consensus.cc:3055] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:29.938328 29466 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:29.932806 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 345696us
I20260709 13:13:29.939091 29466 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.945417 29466 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.945581   561 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.940779   550 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:29.948417   559 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:13:29.948927   550 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:29.950718 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 66768us
I20260709 13:13:29.954965 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:29.955675 29469 raft_consensus.cc:606] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:29.885339 32681 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:29.959956 29540 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:29.960414   562 log.cc:927] Time spent T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:13:29.961346 32681 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:29.863229 32204 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:29.965826 32204 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.966485 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:29.967484 29390 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:29.971073 29466 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:29.971225   499 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:29.971431 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.885998   369 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:29.979637 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:29.980571 29390 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.984683 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:29.985610 29396 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.941350   556 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:13:29.994805 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 46865.4us
W20260709 13:13:29.995309   564 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:13:29.999966 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:30.001745   503 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:30.002369   509 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:30.004308 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.007133   519 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:30.008867 29395 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.010797   493 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:29.983013   473 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:13:30.030313   499 raft_consensus.cc:993] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:30.030910   499 raft_consensus.cc:1081] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:29.902510   558 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:29.946167   561 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.039614 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.041963   561 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:29.977433   537 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:30.046643   558 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.021974 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.026870 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.018744   369 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:30.033485 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 93211.9us
I20260709 13:13:30.051330   474 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:30.051887   369 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:30.053982   472 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:30.054520   472 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:30.054953   472 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.056710   454 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:13:30.070947 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74193.6us
I20260709 13:13:30.074257 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.062790 29435 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:30.067322   569 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
I20260709 13:13:30.069828 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:30.075263   537 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.078776 29542 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:30.079015   509 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:30.079460   509 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.079808   509 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:30.080003   537 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.070402   472 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.074331 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:30.088557 29397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:13:30.099354 29397 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.099965 29397 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.092262 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:30.100224 29396 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:30.100798 30159 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:30.099298 29541 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:30.095293 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.103001 29395 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:30.097420 29542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:13:30.103974 29542 raft_consensus.cc:606] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.104362 29542 raft_consensus.cc:614] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:30.062340   558 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:30.107295 29390 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:30.108438 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:30.115612 29537 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 2.
W20260709 13:13:30.117168 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 92403.9us
I20260709 13:13:30.120646 29360 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:30.123013 29435 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:30.120962 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:30.129614 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:30.130241 29537 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.131053 29538 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:30.132526 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58380.7us
I20260709 13:13:30.133843 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:30.139041   483 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:30.139621   483 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:30.140640   483 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.141227 29543 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:30.143303 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 374007us
W20260709 13:13:30.144095 29363 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.199s (SENT)
I20260709 13:13:30.146196 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:30.147114 29542 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.111373 32681 raft_consensus.cc:2764] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:13:30.116683   376 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.149968 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49116 (request call id 731) took 1093 ms. Trace:
I20260709 13:13:30.153293 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:30.154156 29545 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:30.154244 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:30.155339 29435 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:30.152123 30152 rpcz_store.cc:276] 0709 13:13:29.056447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.056626 (+   179us) service_pool.cc:224] Handling call
0709 13:13:30.149707 (+1093081us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400271354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:30.149870 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179316608}
I20260709 13:13:30.161125 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.163422 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:30.164353 29390 raft_consensus.cc:2376] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10. Re-sending same reply.
I20260709 13:13:30.165630 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.151993 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:30.176064 29541 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:30.178625 29397 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.181789 29397 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:30.184424 29544 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:30.188328 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2222) took 1150 ms. Trace:
I20260709 13:13:30.189884 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.191605 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.126085   472 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:30.200981 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.188911 29388 rpcz_store.cc:276] 0709 13:13:29.016578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.016738 (+   160us) service_pool.cc:224] Handling call
0709 13:13:29.032719 (+ 15981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.156865 (+124146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:29.156899 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:29.156941 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:29.156975 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.166994 (+1010019us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000e65d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:30.167047 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.167174 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284994816}
I20260709 13:13:30.117084   487 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:13:30.195537   476 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:30.195957   545 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:30.184128   576 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:30.232561 30126 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.235s (SENT)
I20260709 13:13:30.233105 30126 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.250226 32621 raft_consensus.cc:3055] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:30.250845 32621 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.251873 32621 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.253404 32621 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.246739   509 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.258961   476 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.260069   476 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.239899   545 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.264964   545 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.257777   509 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:30.271648 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 101234us
I20260709 13:13:30.272864 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.273759 32681 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.230006   472 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:30.281417 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 49336.8us
I20260709 13:13:30.274243 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.291942 29542 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:30.336169 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 149105us
I20260709 13:13:30.340778 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:30.355216 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72051.3us
I20260709 13:13:30.356382 29438 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.359508   577 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:30.361912   529 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:30.304289   512 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.303949   472 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:30.374179 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 100048us
I20260709 13:13:30.375402 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.375754 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 843) took 1008 ms. Trace:
W20260709 13:13:30.379730 29363 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.896s (SENT)
I20260709 13:13:30.374603 30123 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:30.376365 30155 rpcz_store.cc:276] 0709 13:13:29.367554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.416852 (+ 49298us) service_pool.cc:224] Handling call
0709 13:13:29.493140 (+ 76288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:29.933464 (+440324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:29.933502 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:29.953179 (+ 19677us) log.cc:844] Serialized 26 byte log entry
0709 13:13:30.197563 (+244384us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:30.367399 (+169836us) log.cc:844] Serialized 14 byte log entry
0709 13:13:30.375169 (+  7770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.375298 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:30.375357 (+    59us) raft_consensus.cc:1685] finished
0709 13:13:30.375368 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.375557 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56571,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9066,"thread_start_us":667658,"threads_started":3,"wal-append.queue_time_us":257372}
I20260709 13:13:30.322300   576 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.386247 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:30.387496 29463 raft_consensus.cc:2368] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9.
I20260709 13:13:30.390590 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.398644 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.400596 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.406673 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.413026 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.414759 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.374293   509 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.424396 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:30.425328 29465 raft_consensus.cc:3055] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:30.428645 29465 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.406108 32766 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:30.441831 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 62148.3us
I20260709 13:13:30.426950   472 raft_consensus.cc:2764] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:13:30.424091   577 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:30.443192 29363 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.111s (SENT)
I20260709 13:13:30.443718 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.444025   576 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.407176   529 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:13:30.440133 30126 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.721s (SENT)
I20260709 13:13:30.441325   553 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.447505 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.455497   589 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:30.457495   584 log.cc:927] Time spent T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:13:30.458925   526 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:13:30.460709   583 log.cc:927] Time spent T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:30.467660 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2397) took 1159 ms. Trace:
I20260709 13:13:30.468286 29540 rpcz_store.cc:276] 0709 13:13:29.308384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.308553 (+   169us) service_pool.cc:224] Handling call
0709 13:13:29.320047 (+ 11494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.960448 (+640401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.467253 (+506805us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54001b7954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:30.467538 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471108352}
I20260709 13:13:30.374486   561 consensus_queue.cc:1059] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:13:30.425276   509 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:30.477433 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46382.4us
W20260709 13:13:30.497414 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 96876.4us
I20260709 13:13:30.505046 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:30.508344 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.476047   509 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.513139 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:30.514195 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 71028us
W20260709 13:13:30.521270 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 50017.6us
W20260709 13:13:30.524039 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.525831   472 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.512638 32599 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:30.510311   592 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:30.557610 29363 leader_election.cc:400] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9.
I20260709 13:13:30.558125 29393 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:30.569810 29363 leader_election.cc:403] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:13:30.532833   535 consensus_meta.cc:287] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.973s	user 0.013s	sys 0.005s
I20260709 13:13:30.521274 32204 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.572685   503 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:30.581462 29363 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.181s (SENT)
I20260709 13:13:30.571079   535 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:30.585556 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 84537.3us
W20260709 13:13:30.626130 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.572153 32599 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.641284 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.642309 29537 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:30.646631 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 65245.9us
W20260709 13:13:30.647531 29363 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.195s (SENT)
I20260709 13:13:30.648038 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.519346   529 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.574783   526 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:13:30.652799 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 139811us
I20260709 13:13:30.653028 29464 raft_consensus.cc:1240] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 13:13:30.665143 30126 leader_election.cc:336] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.924s (SENT)
I20260709 13:13:30.580693 32204 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.665669 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.584645   503 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:13:30.650084   472 raft_consensus.cc:2764] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:13:30.653865   525 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.662878   592 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.676230 30154 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:30.666412   581 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:30.681288   570 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:30.681782   591 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:30.683645   593 log.cc:927] Time spent T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:13:30.687188   603 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:30.689946   586 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:13:30.691066 29465 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.653975   560 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:13:30.696225 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:30.682209   588 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:30.718209   588 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.720788   588 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:30.711089 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:30.722833   493 consensus_queue.cc:1059] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:30.722868   560 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:30.723554   604 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:30.723642 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:30.724285   452 raft_consensus.cc:3055] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:30.724349   604 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.724870   452 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.726035   452 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.727481   452 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:30.715390 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67915.4us
W20260709 13:13:30.707639 29509 connection.cc:256] RPC call timeout handler was delayed by -3.2377600779998374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:13:30.730962 29509 connection.cc:256] RPC call timeout handler was delayed by -3.1468600779999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:13:30.731348 29509 connection.cc:256] RPC call timeout handler was delayed by -3.0568600779999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:13:30.731632 29509 connection.cc:256] RPC call timeout handler was delayed by -3.0478600779999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:13:30.731901 29509 connection.cc:256] RPC call timeout handler was delayed by -2.4259600779998891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2521s for a response
W20260709 13:13:30.732177 29509 connection.cc:256] RPC call timeout handler was delayed by -2.0425600779999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2947s for a response
W20260709 13:13:30.732442 29509 connection.cc:256] RPC call timeout handler was delayed by -1.6906600779998371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33380000000000004s for a response
I20260709 13:13:30.735188 29538 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:30.713220 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:30.737578 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.739984 29465 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.742483 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:30.745425 29537 raft_consensus.cc:1240] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.707557   570 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:30.760929   472 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:30.762058   376 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:30.762601   472 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:30.763142   472 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.738952   451 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:30.767249 32204 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:30.766896   451 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.716897   590 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:13:30.712678   535 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:30.776913 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.744901   553 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:13:30.784647   526 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.709129 32599 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.743060   519 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:30.787253 29538 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
W20260709 13:13:30.796540 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.766942   575 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:30.823441   598 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:30.824133   598 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.826507   605 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:30.826638 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 49841.6us
I20260709 13:13:30.827255   605 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.827652 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.841641 29465 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:30.828687   604 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:30.858898   553 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.867180 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.820324   575 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:13:30.868782   545 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.601s	user 0.016s	sys 0.000s
I20260709 13:13:30.868643   451 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:30.850520   519 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:30.897154 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 147819us
I20260709 13:13:30.900049 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.901299 29396 raft_consensus.cc:2410] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:30.903913 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.904848 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.870255   313 consensus_queue.cc:1059] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:13:30.913036 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.913869 29391 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:30.914844 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.915655 29392 raft_consensus.cc:2376] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6. Re-sending same reply.
I20260709 13:13:30.921789 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.921772 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.922631 29388 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:30.922956 29394 raft_consensus.cc:2393] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:30.924407 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.925143 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:30.925436 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:30.925781 29396 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.927606 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:30.903010   487 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.934368 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:30.934772   612 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:30.938048   540 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.938720   540 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.941236   540 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:30.942631 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.946396 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:30.946995 29391 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.947193 29388 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:30.906230   451 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:30.943993 30155 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:30.943993 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:30.946130 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:30.950320 29395 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:30.953181 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:30.962867 29438 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:30.893462   545 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.965323 29396 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:30.936051   524 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:30.946758   592 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:30.973594 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.986987 29466 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:30.945875   487 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:30.962704   598 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:30.995864 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:30.998409   549 raft_consensus.cc:3055] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:31.006695   596 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:31.007967   614 log.cc:927] Time spent T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:13:31.008911   609 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:13:30.979792   540 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:30.959857   451 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.917742   575 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.015268   473 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:31.018276 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 190766us
I20260709 13:13:30.997553   519 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.023959 32766 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:31.048484 32766 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:31.050709   451 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:31.051388   451 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:31.049930 32766 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.053228 32766 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:31.055074 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:31.056182 30159 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:31.058234   473 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.060339   303 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:31.060508   473 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.060837   303 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:31.029933   540 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:31.062172   540 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:30.982259   524 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.068068 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:31.068596   524 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.069131 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 445) took 1507 ms. Trace:
I20260709 13:13:31.069543 29464 rpcz_store.cc:276] 0709 13:13:29.561714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.561869 (+   155us) service_pool.cc:224] Handling call
0709 13:13:29.562259 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:30.666646 (+1104387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.068810 (+402164us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001e4e54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:31.069058 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507611904}
I20260709 13:13:31.029773 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:31.073323 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:31.074656   473 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:31.075439   473 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:31.077523   472 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.013720   549 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:31.045177   575 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:31.047770   545 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.022882   596 raft_consensus.cc:697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:31.129453   596 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:31.084049 29541 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:31.131686   549 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:31.085172 29545 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.089780 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:31.086810 29363 leader_election.cc:336] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.584s (SENT)
I20260709 13:13:31.091722 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.133872 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:31.134162 29539 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:31.090653 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:31.134816   451 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:31.061758   303 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.135881   598 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:31.088506 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:31.014719   605 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:31.053572   570 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:31.139478   570 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:31.118398 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:31.148748 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 59070.3us
W20260709 13:13:31.149475 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 62711us
I20260709 13:13:31.149703 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:31.150318 29363 leader_election.cc:336] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.589s (SENT)
I20260709 13:13:31.150825 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:31.109747 32621 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:31.201040 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 51431.5us
I20260709 13:13:31.153939   451 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:31.204129   472 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.205740 29397 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:31.209540   525 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
I20260709 13:13:31.210021   525 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:31.212549   509 consensus_meta.cc:287] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.007s
I20260709 13:13:31.213033   509 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:31.212579 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:31.214134 29467 raft_consensus.cc:1240] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:31.215006 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.113029   524 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.240126 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:31.240427 29397 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:13:31.234843 29539 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:31.249457 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:31.250833 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 95007.1us
I20260709 13:13:31.250864 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.248514 30152 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:31.250308 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.254307 29537 raft_consensus.cc:2368] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7.
I20260709 13:13:31.256415 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.250255 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.257915 29546 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:13:31.200729   473 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:31.258571 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.267944 29543 raft_consensus.cc:2393] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:31.260242 29396 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:31.269399 29396 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:31.270267 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:31.271873 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.272601 29537 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:31.275156 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.275698 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.276201 29539 raft_consensus.cc:2368] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7.
I20260709 13:13:31.246668   592 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.287129 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.273847 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.292876 29463 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:31.301972 29396 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:31.243139 32621 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.310624 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.312862 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:31.313757 29396 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:31.319041 29544 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:31.318962 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:31.321241 29537 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
W20260709 13:13:31.307561   591 consensus_meta.cc:287] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.570s	user 0.004s	sys 0.013s
I20260709 13:13:31.338934   591 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9.
I20260709 13:13:31.341928 29464 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:31.358875 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.359697 29546 raft_consensus.cc:2376] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10. Re-sending same reply.
I20260709 13:13:31.360585 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:31.361191 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.361366 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:31.377015   597 log.cc:927] Time spent T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.804s	user 0.005s	sys 0.000s
I20260709 13:13:31.382364 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 491) took 1222 ms. Trace:
I20260709 13:13:31.382856 29389 rpcz_store.cc:276] 0709 13:13:30.159534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.159647 (+   113us) service_pool.cc:224] Handling call
0709 13:13:30.198048 (+ 38401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:30.307853 (+109805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.307905 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:30.332601 (+ 24696us) log.cc:844] Serialized 52 byte log entry
0709 13:13:30.449340 (+116739us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:30.449405 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.449536 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:31.376319 (+926783us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:31.381999 (+  5680us) raft_consensus.cc:1685] finished
0709 13:13:31.382021 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.382285 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22427,"raft.queue_time_us":103584,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":32485,"spinlock_wait_cycles":9014656,"thread_start_us":169618,"threads_started":2,"wal-append.queue_time_us":153395}
I20260709 13:13:31.358940 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.327404 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:31.331275   621 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:31.337190 32621 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.337710 29391 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:31.284129   525 consensus_queue.cc:1059] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:13:31.281970   452 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:13:31.299999   592 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.247277   524 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.353201   303 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:31.326141 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 107951us
I20260709 13:13:31.389154 29539 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:31.415714 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.417001 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.417598 29539 raft_consensus.cc:2376] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2. Re-sending same reply.
W20260709 13:13:31.330153   624 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:31.413793 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.414117 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.417745 29544 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:31.419121 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.419418 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:31.427681 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.428284 29537 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:31.390524 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.414708 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.400143 29395 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:31.424000 29396 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:31.432214 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.432458 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.433467 29544 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:31.435360 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.436923 29539 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:31.437336 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.439534 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.441803 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.442826 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.444288 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.446005 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.447615 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.448228 29546 raft_consensus.cc:2376] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 2. Re-sending same reply.
I20260709 13:13:31.453361 29544 raft_consensus.cc:2368] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9.
I20260709 13:13:31.393029   487 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:31.454981 29545 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 4: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:31.455878 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.460356 29537 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:31.461464 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.461583 30156 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:13:31.464843 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.463080 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.480120 29538 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:31.485391 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:31.488952   603 raft_consensus.cc:3055] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:31.489470   603 raft_consensus.cc:740] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:13:31.517146 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.535104 29539 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
W20260709 13:13:31.541579 30126 leader_election.cc:336] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.513s (SENT)
I20260709 13:13:31.610774 29545 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:31.617363 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:31.618235 29469 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:31.620430 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.624007   592 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:31.626133 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:31.626291 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 145000us
W20260709 13:13:31.588392 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 126373us
I20260709 13:13:31.640363   524 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:31.641232   602 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:13:31.651068 29543 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:13:31.490829   487 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:31.659886   524 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:31.663933 30156 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:31.664294   524 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:31.668402 29538 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:31.676607 29390 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.671464 32766 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:31.690778 32766 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:31.704813   617 log.cc:927] Time spent T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.580s	user 0.002s	sys 0.024s
I20260709 13:13:31.704377 32599 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:31.707362 32621 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:31.701790 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:31.715478   451 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:31.716106   451 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:31.717667   580 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:31.718293   580 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.719588 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 451) took 1014 ms. Trace:
I20260709 13:13:31.719965 29463 rpcz_store.cc:276] 0709 13:13:30.705471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.705741 (+   270us) service_pool.cc:224] Handling call
0709 13:13:30.711321 (+  5580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:31.293502 (+582181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.719286 (+425784us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54002a4ed4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:31.719499 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336663424}
I20260709 13:13:31.720631   580 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.712102 32766 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:31.715515 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:31.722724 29395 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:31.723470   451 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:31.677562   487 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.727610 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:31.730355 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:31.735611 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.490438   603 consensus_queue.cc:260] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:31.744834 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.744760 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:31.672295   313 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:13:31.728118   487 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:31.749527 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.751178 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:31.752895 30154 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:31.755627 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:31.756464 29388 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:31.760891 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:31.761152 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 103114us
W20260709 13:13:31.762848 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.765600 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:31.754010   603 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:31.763912 30126 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:31.771495 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.773183 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.775321 29541 raft_consensus.cc:2368] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9.
I20260709 13:13:31.777185 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.739625   567 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:31.779275 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.740595   524 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:31.780083 29541 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:31.791309 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:31.749202   575 consensus_queue.cc:1175] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "88760af579b54a6393c6251aa3c6b870" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:13:31.794958   525 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.795770   525 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.797235 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.801270 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.802897 29543 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:31.809957 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.812096 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:31.812674 29543 raft_consensus.cc:2376] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6. Re-sending same reply.
I20260709 13:13:31.814373 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.815065 29542 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:31.815168 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.816550 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.817203 29542 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
W20260709 13:13:31.826426 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 87041.4us
I20260709 13:13:31.820612   606 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:31.822118   567 raft_consensus.cc:697] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:31.842998 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 52634.5us
W20260709 13:13:31.839531 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 75736.4us
I20260709 13:13:31.839792 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.844092 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:31.846514 29542 raft_consensus.cc:2410] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:13:31.849152 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.849886 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.842307 32604 raft_consensus.cc:1064] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:13:31.855877 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:31.862802 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:31.871061 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.742s (SENT)
I20260709 13:13:31.841497   606 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.876436 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.853752   313 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:31.880460   525 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:31.880954 32604 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:31.881862   606 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:31.882905 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:31.888706 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:31.892097 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:31.893416 29394 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:31.894241   581 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:31.894868   581 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:31.898711   493 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:31.899230   493 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:31.900259   493 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:31.901939   493 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:31.905341 29395 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:31.873266 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:31.871676 30156 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:31.915158 32621 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:31.915628 32621 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.915974 32621 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:31.892213 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2093) took 1074 ms. Trace:
I20260709 13:13:31.871260   633 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:13:31.921109 29468 rpcz_store.cc:276] 0709 13:13:30.817880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.818088 (+   208us) service_pool.cc:224] Handling call
0709 13:13:30.819907 (+  1819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.830785 (+ 10878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.830834 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:30.830911 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:30.830960 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.891906 (+1060946us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54001e5354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:31.891958 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.892134 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24384384}
I20260709 13:13:31.871690 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:31.925359 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54342us
W20260709 13:13:31.926743 30126 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.545s (SENT)
I20260709 13:13:31.927191 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:31.928185 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:31.851315 32599 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:31.944900 30156 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:31.966775 30154 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:31.968044 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:31.968964 29543 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:31.970082 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:31.992262 30156 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:31.931309   638 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:31.876636   632 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.019797 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:32.021668 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:32.022527 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:32.012365 30126 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.030241 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:32.041323 30152 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:32.043367 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:31.974778   525 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:32.075037 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 200186us
W20260709 13:13:32.013913   617 log.cc:927] Time spent T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:13:32.073181 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:32.095952 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 182497us
I20260709 13:13:32.107226   592 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:32.126967 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83727us
I20260709 13:13:32.128062 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:32.129484 29509 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:32.133172 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 105596us
I20260709 13:13:32.134783 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.137939 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:32.095252   644 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.148582 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.149830 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.151928 29363 leader_election.cc:400] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9.
I20260709 13:13:32.153048 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.107537 32766 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.162140 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:32.165132 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 152925us
I20260709 13:13:32.167194 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:32.143815   615 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.144229   598 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.099779   567 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.155208   369 raft_consensus.cc:2764] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:32.183743   369 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:32.186524 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:32.186971 32766 raft_consensus.cc:2764] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:32.187922 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:32.188803 29389 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 6: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:32.189649 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:32.167977   592 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:32.151147   591 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.154313   510 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:13:32.197741 32599 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.198367 32599 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.156631   580 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.168588   529 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.170833   451 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.247114   615 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.247877   615 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.248903 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2262) took 1180 ms. Trace:
I20260709 13:13:32.249341 29390 rpcz_store.cc:276] 0709 13:13:31.068542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.070076 (+  1534us) service_pool.cc:224] Handling call
0709 13:13:31.070367 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:31.677122 (+606755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.248598 (+571476us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54002c1ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:32.248826 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393723264}
I20260709 13:13:32.251690   493 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:32.252689   625 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.966s	user 0.010s	sys 0.005s
I20260709 13:13:32.252331   493 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.256080   493 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.256320 32599 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.256466 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 497) took 1306 ms. Trace:
I20260709 13:13:32.259675 29392 rpcz_store.cc:276] 0709 13:13:30.950466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.950580 (+   114us) service_pool.cc:224] Handling call
0709 13:13:30.967316 (+ 16736us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:30.976254 (+  8938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.976302 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:30.992817 (+ 16515us) log.cc:844] Serialized 52 byte log entry
0709 13:13:31.253863 (+261046us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:31.253904 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.253972 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:32.251927 (+997955us) spinlock_profiling.cc:243] Waited 990 us on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:32.256073 (+  4146us) raft_consensus.cc:1685] finished
0709 13:13:32.256099 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.256385 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9129,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":7502,"spinlock_wait_cycles":2276096,"thread_start_us":187116,"threads_started":1,"wal-append.queue_time_us":260624}
I20260709 13:13:32.239805   509 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.263394 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:32.264474 29539 raft_consensus.cc:2410] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:32.250306   615 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:32.268894 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:32.222194 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 55785us
I20260709 13:13:32.272851 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.281102 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:32.283407 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 145605us
I20260709 13:13:32.284888 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.291541 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:32.292447 29390 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:32.295282 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:32.297474 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.249991 32621 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.299822 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.303056 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:32.267966   560 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.303772 30159 raft_consensus.cc:2376] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7. Re-sending same reply.
I20260709 13:13:32.278419   487 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.323647 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.332401   526 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.338815   606 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.302349   303 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:32.315824   612 raft_consensus.cc:2764] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:13:32.339365   630 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:32.354943 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 70168.7us
I20260709 13:13:32.356007 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.356202 30126 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:32.358350 30153 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:32.360760 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.327433   638 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:32.378893   638 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.319785   560 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:32.390398 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 220681us
I20260709 13:13:32.391562 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.402578 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.378978   652 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:32.410488 29509 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:32.410872 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.415491 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:32.417315 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:32.399652   603 consensus_meta.cc:287] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.005s
W20260709 13:13:32.422794 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 129061us
I20260709 13:13:32.389559   638 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:32.423640 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.425040 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.425966 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.413484   590 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.378468   630 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.394863   655 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:32.421159   612 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:32.409039   451 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.375204   303 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.470347 29463 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:32.467062   596 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.414136   652 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:32.419227   580 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.473253 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.496732 29465 raft_consensus.cc:2410] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:13:32.476445 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:32.469408 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53982.5us
I20260709 13:13:32.412814   529 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:13:32.491245 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 95828.4us
I20260709 13:13:32.501606 29363 leader_election.cc:400] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9.
I20260709 13:13:32.502043 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:32.502871 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.468886   577 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:32.504257 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:32.508496 29363 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:32.477891   615 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.522022 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.524778 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.529893 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:32.531705 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:32.497864   652 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.481814   655 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.517539   598 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.534214 32766 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.509356   612 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.507551   451 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.549521 32766 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:32.517942   592 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:32.541949   655 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.555119 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:32.556661   656 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:13:32.560391   661 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:32.526427   580 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:32.575242 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 103439us
I20260709 13:13:32.570809 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.535705   590 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:32.529904   596 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.576327 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:32.540668 32621 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:32.578368 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:32.580590 30123 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.516250   577 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.527443   615 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.572399   648 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:32.591383 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:32.593129 29468 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:32.601121 29465 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:32.579831   451 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:32.577914   590 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.587322   575 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:32.584784   612 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.589185   606 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:32.588929 32766 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.607523   580 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.659948   580 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:32.661464   623 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.550s	user 0.010s	sys 0.011s
I20260709 13:13:32.592595   648 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:32.663489 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 53107.3us
I20260709 13:13:32.601843 32621 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:32.625216 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:32.629855 29544 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:13:32.631138   663 log.cc:927] Time spent T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:13:32.578734   661 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.589462   603 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:13:32.634397 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:32.635007   658 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:13:32.636207   577 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:32.636659   615 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:32.644232   581 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.749s	user 0.012s	sys 0.002s
I20260709 13:13:32.645193   598 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.621935   591 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:32.646287   618 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 1.535s	user 0.012s	sys 0.011s
I20260709 13:13:32.621788   612 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.718907   534 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.719573   612 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:32.654742   303 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:32.720502   667 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:13:32.721212 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:32.721936 29543 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:32.696767 32766 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.618608   560 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.723953 29538 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:32.677718 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2456) took 1058 ms. Trace:
I20260709 13:13:32.724658 32766 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:32.676818 32621 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.724931 29544 rpcz_store.cc:276] 0709 13:13:31.619358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.628802 (+1009444us) service_pool.cc:224] Handling call
0709 13:13:32.629336 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.677404 (+ 48068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.677647 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:32.725462 32621 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.613445   590 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.693979 29546 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:32.662952   648 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:32.747901   638 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.616933   575 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.750248   575 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:32.585343   524 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.655284   451 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:13:32.726943 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:32.765894 29537 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:32.738870   661 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:32.777496 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 245880us
I20260709 13:13:32.778918 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:32.724694   598 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.740909 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 1946) took 1814 ms. Trace:
I20260709 13:13:32.741474   630 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:32.731181   615 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.726284   581 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.744653   580 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.731477   592 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:32.748980 32766 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.755606 29545 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:13:32.778729   660 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.227s	user 0.002s	sys 0.002s
I20260709 13:13:32.768982 29537 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:13:32.770654 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 161090us
I20260709 13:13:32.816481 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:32.817227 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:32.818324 30152 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:32.786011 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.712404 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:32.786046 29393 rpcz_store.cc:276] 0709 13:13:30.926773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.926904 (+   131us) service_pool.cc:224] Handling call
0709 13:13:30.927247 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:30.927498 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.927531 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:30.928058 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:13:31.086648 (+158590us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:31.283052 (+196404us) log.cc:844] Serialized 14 byte log entry
0709 13:13:31.283419 (+   367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.283502 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:32.645543 (+1362041us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:32.740540 (+ 94997us) raft_consensus.cc:1685] finished
0709 13:13:32.740653 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.740830 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":243364,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":44,"raft.queue_time_us":116,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11236,"spinlock_wait_cycles":21672704,"thread_start_us":304109,"threads_started":2,"wal-append.queue_time_us":168724}
I20260709 13:13:32.819988 30159 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:32.766875   638 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:32.821887 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.819012 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.827260 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:32.829347 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:32.825482 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:32.831591 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:32.833153 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:32.831791 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 49403.2us
W20260709 13:13:32.833997 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48093.7us
I20260709 13:13:32.835016 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.832015 30152 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:32.719651   534 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.821182   301 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:32.823372 32766 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.843539 30158 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:32.844954 32766 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:32.823149   592 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.845333   580 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.845620 32766 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:32.816403   615 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.846886 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:32.848624   615 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:32.849262   615 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:32.849756   615 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:32.831048   529 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.856033   677 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:32.856684   677 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:32.857627   677 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.837410   577 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:32.861155   655 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.863313   592 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:32.865077   652 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.841437   657 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:32.871510   657 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.872061   657 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:32.873224 30151 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:32.874373   575 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.877961 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:32.878819 29537 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:32.880155 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:32.880637 29543 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.880851 29545 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:32.883916 29435 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:32.901786 29541 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:32.825474   524 consensus_queue.cc:1059] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:13:32.844988   581 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:32.907611   664 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:32.911993   524 raft_consensus.cc:3055] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.935372 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.939186 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:32.912067   664 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.941313 29393 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:32.942250 29394 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.906289 32766 consensus_queue.cc:1059] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:13:32.945271 30151 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:32.947376 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.923903   451 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:32.952746 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 119686us
I20260709 13:13:32.953687 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:32.954018 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.944458   664 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.955629   655 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:32.956285   655 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.956760   655 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:32.957450 32621 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.952682 32204 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:13:32.951005   598 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:32.960366 30158 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:32.960515 32621 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.962903   581 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:32.963142   682 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:13:32.964000 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.967294   652 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.933444   675 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:32.971946   675 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.944510   524 raft_consensus.cc:740] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:32.975399   524 consensus_queue.cc:260] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:32.976619   524 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:32.977401 29291 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 177) took 16051 ms (client timeout 15000 ms). Trace:
I20260709 13:13:32.171783 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.990875 29394 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:32.994796 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:32.998785 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46730.3us
I20260709 13:13:32.979804   451 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.002681 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.003525 29294 catalog_manager.cc:5697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 6, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.004472   451 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:32.948377   615 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.005461 29294 catalog_manager.cc:5697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.009578   303 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:33.012477   549 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.015750 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:33.020313   612 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:33.021883 29389 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:33.056413 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.057004 29388 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:33.057226 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:32.980599   534 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:33.058010 29389 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:33.023898 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 189008us
I20260709 13:13:33.026516 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:33.027554 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.978222   575 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:33.061375 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:33.045236 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45700.2us
I20260709 13:13:33.046301 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:32.974330   675 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:33.051259 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:33.051375 29363 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.566s (SENT) [suppressed 33 similar messages]
I20260709 13:13:33.001762 29394 raft_consensus.cc:1240] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:33.061132 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:33.070533   675 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:32.977864 29291 rpcz_store.cc:269] 0709 13:13:16.934519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.935272 (+   753us) service_pool.cc:224] Handling call
0709 13:13:32.977283 (+16042011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:26.288376 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:26.289468 (+  1092us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:26.289557 (+    89us) write_op.cc:435] Acquired schema lock
0709 13:13:26.289586 (+    29us) tablet.cc:662] Decoding operations
0709 13:13:26.399202 (+109616us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:26.408722 (+  9520us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:26.409917 (+  1195us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:13:26.614491 (+204574us) tablet.cc:701] Row locks acquired
0709 13:13:26.614560 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:13:26.614835 (+   275us) write_op.cc:270] Start()
0709 13:13:26.615046 (+   211us) write_op.cc:276] Timestamp: P: 1783602806614748 usec, L: 0
0709 13:13:26.615077 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:13:26.616181 (+  1104us) log.cc:844] Serialized 5300 byte log entry
0709 13:13:26.894023 (+277842us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b1800208420. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:13:27.537641 (+643618us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:27.727801 (+190160us) op_driver.cc:464] REPLICATION: finished
0709 13:13:27.812899 (+ 85098us) write_op.cc:301] APPLY: starting
0709 13:13:27.826349 (+ 13450us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:27.912515 (+ 86166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:27.932795 (+ 20280us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:28.288358 (+355563us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:28.370425 (+ 82067us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:13:28.370513 (+    88us) write_op.cc:312] APPLY: finished
0709 13:13:28.371039 (+   526us) log.cc:844] Serialized 95 byte log entry
0709 13:13:28.371287 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.371472 (+   185us) write_op.cc:454] Released schema lock
0709 13:13:28.371581 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:28.390372 (+ 18791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.390410 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101306,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":29629,"apply.run_cpu_time_us":10265,"apply.run_wall_time_us":601024,"num_ops":13,"prepare.queue_time_us":128291,"prepare.run_cpu_time_us":40848,"prepare.run_wall_time_us":493423,"raft.queue_time_us":186837,"raft.run_cpu_time_us":1910,"raft.run_wall_time_us":30139,"replication_time_us":1112497,"spinlock_wait_cycles":47366912,"thread_start_us":381634,"threads_started":4,"wal-append.queue_time_us":198397,"wal-append.run_cpu_time_us":36172,"wal-append.run_wall_time_us":2527171}]]}
I20260709 13:13:33.072381 29397 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:33.120373 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:33.080837 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 84911.7us
I20260709 13:13:33.022318   598 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.083827   474 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:33.092509 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:33.093854 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.096168   567 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.109325 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:33.109197 29389 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:33.110126 29468 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:33.090809   369 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:13:33.110589 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:33.128700   657 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.111917 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:33.128748   675 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:33.112519   646 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.063s	user 0.000s	sys 0.002s
I20260709 13:13:33.050705   303 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:33.114351 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 273126us
I20260709 13:13:33.068473 29463 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:33.145479 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:33.130437 29392 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.111675 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:33.134943 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 65822.7us
I20260709 13:13:33.142385 29294 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.160288 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:33.127130 29343 placement_policy_util.cc:248] tablet cbc3743d348b41f48617d0cb35c85353: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:13:33.171171 29438 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:33.176096 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:33.174201 29294 catalog_manager.cc:5697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 5, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.067404   612 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:33.204118 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50868.5us
I20260709 13:13:33.159683   655 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.128854   598 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.138312   567 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.215319 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:33.192476   596 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:33.216024   596 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:33.216097 29469 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:33.216499   596 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:33.217317   612 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.217759 29294 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.219036   303 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.221489 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:33.223341   657 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:33.202201   676 consensus_queue.cc:1059] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:13:33.224781   676 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:33.225188   676 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:33.225234   655 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:33.217128   630 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:33.225805   655 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.174644   590 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.158977   648 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.227886 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.222597 29294 catalog_manager.cc:5697] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 4 to 5, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.232120 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:33.240113 29294 catalog_manager.cc:5697] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.190706   535 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:33.160890   482 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:13:33.226220   655 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:33.246424 29392 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:33.275266 29395 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:13:33.275081 29294 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.278259 29391 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:33.280514 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52716.8us
W20260709 13:13:33.282002 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 230644us
I20260709 13:13:33.227324   620 raft_consensus.cc:3055] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:13:33.282951 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 223143us
I20260709 13:13:33.282855 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.287262 29438 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:33.273488   549 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:33.291402 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:33.294571 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.302433 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.229200   567 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:33.226269   676 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.231386   665 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:13:33.299940   675 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.284049   479 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:33.351495 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 49304.7us
I20260709 13:13:33.285562   620 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:33.297744   549 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:33.351030 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48387.5us
I20260709 13:13:33.231541   540 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 13:13:33.355011 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 54473.1us
I20260709 13:13:33.376109 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.295007   524 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.367448 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.306555   482 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:33.303326   580 raft_consensus.cc:476] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Not starting pre-election -- already a leader
W20260709 13:13:33.346351 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44461.6us
I20260709 13:13:33.303601   575 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.303906   686 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.347100 32763 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.378296 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.351711   487 consensus_queue.cc:1059] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:13:33.288403   535 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:13:33.288190   560 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:13:33.365454   657 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:33.375098   479 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:33.391773   679 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:33.392215 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:33.435750 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.349511   612 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:33.395843 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:33.396301 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.376315   549 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.399056 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.352319   673 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:13:33.401988 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:33.382265   676 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.407339 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:33.407971 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:33.363538   671 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.413520 29545 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:33.346031   615 consensus_queue.cc:1059] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:13:33.383066   483 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.430146 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:33.431360 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:33.439230   690 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:33.440964   694 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.392872   524 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.492568 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:33.448542   648 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.451508 29469 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:13:33.501312 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:33.460355   675 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:33.400055 32763 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:33.459358 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 63144.7us
I20260709 13:13:33.469719 29543 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:33.386874   581 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:13:33.481282   662 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.489548 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:33.526568 32763 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.402619   567 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:13:33.528264   567 raft_consensus.cc:3055] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:33.528656   567 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:33.529564   567 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:33.454897 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 55976.5us
I20260709 13:13:33.498948   652 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:13:33.532106   652 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:33.532460   652 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:33.533079 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:33.533365   652 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.534235 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:33.535511 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:33.461673   630 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:13:33.493345   303 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:13:33.459872   612 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.537050 29545 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:33.539209 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:33.539423 29538 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.486557   671 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.546788 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:33.550062 29546 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:33.551481 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:33.565199 29546 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:33.570737 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:33.573607 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.574628 29390 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:13:33.556039   690 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:33.504877   615 consensus_queue.cc:1243] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer c65265f20d7e42b6bfe314c5d109bdf7 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:33.585541 29467 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:33.595245 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:33.550401   598 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:33.597244 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.597325 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.581073 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.600303 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.602052 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:33.557245   652 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:33.607674 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.582878 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:33.603788 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:33.595927 29538 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:33.603958 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.612318 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:33.567193   590 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:33.614544 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:33.621272 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:33.576138   648 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.626813 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:33.624048 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 68601.8us
I20260709 13:13:33.623584 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:33.625454 30151 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:33.630225 29390 raft_consensus.cc:1217] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 13:13:33.630838 29390 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:33.608006   474 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.586030   540 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:13:33.647300 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:33.645066 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:33.643905 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.649580 29394 raft_consensus.cc:2410] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:33.622874   567 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.646140 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.643879 29468 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:33.640337 29546 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:33.651117 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.653813 29390 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:33.576485   479 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.663515 29391 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:33.664667 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:33.664966 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:33.678491   677 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:33.678720   590 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:33.680465   590 raft_consensus.cc:697] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:33.681775   590 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.651579   474 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.693533   474 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.625876   451 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:13:33.696990   697 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:13:33.654738   693 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.273s	user 0.000s	sys 0.002s
I20260709 13:13:33.708101   524 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.714236   575 raft_consensus.cc:3055] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:33.714965   575 raft_consensus.cc:740] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:33.732553 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:33.734855 29542 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:33.736837   680 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:33.655673   487 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:33.741243 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:33.745927 29465 raft_consensus.cc:2393] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 3: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:33.748066 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83477us
I20260709 13:13:33.717736   685 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:33.686290   612 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:33.755882   474 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:33.761924   673 consensus_queue.cc:1059] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:33.762425   474 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:33.763427   673 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:33.764048   673 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:33.763736   474 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.765370   673 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.809273 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:33.809325 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.786810   493 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:33.790362 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:33.792017 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:33.726190   671 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:33.796131 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.821377 29391 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:33.800211 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:33.755292   664 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.799s	user 0.005s	sys 0.010s
I20260709 13:13:33.805871 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.829458 29543 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:33.835491 29394 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:33.774320 29343 auto_rebalancer.cc:629] Failed to schedule move for tablet ef663d2174234a11995ce0c886e35150: Illegal state: Replica 7c2e8d3e55c649e2b3acedef25d81e16 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:33.810407 29389 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:33.810992 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:33.838411 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:33.826464 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:33.848198 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:33.849159 29543 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:33.856739 30158 raft_consensus.cc:2368] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:33.716215   575 consensus_queue.cc:260] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.858688 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:33.812768   648 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.864964 30160 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:33.820005   493 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:33.822989   612 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:33.835126   654 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:33.843425   487 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:33.843009   524 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:33.900974 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.878366 29469 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
W20260709 13:13:33.888852 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 57103.9us
I20260709 13:13:33.883705 29389 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:33.895445   596 consensus_meta.cc:287] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.678s	user 0.016s	sys 0.000s
I20260709 13:13:33.846678   664 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.846901   451 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:13:33.899534   493 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.921396   493 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:33.931305   705 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:13:33.892833   673 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:33.943393   706 log.cc:927] Time spent T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:33.908524   571 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:13:33.904222   654 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.957692   654 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:33.904350   655 consensus_meta.cc:287] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.614s	user 0.015s	sys 0.000s
I20260709 13:13:33.958564   675 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.958866   655 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.959408   675 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:33.960412 29537 raft_consensus.cc:2368] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:33.961867   655 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.911444 29546 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:13:33.964092 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:33.985229 30158 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:33.969625   664 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:33.971206   596 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.900292   620 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:33.974871   675 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:33.976362   549 consensus_meta.cc:287] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.500s	user 0.012s	sys 0.000s
I20260709 13:13:33.978130 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:33.907068 29438 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:33.885090 32763 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:33.994769 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 87793.4us
W20260709 13:13:34.018872 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.018076 29438 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:34.041235   479 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:34.034212   620 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.036819   664 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:34.036298   483 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:33.999348   549 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.049489   479 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.063081   479 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.064356 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:34.065044 29546 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:13:34.058250 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 268055us
I20260709 13:13:34.055615   664 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:34.087535   664 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.088287 32763 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.088117 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:34.090778 29541 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.092840 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:34.096089   549 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.097949   596 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:34.114142 29541 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:13:34.115466 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:34.073431 30126 leader_election.cc:336] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.123s (SENT)
I20260709 13:13:34.119225 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:34.123646 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 50251.7us
I20260709 13:13:34.125586 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:34.128499 29541 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.128890 30126 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:34.132301   702 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:13:34.136710 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:34.132488 29435 leader_election.cc:400] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
W20260709 13:13:34.132833   698 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.619s	user 0.002s	sys 0.000s
I20260709 13:13:34.137495 29538 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:34.138111 29435 leader_election.cc:403] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:34.149408   704 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:34.123401   596 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:34.151059 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:34.152798 29546 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:34.154735 29438 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:34.157745 29541 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:34.158039 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:34.164593 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:34.150924   665 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:34.151691   675 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.232084 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.159163   567 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:34.253405 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 89073.7us
I20260709 13:13:34.254491 29438 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:34.160105   704 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:34.162878   612 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.161051   596 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:34.266710   686 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.277182   686 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.280089   686 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:34.266978   638 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:34.280750 29538 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:34.281201   638 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.283879   638 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:34.166002 29435 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:34.286640 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 120772us
I20260709 13:13:34.286890   474 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:34.287379   474 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.287756   474 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.173225   654 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:34.296691 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:34.226676   603 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:34.304893 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:34.166762   714 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:34.263589   652 consensus_meta.cc:287] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.002s
I20260709 13:13:34.260608   567 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.298758   612 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.304605   482 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.314636   571 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:34.292014   707 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:34.348614 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:34.315384 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:34.353907 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:34.365420   483 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.366101   483 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:34.358131   479 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.340358   567 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:34.373003 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.315732   654 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:34.375766   654 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.370144   479 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.383746 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:34.385429 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.319367   719 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:13:34.257826   675 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.323086   685 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.407261   685 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.408864   675 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:34.409641   685 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.410328   707 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:34.411437   707 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.394598 29394 raft_consensus.cc:1240] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:34.345609   714 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:34.329312   612 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:34.404309 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59988.8us
I20260709 13:13:34.328461   482 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.439834 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:34.469307 29392 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:34.469700 29438 leader_election.cc:400] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:34.329715   596 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.443945 29543 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:34.394750   571 raft_consensus.cc:697] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:34.486158 29543 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:34.420912   704 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.481937   612 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:34.483234   714 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:34.495692 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 232418us
I20260709 13:13:34.490577 29543 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.498140 29543 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:34.501519 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 211960us
I20260709 13:13:34.470677   580 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.515412 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:34.516322 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:34.480096   493 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 3 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:34.522064 29391 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:13:34.523921 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:34.530423 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:34.532567 29395 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.532577 30159 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:34.536065 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:34.536931 29538 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.542128 29543 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:13:34.542759 29543 pending_rounds.cc:85] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 3
I20260709 13:13:34.543107 29543 pending_rounds.cc:107] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:13:34.543406 29543 raft_consensus.cc:2889] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:34.544121 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:34.544740 29390 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:34.500865   487 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.503211   603 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.559105 29544 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:34.565536 29390 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:34.548086 29543 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 3 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:34.530543   652 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.575960 30159 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:34.530619   524 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.501053   612 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.517797   664 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.503475   474 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.582482 29538 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:34.583531 29395 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:34.587828 30151 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:34.596472 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea2318003a42fea9088b490db583f1"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:34.597206 29467 raft_consensus.cc:606] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.598031 30151 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:34.599192 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:34.601143 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:34.604672 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.533840   580 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.563989   603 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.607470 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:34.637449 29538 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:34.569753   653 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.562744   487 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.634373   483 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.640103 29389 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:34.606731 29467 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:34.645619 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.647076 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.650090 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.655768 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:34.662267 29465 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:34.662405 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:34.663503 29469 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:34.666937 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:34.667838 29463 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:34.642328   679 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:34.654426   598 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.648556   653 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.670949   510 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:34.672945   653 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:34.673223   720 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:13:34.675097 32763 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:34.675642 32763 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.676584   580 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.591305   652 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.678812 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.680327 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.681185   686 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:34.681651 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.681876   686 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:34.669360   679 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.605909   581 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.634171   612 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:34.701635 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:34.591543   524 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.643265   657 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.648221   680 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.648034   655 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:34.575764   571 consensus_queue.cc:237] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.701862   598 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:34.721877   580 consensus_queue.cc:1059] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:13:34.726337   603 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:34.727766   482 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:34.728869   483 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.751510 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 496) took 1214 ms. Trace:
W20260709 13:13:34.729351   723 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:13:34.729059   567 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.682528   686 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:34.701622   679 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:34.719133   722 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:34.705816   676 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:34.747146 29540 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:34.708274   687 consensus_queue.cc:1059] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 13:13:34.718997   719 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:34.752043 29544 rpcz_store.cc:276] 0709 13:13:33.532475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.532686 (+   211us) service_pool.cc:224] Handling call
0709 13:13:34.746562 (+1213876us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54001a1154. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:34.746713 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102891264}
I20260709 13:13:34.717245   612 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:34.747776 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 109463us
I20260709 13:13:34.718091   654 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.771608   575 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:34.733552   657 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.709796   581 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.782421   524 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:34.770319   567 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:34.821002   581 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.830065 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 884) took 1025 ms. Trace:
I20260709 13:13:34.830529 30155 rpcz_store.cc:276] 0709 13:13:33.804424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.804585 (+   161us) service_pool.cc:224] Handling call
0709 13:13:33.836105 (+ 31520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.956197 (+120092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.956250 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:33.956315 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:33.956363 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.829777 (+873414us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54006419d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:34.829834 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.829989 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275373952}
I20260709 13:13:34.832752   657 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.818387   687 consensus_queue.cc:1243] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:13:34.816917   474 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.841042 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1920) took 1293 ms. Trace:
I20260709 13:13:34.841097   679 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:34.841856   729 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:13:34.841701 29542 rpcz_store.cc:276] 0709 13:13:33.547976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.738945 (+190969us) service_pool.cc:224] Handling call
0709 13:13:33.739357 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:33.740085 (+   728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.740130 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:33.747813 (+  7683us) log.cc:844] Serialized 52 byte log entry
0709 13:13:34.591707 (+843894us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b18004477c0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:13:34.746427 (+154720us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:34.760734 (+ 14307us) log.cc:844] Serialized 14 byte log entry
0709 13:13:34.762111 (+  1377us) log.cc:844] Serialized 14 byte log entry
0709 13:13:34.762457 (+   346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.762592 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:34.840761 (+ 78169us) raft_consensus.cc:1685] finished
0709 13:13:34.840794 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.840966 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7073,"prepare.queue_time_us":20820,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":3228,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":15427,"spinlock_wait_cycles":81865984,"thread_start_us":154477,"threads_started":1,"wal-append.queue_time_us":1061715}
I20260709 13:13:34.822566   654 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.843911   679 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:34.841213   664 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.859755   612 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.846091   654 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.878396   487 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:34.886523 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 185025us
I20260709 13:13:34.887727 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:34.889118 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:34.890817   612 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:34.891649   612 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:34.892084   612 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.892500   612 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:34.895339 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 77311.4us
I20260709 13:13:34.898679   741 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:34.907749   724 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.908413   724 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:34.910821   724 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:34.905367   612 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.899628 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:34.916496   741 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:34.916981   741 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:34.917436   741 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:34.938642   741 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:34.943473   612 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:34.943836   741 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:35.616653   737 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:35.617624   737 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:35.620571   737 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:36.101859   737 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.102828   737 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:36.105965   737 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.464282 29539 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:37.461426 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.466995 29544 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 3.
I20260709 13:13:37.456779   746 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.472296   746 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.478981   746 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.483855   746 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.486377   747 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.491454   747 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.496686   747 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.487466   746 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.512280   746 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.513230   746 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.514307   746 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.520327   746 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.506371   748 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.527984   748 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.531803   748 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.515872   747 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.536605   747 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.540218   747 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.542243   747 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.544960   747 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.533022   746 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:37.541225   748 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.551038   746 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.552596   748 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.554309   746 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.555101   746 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.555181 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.555934   746 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.556476   748 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.556681 29541 raft_consensus.cc:2410] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:37.560480   747 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.561605   747 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.562618   747 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.565842   747 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.557294   748 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.566995   748 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.568182   746 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.570643 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:37.572153 29467 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:37.573282 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.575282 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.576284   748 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.639739 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:37.644579   534 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:37.645864   534 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.648628   534 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.649148   534 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:37.650087   534 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.653460 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:37.654299 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.654515 29541 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:37.654688 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.653443   534 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:37.655721 30126 connection.cc:256] RPC call timeout handler was delayed by -1.534317351000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:13:37.656240   534 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:13:37.656426 30126 connection.cc:256] RPC call timeout handler was delayed by -1.5270082980002826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:13:37.656957 30126 connection.cc:256] RPC call timeout handler was delayed by -1.3840173510000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:13:37.656877 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.658078 29544 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:13:37.658882 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:37.658958 30126 connection.cc:256] RPC call timeout handler was delayed by -1.1176173510000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:13:37.659003 29541 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:13:37.659709 30126 connection.cc:256] RPC call timeout handler was delayed by -1.1176173510000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:13:37.657202   534 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.659983 29539 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:37.662752   534 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.662817 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:37.655755 29537 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:37.669929   534 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:37.671103   534 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.674139   534 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.686549   751 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:37.686609 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:37.688086   751 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.690785   748 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:37.691494   751 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:37.691774   747 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.692546   747 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.693446   751 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.694473   751 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.691569   748 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.697554   751 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:37.698202 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:37.698519 29463 raft_consensus.cc:1240] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:37.699743   751 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:37.700374   751 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.700908   751 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:37.703739   752 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:37.706650   752 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:37.707160   752 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.707667   752 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.709055 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.709784 29537 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 5.
I20260709 13:13:37.714035 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.714987 29539 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:37.688684 29512 connection.cc:256] RPC call timeout handler was delayed by -2.357924636000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:13:37.715588   751 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:37.716188 29512 connection.cc:256] RPC call timeout handler was delayed by -1.8935497249999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 13:13:37.716616 29512 connection.cc:256] RPC call timeout handler was delayed by -1.8860136480000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:13:37.717223 29512 connection.cc:256] RPC call timeout handler was delayed by -1.7904208189997917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:13:37.717645 29512 connection.cc:256] RPC call timeout handler was delayed by -1.3637562510000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:13:37.717958 29512 connection.cc:256] RPC call timeout handler was delayed by -1.251846617999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
I20260709 13:13:37.718106   751 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:37.718036   746 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.719286   751 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:37.719815   751 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.719545   746 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.720288   751 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:37.722249   746 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:37.721858   752 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.727056   752 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:37.730594   751 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.734721 30126 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:37.735407 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:37.735999 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:37.736670   747 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.737819 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:37.738654 29539 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.739789   752 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:37.699863   748 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.746619   487 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:37.747231   487 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.747717   487 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:37.748385   751 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:37.736191 29537 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:37.754978 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.052s	user 0.039s	sys 0.048s
I20260709 13:13:37.755607   451 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.740249   752 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:37.770757   752 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.759881 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:37.772631 29541 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:37.760953   451 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.761888 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:37.779482 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.076s	user 0.039s	sys 0.049s
I20260709 13:13:37.780040 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.781872 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.762964 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.782722 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:37.783643 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.763057 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:37.764160 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:37.765331 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.786989 29466 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:37.767635 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.788487 29470 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:13:37.780085 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 3.07689e+06us
I20260709 13:13:37.790000   487 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.791350 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:37.805516 29360 connection.cc:256] RPC call timeout handler was delayed by -1.9789400170000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:13:37.809150 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.810104 29466 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:37.812844 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.796310   748 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:37.815704 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.822247   487 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:37.822679 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.811940 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.833611 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.834831   754 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:37.835472 29544 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:37.835752   754 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.836756 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:37.837462 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.837729 29544 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:37.838971 29537 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:13:37.840041   755 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.842039 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.843144 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.843791 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.844442 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.842458 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:37.845242 29466 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
W20260709 13:13:37.846272 29493 debug-util.cc:398] Leaking SignalData structure 0x7b08003359a0 after lost signal to thread 28253
I20260709 13:13:37.844635 29544 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:37.846563   451 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.847232   451 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:37.847991   451 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.848105 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:37.849573 29544 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:37.849287   755 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.853420 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:37.854600   754 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:37.854681 29512 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:37.855468   754 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:37.856642 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 45053.6us
I20260709 13:13:37.856359   754 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:37.860241   679 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.825282   752 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:37.862993 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52869.7us
I20260709 13:13:37.864107 29539 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:37.853448   755 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:37.871583 29472 raft_consensus.cc:1240] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:37.872242 29541 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:37.873071 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 493) took 4341 ms. Trace:
I20260709 13:13:37.873391 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2517) took 3732 ms. Trace:
I20260709 13:13:37.873662 29540 rpcz_store.cc:276] 0709 13:13:33.531457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.534530 (+  3073us) service_pool.cc:224] Handling call
0709 13:13:34.746732 (+1212202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.812719 (+ 65987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.872434 (+3059715us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001a1150. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:37.872759 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786904704}
I20260709 13:13:38.000037 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:38.187083 29537 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:37.882974 29468 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:37.873836 29545 rpcz_store.cc:276] 0709 13:13:34.141059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.403728 (+262669us) service_pool.cc:224] Handling call
0709 13:13:34.404042 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.410824 (+  6782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.410857 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:34.410901 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:34.410929 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.872833 (+3461904us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b54002c6fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:37.872921 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.873153 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15044864}
W20260709 13:13:38.224589 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 366612us
I20260709 13:13:38.223598 30126 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:38.241874 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 55096.2us
I20260709 13:13:38.243949   487 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:38.245738   487 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:38.247399   487 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:37.877439   451 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.021041   752 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.244827 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:37.877084   754 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.128211   761 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:38.244642   755 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.258895 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:38.279605   679 consensus_queue.cc:1059] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:38.281005   679 raft_consensus.cc:3055] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:38.281411   679 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:38.282785   575 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:38.283455   575 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:38.284106 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:38.285020 29545 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.284796   724 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:38.284672   575 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.260298   451 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:38.261524   761 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.287942 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:38.288904 29541 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:38.290659   657 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.291003   451 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.291500   451 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.291548   657 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.260416   752 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:38.294214   752 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:38.296049   754 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.290148   761 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:38.296866   754 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.270143 29512 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:38.271018   590 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.298977   590 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.299455 29541 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:38.297753   761 raft_consensus.cc:3055] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:38.300127   761 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:38.301447   590 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.301358   761 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.302714   748 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:38.302971   761 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.303267   748 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.302881   451 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.303820   748 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:38.305126   679 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.306993   679 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.307042 29512 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:38.307982   755 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:38.309273 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.310212 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:38.310561   686 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:38.311012   686 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:38.311390   686 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:38.279206 29537 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:38.295648   752 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.268234   687 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.325645 29512 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:38.328667 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.341349   762 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.341763   654 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:13:38.342358   762 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.344072   451 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.348837   762 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.314671   612 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.350649   590 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.350917   612 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.351507   590 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:38.356055 29363 connection.cc:256] RPC call timeout handler was delayed by -1.8237073440000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:13:38.356588 29363 connection.cc:256] RPC call timeout handler was delayed by -1.7004073440000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:13:38.359100   451 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.359948   451 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.341455 32763 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:38.362295 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:38.365765 29284 maintenance_manager.cc:419] P 41140e47adf040c7a76a599e7698358d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.034205
I20260709 13:13:38.365797   654 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:38.367067   762 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.367882   762 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.368254   654 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:38.368706   687 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.369688   654 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.341162   598 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.395062   598 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.395778   762 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.354137   590 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.396982   754 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:38.371981 32763 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.374040   560 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:38.374166 29438 connection.cc:256] RPC call timeout handler was delayed by -2.1012214320001021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
I20260709 13:13:38.371454   687 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.383710   612 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.384526   755 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.385459   657 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.385983   748 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.386605   451 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:38.387858 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:38.393368   761 consensus_queue.cc:1059] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:38.397545   598 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.439178 32763 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.397696   679 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:38.439603   560 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.440688   679 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.372196   655 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.400868 29545 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:38.446456 30126 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:38.442021 32763 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:38.450671 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 125149us
W20260709 13:13:38.451375 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63671.5us
I20260709 13:13:38.442039   560 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:38.445369   612 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.445528   598 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:38.457906 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:38.463088 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:38.454932   487 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:38.457394   598 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.470842 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:38.464680   655 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.476349   679 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:38.477051   679 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.477730   679 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.469762   657 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:38.479025   657 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.479530   657 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:38.480154   679 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.480402 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:38.471258   598 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.481762   761 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:38.482244   761 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.482689   761 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:38.483433   748 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.473219 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:38.487556 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:38.472631   487 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:38.492619   487 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:38.496833   755 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:38.497442   755 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:38.497895   755 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.498255 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:38.478260   655 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.468626   686 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.473359   612 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.503990   768 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:38.506206 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:38.527724 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:38.529377 29390 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:38.533762   612 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.539250 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:38.540134 29392 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:38.542299 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:38.543254 29395 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:38.556589 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:38.558320 29392 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:38.566031   761 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.568908   761 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.581471 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:38.588304 29392 raft_consensus.cc:2410] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:13:38.595266 29395 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:38.594146   598 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:38.606835   598 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.615307   686 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:38.617835   652 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:38.704079 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:38.709743   755 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:38.926911 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:38.951135   771 log.cc:927] Time spent T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
W20260709 13:13:39.161438   772 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.458s	user 0.000s	sys 0.000s
I20260709 13:13:39.161913 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.162961 29392 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:13:39.345842   773 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:13:39.356010 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.357326 29390 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:39.421396 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:39.421784 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.422248 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.424137 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.425066 29394 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 4.
I20260709 13:13:39.432348 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.433346 29397 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:39.444527 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.445535 29388 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:39.446136 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.446611 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.447093 29396 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:39.447468 29388 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:39.448382 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.448632 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:39.449020 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.449514 29388 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:39.449441 29396 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:39.452915 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.449690 29397 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:39.500765 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.453758 29390 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:13:39.637051 29360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.132:38609 timed out after 1.774s (SENT) [suppressed 10 similar messages]
I20260709 13:13:39.698589 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.699985 29393 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:39.701272 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.702215 29394 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:39.703481 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.706030 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.715638 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.707427 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.723027 29392 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:39.723856 29394 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:39.765372 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:39.782070 29388 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:39.820508   755 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:39.845077 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 208088us
W20260709 13:13:39.853482 29360 leader_election.cc:336] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Timed out: RequestConsensusVote RPC to 127.27.150.132:38609 timed out after 1.528s (SENT)
I20260709 13:13:39.854138 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:39.876195   765 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 1.353s	user 0.005s	sys 0.022s
I20260709 13:13:39.876606 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:39.883693 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:39.897923   774 log.cc:927] Time spent T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 1.192s	user 0.004s	sys 0.017s
I20260709 13:13:39.905678   638 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:39.917022   638 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:39.913379 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.923419   638 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:39.929352   552 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:39.913332   776 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:39.930141   552 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:39.932885   552 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:39.933447 29435 connection.cc:256] RPC call timeout handler was delayed by -3.8175191390000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 13:13:39.933985 29435 connection.cc:256] RPC call timeout handler was delayed by -3.7923191390000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 13:13:39.937072   552 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.937564 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 1.47113e+06us
I20260709 13:13:39.937731   552 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:39.940528   552 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:39.934305 29435 connection.cc:256] RPC call timeout handler was delayed by -3.7923191390000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 13:13:39.943981   776 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:39.944032 32763 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.949313 32763 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:39.952010 32763 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:39.954860   777 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.957291   777 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:39.955355   638 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:39.955721   776 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:39.946832   552 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.947633 29435 connection.cc:256] RPC call timeout handler was delayed by -3.7467592750001586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260709 13:13:39.977068   638 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:39.967406 29512 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:39.978240   776 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:39.969791 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:39.980086   675 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.945502   596 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:39.990609 29391 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:39.991681   675 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:39.993278   657 consensus_meta.cc:287] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.513s	user 0.019s	sys 0.003s
I20260709 13:13:39.993985   657 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:39.996341   596 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:39.996878   596 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:40.000399   776 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.002635   638 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:39.959462 32763 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:40.008132 32763 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.013260 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 1930) took 2554 ms. Trace:
I20260709 13:13:40.016003   675 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:40.016721   675 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:39.996932   657 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.017338   675 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.018646 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.019593 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.013680 29538 rpcz_store.cc:276] 0709 13:13:37.459061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.301197 (+842136us) service_pool.cc:224] Handling call
0709 13:13:38.301634 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.302215 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.302258 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.302963 (+   705us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.401944 (+ 98981us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:38.402005 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.402110 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.875381 (+1473271us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:40.012707 (+137326us) raft_consensus.cc:1685] finished
0709 13:13:40.012756 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.013017 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":16744832,"thread_start_us":98489,"threads_started":1,"wal-append.queue_time_us":163657}
I20260709 13:13:40.020897 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.020990 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.019698 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:39.978960 29435 connection.cc:256] RPC call timeout handler was delayed by -3.6999592750000829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:13:40.022655 29435 connection.cc:256] RPC call timeout handler was delayed by -3.6933191390000957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:13:40.022807 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:40.023025 29435 connection.cc:256] RPC call timeout handler was delayed by -3.64021913900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 13:13:40.023145 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.023945 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.024315 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.025086 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.050901   603 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:40.051102 29471 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:40.051471 29435 connection.cc:256] RPC call timeout handler was delayed by -3.64021913900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 13:13:39.998704   777 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:40.051869 29435 connection.cc:256] RPC call timeout handler was delayed by -3.604219139000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 13:13:40.025722 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:40.052251 29435 connection.cc:256] RPC call timeout handler was delayed by -3.5763191390001339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:13:40.052557 29469 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:40.025765 32763 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:40.031729 30126 leader_election.cc:336] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.522s (SENT)
I20260709 13:13:40.053380   779 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.027173 29543 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:40.034104 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:40.054730 30123 connection.cc:256] RPC call timeout handler was delayed by -3.5304928540001583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:13:40.055157 30123 connection.cc:256] RPC call timeout handler was delayed by -3.5300555270000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:13:40.055469 30123 connection.cc:256] RPC call timeout handler was delayed by -3.5219555270000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:13:40.055806 30123 connection.cc:256] RPC call timeout handler was delayed by -3.2555555270000696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:13:40.055894 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.056288 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.057341 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.033344   638 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.058208 29543 raft_consensus.cc:2410] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:13:40.054028   779 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.064071   779 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.042259 29538 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.051702   603 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.058359   638 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.058858 29546 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:40.022269   552 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.041764   596 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.060039 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.048229   675 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.064953   778 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.068290 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.081415 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.069501   685 raft_consensus.cc:3055] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:40.070962 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.071245 29543 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:13:40.052585 29435 connection.cc:256] RPC call timeout handler was delayed by -3.5763191390001339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:13:40.073184 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.075426 29391 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:40.116627 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.087278   685 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:40.095978   675 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.084954 29394 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:13:40.135013 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1972) took 1616 ms. Trace:
W20260709 13:13:40.133646 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.082849 29540 raft_consensus.cc:2410] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:13:40.134214 29435 connection.cc:256] RPC call timeout handler was delayed by -3.5091592750002292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
I20260709 13:13:40.130519 29546 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:40.134768 29538 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:13:40.137743 29435 connection.cc:256] RPC call timeout handler was delayed by -3.49981913900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:13:40.138094 29435 connection.cc:256] RPC call timeout handler was delayed by -3.49981913900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:13:40.138365 29435 connection.cc:256] RPC call timeout handler was delayed by -3.3936191390000658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:13:40.138662 29435 connection.cc:256] RPC call timeout handler was delayed by -3.3936191390000658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:13:40.138904 29435 connection.cc:256] RPC call timeout handler was delayed by -3.3099191390001579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 13:13:40.139382 29435 connection.cc:256] RPC call timeout handler was delayed by -3.3099191390001579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 13:13:40.139679 29435 connection.cc:256] RPC call timeout handler was delayed by -2.4504191390001324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3098s for a response
I20260709 13:13:40.139755   552 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:40.140089 29435 connection.cc:256] RPC call timeout handler was delayed by -1.6323191390001739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4007s for a response
I20260709 13:13:40.137015 29391 rpcz_store.cc:276] 0709 13:13:38.518740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.969242 (+1450502us) service_pool.cc:224] Handling call
0709 13:13:40.134934 (+165692us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:40.140475 29435 connection.cc:256] RPC call timeout handler was delayed by -1.6323191390001739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4007s for a response
W20260709 13:13:40.124181 30126 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.689s (SENT)
I20260709 13:13:40.130519   778 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:40.143210 30126 leader_election.cc:336] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.800s (SENT)
I20260709 13:13:40.143708 30126 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:40.145130   778 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:40.116905 29468 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:13:40.146401 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.146672 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:40.147639 29469 raft_consensus.cc:606] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:40.121352   638 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.149538   638 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.085670   779 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:13:40.136687 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 105476us
I20260709 13:13:40.145779   778 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:40.138824   780 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.177110 29538 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:40.124347   603 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.140261   685 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:40.179184 29542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 508) took 2722 ms (client timeout 1985 ms). Trace:
I20260709 13:13:40.150228   638 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.206822 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:40.207541 29545 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:40.186900 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.179349   685 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:40.179702 29542 rpcz_store.cc:269] 0709 13:13:37.456906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.178768 (+2721862us) service_pool.cc:211] Skipping call since client already timed out
0709 13:13:40.178970 (+   202us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:13:40.179529   603 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:40.212620   598 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.213989   598 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.182644   675 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.215740   638 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.216220   598 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:40.218909   598 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:40.219265 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.219434   598 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.221700   598 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.221745 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.222545 29471 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:40.222289   598 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:40.223717 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.224258   598 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.211552 30123 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:40.227077 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 90669.7us
I20260709 13:13:40.227936 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:40.229316 30123 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:40.184561 29469 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:40.179422   778 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:40.244771 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.226572   598 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:40.235232 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.250810 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.236500   575 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:40.237082 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 269808us
I20260709 13:13:40.251459 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.251492   575 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.253178   575 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.238382 29544 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:13:40.235761   780 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.239830   509 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:40.242324   675 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:40.246603 29362 connection.cc:256] RPC call timeout handler was delayed by -4.5348071109999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:13:40.247288 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.248080   451 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.248626   777 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.249184   603 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:40.274540   652 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.275286   638 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.275820   638 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.275509   652 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.276268   638 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.246615 29471 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:40.281625   653 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:40.283375   653 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.234373 29545 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:40.260571 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.294243 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.294579 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.294798   653 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.295358   653 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.295441 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.296108 29465 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:40.295902   653 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.296360   575 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.297755 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:40.264457 29493 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea520 after lost signal to thread 29329
I20260709 13:13:40.265090 29466 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:40.299129 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.299463 29396 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:13:40.299923 29493 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2640 after lost signal to thread 29421
W20260709 13:13:40.300239 29493 debug-util.cc:398] Leaking SignalData structure 0x7b080038b260 after lost signal to thread 29422
I20260709 13:13:40.300279 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.301528 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:40.301779 29493 debug-util.cc:398] Leaking SignalData structure 0x7b0800339aa0 after lost signal to thread 29496
W20260709 13:13:40.302119 29493 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec1e0 after lost signal to thread 29497
I20260709 13:13:40.269304   777 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.304417   777 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.271785   451 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.303344 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.250607   778 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.287432 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.286064   664 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:40.307219 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.288954 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.308820 29471 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:40.309166 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.310201 29393 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:40.315344 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.316028 29466 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:40.316515 29393 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:40.290803 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.288885 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.316967 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.292189   652 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.261883   780 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.306497 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 529) took 1942 ms. Trace:
I20260709 13:13:40.306792   451 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.274636   603 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.365484   603 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.287771 29390 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 3 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:40.309345 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.288640 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.289767 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.290526 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.184880   779 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:40.321199 30126 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.985s (SENT)
W20260709 13:13:40.323261 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58391.4us
I20260709 13:13:40.336603 29471 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:40.358069 29541 rpcz_store.cc:276] 0709 13:13:38.364016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.364237 (+   221us) service_pool.cc:224] Handling call
0709 13:13:38.364778 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.448423 (+ 83645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.448473 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.452955 (+  4482us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.527372 (+ 74417us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:38.528174 (+   802us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.528636 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.528945 (+   309us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.543375 (+ 14430us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b48001c1658. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ed8caaa1 00007f61ed8c1b37 00007f61ed8c19ca 00007f61ed9b926f 00007f61ed9b8f37 00007f61ed9cd55c 00007f61ed9cd508 00007f61ed9cd488 00007f61ed9cd443 00007f61ed9cc6ec 00007f61ec8f6a96
0709 13:13:40.306128 (+1762753us) raft_consensus.cc:1685] finished
0709 13:13:40.306261 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.306407 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":201,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":102536,"raft.run_cpu_time_us":3320,"raft.run_wall_time_us":75622,"spinlock_wait_cycles":26219904,"thread_start_us":132806,"threads_started":2,"wal-append.queue_time_us":104722,"wal-append.run_cpu_time_us":4040,"wal-append.run_wall_time_us":1603134}
I20260709 13:13:40.368589 29392 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.359738 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:40.368511 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45681.1us
I20260709 13:13:40.379438 29466 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:40.380898   777 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:40.381423 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:40.383376   777 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:40.383805   777 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.384188   777 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:40.384370 29438 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:40.387326   664 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:40.387751   535 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:40.388697   665 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:40.387760   664 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.392429   664 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.388731   571 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:13:40.394412 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:40.398741 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.401582 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:40.405260 29493 debug-util.cc:398] Leaking SignalData structure 0x7b080032be80 after lost signal to thread 29570
W20260709 13:13:40.405673 29493 debug-util.cc:398] Leaking SignalData structure 0x7b08003af780 after lost signal to thread 29571
I20260709 13:13:40.405848 29395 raft_consensus.cc:2410] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:40.323568   653 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:40.405712 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 137880us
I20260709 13:13:40.410634 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.411404   535 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:40.364367   575 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.424467 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:40.425302 29493 debug-util.cc:398] Leaking SignalData structure 0x7b08003332a0 after lost signal to thread 30184
I20260709 13:13:40.432343 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:40.402108   560 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:40.439709 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.440619 29463 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:13:40.440559 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 67389.1us
I20260709 13:13:40.376165   652 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:40.407469   451 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:40.378711   780 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:40.444021 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 122876us
I20260709 13:13:40.409502   675 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.411820   535 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:40.450042   571 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:13:40.444216   755 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:40.452507 29472 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:40.452951   755 raft_consensus.cc:697] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:40.453372   580 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:40.453863   580 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.454276   580 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:40.454068   755 consensus_queue.cc:237] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:40.454937 29509 connection.cc:256] RPC call timeout handler was delayed by -1.4711660469997696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:13:40.455525 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3766660469998442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260709 13:13:40.455886 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3676660469998296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:13:40.456164 29509 connection.cc:256] RPC call timeout handler was delayed by -1.3163660469997467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:13:40.456429 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2956660469997132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:13:40.456717 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2874019309997493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:13:40.457047 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2874019309997493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:13:40.457211 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2308660469998358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:13:40.457358 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2220639869997285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:13:40.457505 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2166953259998081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:13:40.457648 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2029660469997907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 13:13:40.457793 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2029660469997907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 13:13:40.460074 29394 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:40.443740   369 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.462918 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.463833 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.462571   598 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.472805 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.442761   560 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:40.444525   785 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.444665   451 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:40.459229   676 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.482786   452 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:13:40.472604   535 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.484927   784 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.486227 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.487567 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.615367 29391 raft_consensus.cc:2393] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:40.481184 30126 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:40.616798 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 135700us
I20260709 13:13:40.486739 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.505466 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.615463 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:40.516175   596 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:40.540158   680 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.560124 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.569020 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:40.576166 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2348) took 6054 ms. Trace:
I20260709 13:13:40.579782 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.579901 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:40.624284 29539 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.595424 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:40.625515 30155 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.598941 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:40.616859 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 138877us
I20260709 13:13:40.462872   369 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:40.614252 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.489732   451 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.456640   780 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.644829 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.458743   675 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.596231 30157 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.628242 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.629662 30154 raft_consensus.cc:2410] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:40.631574   778 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:40.632462   560 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.623662 29389 rpcz_store.cc:276] 0709 13:13:34.521153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.521310 (+   157us) service_pool.cc:224] Handling call
0709 13:13:34.521639 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.640467 (+118828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.570123 (+5929656us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001c5cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:40.575856 (+  5733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271890816}
I20260709 13:13:40.618377 29541 raft_consensus.cc:2376] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7. Re-sending same reply.
I20260709 13:13:40.638371 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.639297 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.640556 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.477355   652 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.659871 29396 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:40.476496   598 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.664920 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.648555 29540 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:40.474647   571 consensus_queue.cc:1059] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 13:13:40.660935 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.659017 30158 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 11: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:40.659650 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.623200   575 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.666409 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:40.663290 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 194328us
I20260709 13:13:40.635305   369 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.672163 29472 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:40.673362 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.679111 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.680086 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.654605   535 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.704483 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.495844   676 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.680962   779 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.489614   785 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.683493 29467 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:40.679147 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.684434 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:40.715986 29509 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:40.703883 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.718891 29546 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:40.703410 30152 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:40.678409 30123 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:40.714308 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.629071   784 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.722196 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:40.656131   654 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:13:40.727520 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.720522 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:40.677003   575 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:40.715009 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.726480 29509 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:40.723222 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 46476.5us
I20260709 13:13:40.714347 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.728385 29472 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:40.742081 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.731169 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:40.743433 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65160.6us
I20260709 13:13:40.714546   560 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:40.751078 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.734769 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:40.748661 29393 raft_consensus.cc:1240] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:40.661267   680 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.765709 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.766134 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.766645 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.732035   778 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:40.744263   575 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.769765 29391 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:40.770553 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.770943 29541 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:40.747816   655 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:40.774473 30154 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:40.780227 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.777537 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.768747 30151 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:40.786882 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.788578 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.791931 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.793465 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:40.789125 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 54769.9us
I20260709 13:13:40.798596 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.794363 29389 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:40.792896 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.789502 30159 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:40.773672   778 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.801003 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.799223 29391 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:13:40.804105 29467 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:40.803469 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.802326 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.806218 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.806630 29539 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:40.806896 29469 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:40.807858 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133108182cae493ab908290bfa9179d1"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:40.808403 29469 raft_consensus.cc:606] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:40.810086 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.810951 30154 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:40.812096 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:40.779762   655 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.815297 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.816135 29389 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.817044 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.818754 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.814077 32204 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.145s
I20260709 13:13:40.821264   704 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:40.821718   704 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.822083   704 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:40.827863   791 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:40.828462   791 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.828614   680 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:40.828943   791 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:40.829677 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:40.830675 29418 debug-util.cc:398] Leaking SignalData structure 0x7b0800105580 after lost signal to thread 28253
I20260709 13:13:40.830960 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.831624 30154 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:40.832427 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.791982   509 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:40.841930   665 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:40.833559 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.836997 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.836210   784 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.841106   598 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:40.847293 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.835095 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:40.847987 29418 debug-util.cc:398] Leaking SignalData structure 0x7b080008f920 after lost signal to thread 29329
I20260709 13:13:40.849275 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.852456 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:40.876569 29467 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:13:40.860440 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:40.878357 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.810381   778 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.798854   796 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:40.882711 29391 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:40.879400 29397 raft_consensus.cc:2376] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7. Re-sending same reply.
I20260709 13:13:40.842729   655 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:40.891170 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 77777.8us
I20260709 13:13:40.892442 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:40.893767   796 raft_consensus.cc:697] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:40.894001   793 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.895956 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.895303   796 consensus_queue.cc:237] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.854646   665 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:40.907634 29397 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:40.917654 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.918509 30158 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:40.924401 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.929800 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.930747 30158 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:40.932365   598 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:40.920997   685 consensus_meta.cc:287] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.705s	user 0.014s	sys 0.000s
I20260709 13:13:40.908145   793 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:40.875135   509 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:40.946686   676 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:40.935511 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:40.952056 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:40.926265   777 consensus_meta.cc:287] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 13:13:40.891312 29392 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:40.960304 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:40.963589 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:40.964720 29537 raft_consensus.cc:2410] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:40.927100   755 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:40.970067   755 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:40.940272 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:40.934170   598 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:40.971222 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.981258 29392 raft_consensus.cc:2376] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7. Re-sending same reply.
I20260709 13:13:40.972296   680 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:40.972723 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:40.984117 29397 raft_consensus.cc:2376] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5. Re-sending same reply.
W20260709 13:13:40.984856 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 49437us
I20260709 13:13:40.985117 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:40.973085   598 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.988252 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:40.989118 30157 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:40.985908 29360 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:40.985134 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44965us
I20260709 13:13:41.004137 29391 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:41.004618 29391 pending_rounds.cc:85] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 3
I20260709 13:13:41.005928 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:41.008553 29389 raft_consensus.cc:2410] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:13:41.014300 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.020054 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.020990 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.009069 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:41.004858 29391 pending_rounds.cc:107] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:13:41.024708 29391 raft_consensus.cc:2889] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:41.003212   676 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:41.054566   796 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:41.055192   796 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:41.055708   796 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:41.051949 29392 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:41.059238   808 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:41.060146   808 consensus_queue.cc:1059] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:41.060745 29392 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:41.048586 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.063266 30158 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
W20260709 13:13:41.051939   603 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.686s	user 0.013s	sys 0.001s
I20260709 13:13:41.005524   777 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.079387 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:41.080562 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 67392.2us
W20260709 13:13:41.067829   580 consensus_meta.cc:287] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.002s
I20260709 13:13:40.950399   793 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.974330   785 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.045506 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:41.084421 29390 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.007s
I20260709 13:13:41.017863   680 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:41.102885 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.104506 29394 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.103379 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.101660 30160 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:41.113044 30155 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:41.127481 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 82137.9us
I20260709 13:13:41.129168 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:41.131711 29394 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:13:41.100554   664 consensus_meta.cc:287] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.005s
W20260709 13:13:41.112468   638 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.836s	user 0.014s	sys 0.002s
I20260709 13:13:41.106285   784 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.090915   755 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.104259   777 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.115129   680 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.145466 30158 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:41.016010   665 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.089815   580 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.086251   603 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.149197 30155 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:41.151473 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:41.151914 29360 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:41.156203   655 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.157215   524 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.158039   524 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:41.158835   524 consensus_queue.cc:1243] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer c65265f20d7e42b6bfe314c5d109bdf7 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:41.137982   664 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:41.163628 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08000983c0 after lost signal to thread 29421
W20260709 13:13:41.164047 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc0c0 after lost signal to thread 29422
I20260709 13:13:41.164484   664 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.165391 29471 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:41.146642   680 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.143278   638 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.172077   638 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:41.172281   451 consensus_meta.cc:287] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.004s
I20260709 13:13:41.172766   685 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:41.173439 30153 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.174364   665 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:41.191999   685 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:41.174751 30156 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:41.176105   575 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.176565   780 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.169443 29360 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:41.183068 29388 raft_consensus.cc:2368] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:41.187458   369 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.196319 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.193946 29465 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:13:41.199283   580 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.196472   596 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:41.193234   685 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.200614   780 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:41.200963   685 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:41.201294   780 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.200687   575 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:41.201772   787 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.549s	user 0.002s	sys 0.000s
I20260709 13:13:41.201792   780 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.205684   778 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:41.210122 29418 debug-util.cc:398] Leaking SignalData structure 0x7b0800380d20 after lost signal to thread 29496
W20260709 13:13:41.210529 29418 debug-util.cc:398] Leaking SignalData structure 0x7b0800380ee0 after lost signal to thread 29497
I20260709 13:13:41.211265   778 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.145020   784 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.212327   598 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.213639   784 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:41.212042 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08003df8c0 after lost signal to thread 29570
W20260709 13:13:41.215675 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa200 after lost signal to thread 29571
I20260709 13:13:41.216177   369 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:41.217533 29418 debug-util.cc:398] Leaking SignalData structure 0x7b080019e0c0 after lost signal to thread 30184
I20260709 13:13:41.218109 30154 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.198101   451 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.208920   704 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:41.218899 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08002e16a0 after lost signal to thread 712
W20260709 13:13:41.236943 29418 debug-util.cc:398] Leaking SignalData structure 0x7b0800267000 after lost signal to thread 713
W20260709 13:13:41.237275 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa380 after lost signal to thread 714
W20260709 13:13:41.237584 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08003670c0 after lost signal to thread 724
W20260709 13:13:41.237820 29418 debug-util.cc:398] Leaking SignalData structure 0x7b08003c42c0 after lost signal to thread 726
I20260709 13:13:41.223191   675 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.224694 30158 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:41.227432   791 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.228197 30156 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.228639   655 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.207141   603 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.246196 30155 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:41.246115 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 117030us
I20260709 13:13:41.247210 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:41.232398 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 63110.2us
I20260709 13:13:41.240216 29464 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:41.250754 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:41.250262 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:41.257485 29391 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:41.307816 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:41.310778 30159 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 12: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:41.311201 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 64035.2us
W20260709 13:13:41.318780 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 68054.7us
I20260709 13:13:41.321312 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:41.244395   580 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:41.336949 30151 raft_consensus.cc:2368] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:41.342041 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:41.343214 29395 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:41.312337 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:41.377162 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 57169.5us
I20260709 13:13:41.347020 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:41.379812 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:41.251730   524 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:41.336732 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:41.382334   755 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.394007   818 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:41.394654   818 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.394352   755 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.395094   818 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:41.396878   755 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.397432   776 consensus_queue.cc:1059] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:41.398734   819 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:41.398540   524 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.399233   819 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.399557   777 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.399688   819 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.400130   777 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.401204   524 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.402046   655 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:41.402315   777 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.404165   704 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.404711   590 consensus_queue.cc:1059] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:41.405493   590 consensus_queue.cc:1243] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer c65265f20d7e42b6bfe314c5d109bdf7 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:41.405953   590 raft_consensus.cc:3055] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:41.406266   590 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:41.407272   590 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.408653   590 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.383970   778 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:41.409250 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.409643   778 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.410084   778 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.410844 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:41.411588 30155 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:41.377074   598 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.412994   776 raft_consensus.cc:3055] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:41.413439   776 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:41.414324   776 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.415686   776 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.334146   784 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:41.417373 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:41.420166 29390 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.424430   680 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.447885 29390 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:41.428743   793 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.430712   451 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.432327   784 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.435001   509 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.457067 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:41.435612 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.439116 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:41.442968 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1902) took 1068 ms. Trace:
I20260709 13:13:41.458776 29471 rpcz_store.cc:276] 0709 13:13:40.374874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.409615 (+ 34741us) service_pool.cc:224] Handling call
0709 13:13:41.442717 (+1033102us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b540035be54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:41.442877 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660922624}
I20260709 13:13:41.449167 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:41.451997 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:41.459753 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.452669 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:41.452854 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:41.456866 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:41.459576 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.461823 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:41.460884 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 81151.7us
I20260709 13:13:41.463383 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:41.462747 29395 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:41.464277 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.467083 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:41.469028 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.469858 29463 raft_consensus.cc:2393] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:41.470677 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.471308 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.471944 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.473104 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.473639 29470 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.474730 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.474838 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.475152 29395 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:41.475498 29469 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:13:41.476444 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.447499   791 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.455835   784 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.478869 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:41.479305 30123 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:41.479516 29396 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:41.480849   788 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:41.481251   788 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.476459 29395 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.475556 29472 raft_consensus.cc:2368] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:41.484261 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:41.481618   788 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:41.485893   791 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:41.488302 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.489091 29466 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:41.490059 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.490649   675 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:41.454581   796 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.493940   638 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:41.494670   780 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.498885 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.487046 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:41.503916 29469 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:13:41.500558 29466 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:41.517483 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.521951 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.522258 29472 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:41.516453 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:41.524088 29390 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:41.503595   675 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.528390 29467 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:41.529438 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.531330 29471 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:41.534143 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.537868 29539 raft_consensus.cc:1240] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:41.523242   598 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:41.539991   598 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.540372   598 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:41.540397 29538 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:13:41.534262 30126 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:41.543262 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:41.544204 30126 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:41.545462 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.545910 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.545058 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:41.546799 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.547254 29543 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:41.547865 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.548616   452 raft_consensus.cc:3055] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:41.552255 29545 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:41.552855 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:41.554379   652 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:41.554796 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:41.555464 29537 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:41.555855 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.555887 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36866 (request call id 1997) took 1092 ms. Trace:
I20260709 13:13:41.580190 29541 raft_consensus.cc:2410] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:41.558008   784 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.560189   780 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.531200   675 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:41.563582 29471 raft_consensus.cc:1275] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:41.564842 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.023s	sys 0.017s
I20260709 13:13:41.527618   638 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:41.605635   638 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.606267 29546 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.567570 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.608747 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.571417   575 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:41.609408   575 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.609815   575 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:41.609575 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.572234 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.571277 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.571277 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:41.616878 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 131984us
I20260709 13:13:41.573318 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2554) took 1090 ms. Trace:
I20260709 13:13:41.574649   603 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:41.576721 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.546993 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.555351   791 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.583662 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.578884 29472 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:41.531554   778 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.584563   452 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:41.585233 29512 leader_election.cc:400] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:41.585582 29392 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:41.631163 29512 leader_election.cc:403] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:13:41.632377 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 47305.6us
I20260709 13:13:41.587524   653 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:41.587774 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 71427.8us
I20260709 13:13:41.636416 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:41.588917 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:41.590085 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.637866 29469 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:41.587591   796 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.590754   680 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.579655 29540 raft_consensus.cc:2376] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7. Re-sending same reply.
I20260709 13:13:41.580461 29394 rpcz_store.cc:276] 0709 13:13:40.463150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.463557 (+   407us) service_pool.cc:224] Handling call
0709 13:13:41.555646 (+1092089us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54000e6ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:41.555787 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471765888}
I20260709 13:13:41.594506 29396 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:13:41.595471 29470 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
W20260709 13:13:41.604219 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.023s	sys 0.017s
I20260709 13:13:41.539309   793 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:41.603430 29438 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:41.620967 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:41.574440   822 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:41.625420 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49108 (request call id 909) took 1016 ms. Trace:
I20260709 13:13:41.606289   784 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.629185 29467 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.585927   655 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:41.634070 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:41.652613 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 664846us
W20260709 13:13:41.661610 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 68180.7us
I20260709 13:13:41.619285 29544 rpcz_store.cc:276] 0709 13:13:40.482638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.484557 (+  1919us) service_pool.cc:224] Handling call
0709 13:13:40.484926 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.677158 (+192232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:40.917022 (+239864us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.334357 (+417335us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b1800276ee0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e854123a
0709 13:13:41.334638 (+   281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.334705 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:41.334760 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.573067 (+238307us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54000f3cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:41.573133 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.573255 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9374,"prepare.queue_time_us":355703,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":1179,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":8321,"spinlock_wait_cycles":474833024,"thread_start_us":371119,"threads_started":2,"wal-append.queue_time_us":272322}
I20260709 13:13:41.625056   603 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:41.655823 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:41.667092 30160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 584) took 1032 ms. Trace:
I20260709 13:13:41.658762 30152 rpcz_store.cc:276] 0709 13:13:40.609487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.675927 (+ 66440us) service_pool.cc:224] Handling call
0709 13:13:41.625198 (+949271us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54006400d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:41.625356 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37661952}
I20260709 13:13:41.590256   818 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.667506 30160 rpcz_store.cc:276] 0709 13:13:40.634405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.137203 (+502798us) service_pool.cc:224] Handling call
0709 13:13:41.625454 (+488251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.651630 (+ 26176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.651660 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.658032 (+  6372us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:41.658092 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.658168 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.666895 (+  8727us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54006400d0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:41.667026 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106781440}
I20260709 13:13:41.642766   780 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:41.655673 29464 raft_consensus.cc:2393] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 4: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:41.635949   653 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:41.688059 32204 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:41.689184 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 55204.2us
I20260709 13:13:41.691745 29512 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:41.671052   603 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:41.670781   680 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:41.671509   535 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:41.714628 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:41.675096   596 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:41.720278 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:41.694036   653 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:41.678195   655 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:41.732295 29467 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:41.657640   794 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:13:41.698415   784 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:41.738613 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 102311us
I20260709 13:13:41.779043   784 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.779582   784 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:41.779683 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:41.772867 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 58767.5us
W20260709 13:13:41.773451 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 61321us
I20260709 13:13:41.666375   487 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:13:41.781632   487 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:41.782037   487 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:41.783034   487 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.784349   487 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.668322   819 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.787114 29541 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.708065   793 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:41.774786 30126 leader_election.cc:336] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.564s (SENT)
I20260709 13:13:41.788151   793 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.788566   793 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.725422 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:41.693639   788 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:41.798074   793 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.798266 29542 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:41.777693 29363 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:41.800591   793 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:41.731458   796 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:41.804972 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:41.805962   479 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:13:41.759553   794 consensus_queue.cc:1243] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer 88760af579b54a6393c6251aa3c6b870 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:41.808555 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:41.703306   452 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:41.882058 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 73593.3us
W20260709 13:13:41.917187 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.923619 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 156245us
I20260709 13:13:41.731508   571 consensus_queue.cc:1059] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:13:41.760288   535 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:42.077236 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 296056us
I20260709 13:13:41.809383 32204 consensus_queue.cc:1059] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:41.665622   822 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:41.812160   790 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.805466   796 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.811018 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:41.811013   596 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:41.968021   655 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.081008   819 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:42.082914   803 consensus_queue.cc:1059] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:13:42.085933 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 304747us
I20260709 13:13:41.812480   451 raft_consensus.cc:2764] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:13:42.077889   590 consensus_queue.cc:1048] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:13:42.097781 29512 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:42.098024 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:42.076004   793 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.117672 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:42.122010   451 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:42.099973   828 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.141676 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:42.114162   796 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:42.123797 29283 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.568s	user 0.004s	sys 0.034s
W20260709 13:13:42.124696   675 consensus_meta.cc:287] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.017s
I20260709 13:13:42.116111   788 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:42.127055   590 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:42.126413   596 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:42.138578   571 consensus_queue.cc:1243] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer 7c2e8d3e55c649e2b3acedef25d81e16 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:13:42.182276   590 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.132272   680 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:42.170579   787 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:13:42.115981   790 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.188649 32204 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:42.182991   560 consensus_queue.cc:1059] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:13:42.196015   560 raft_consensus.cc:3055] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:42.196507   560 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:42.198553 30123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.016s	sys 0.041s
I20260709 13:13:42.147698   778 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:42.199008 30123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.016s	sys 0.041s
I20260709 13:13:42.184477   590 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.131381   821 consensus_queue.cc:1059] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:13:42.146905   451 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.186657   780 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
W20260709 13:13:42.200284 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 539212us
I20260709 13:13:42.208280 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:42.177364   675 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.143075   784 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.222112 30123 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:42.197552   831 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:42.197662   828 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:42.180860   535 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:42.232546 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 90947us
I20260709 13:13:42.193231   803 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:13:42.233325 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.219035   788 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:42.238474 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.198833   680 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:42.214771 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 403845us
I20260709 13:13:42.241766 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:42.235476 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.236306 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:42.237126 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:42.242689 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 110784us
I20260709 13:13:42.247399 29464 raft_consensus.cc:3055] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:42.247991 29464 raft_consensus.cc:740] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.205176   603 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.253497 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.230834   816 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:42.255025 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.228425   831 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:42.259475 29467 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.262687 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.223166   794 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:13:42.267684 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.263429 29541 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:42.203873   560 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.276042 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.276537 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:42.264652   575 consensus_meta.cc:287] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.011s
I20260709 13:13:42.277068 29546 raft_consensus.cc:2393] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.277397 29544 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.260056   657 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:42.274827 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.278669   657 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:42.279721   657 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.280797   790 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:42.282229   822 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:42.284098   816 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:42.283301 29292 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 4 to 5, leader changed from <none> to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:42.285241   816 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.277405   575 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.265405   831 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:42.288134   575 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:42.253039   817 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:42.292225   817 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.254760   596 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.293125   675 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:42.294380   653 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.000s
I20260709 13:13:42.294960   653 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:42.296252   598 consensus_meta.cc:287] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.006s
I20260709 13:13:42.296756   598 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.297047   680 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.276748   560 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:42.313695 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.314805   603 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:42.315163 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:42.315809 29540 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:42.316082   784 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:42.316144 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.317031 29537 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.317974 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:42.319307   653 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:42.320317   598 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:42.267360 29539 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:42.321132   452 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:42.322234 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.268482 29464 consensus_queue.cc:260] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.322831 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:42.323222 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:42.323388 29464 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.323482 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.324061 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.324659 29537 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.324831 29539 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:42.292297   451 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:42.302661 29538 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:42.310699 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.324831 29546 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:42.328020 29539 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:42.286074 29292 catalog_manager.cc:5697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:42.335151 29544 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.335364 29467 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:42.346558 29537 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:42.338254 29438 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:42.355284 29512 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:42.355647 29464 raft_consensus.cc:1275] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:42.352964 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 235460us
I20260709 13:13:42.361704 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.363512 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.370863 29470 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:42.364562 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.370111 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.376048 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.379354 29470 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:13:42.371665 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:42.384845 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.374200 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.386956 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.392495   847 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.393550   847 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.395097   818 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:42.397331   847 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:42.337637   665 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:13:42.399499   675 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:42.399384   847 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:42.400269   675 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:42.404824 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 66670.3us
I20260709 13:13:42.406646   803 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:42.407212   803 raft_consensus.cc:697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.408162   803 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.410347   821 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:42.410853   821 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:42.411684   800 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:13:42.411825   821 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.413291   821 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:42.413932 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:42.415261 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 2.204s (SENT)
I20260709 13:13:42.414969   817 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.318269   796 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.373644 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.435552 29541 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.438154 29537 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:42.439957 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.440714 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.440851 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.446991 29464 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:42.442972 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:42.444046 30160 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:42.437096   817 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.447615 29469 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:42.448550 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:42.450559 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 78977.1us
I20260709 13:13:42.451452 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:42.452754   827 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.368s	user 0.000s	sys 0.004s
I20260709 13:13:42.453191   479 raft_consensus.cc:3055] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:42.453585   479 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.452826 29292 catalog_manager.cc:5697] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:42.454610   479 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.456081   479 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:42.458770   844 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:42.451488 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:42.460378   808 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:42.459297   844 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.461285   844 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:42.466629   657 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.467265   657 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:42.467625 29294 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 283) took 29399 ms (client timeout 15000 ms). Trace:
I20260709 13:13:42.451504   596 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:13:42.471617   451 raft_consensus.cc:3055] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:42.472185   451 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:42.472275   676 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:42.472879   676 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.473245   451 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.474889 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:42.475505 29394 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:42.475590 29388 pending_rounds.cc:85] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 9
I20260709 13:13:42.475996 29388 pending_rounds.cc:107] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:13:42.476264 29388 raft_consensus.cc:2889] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:42.476357 29396 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:42.471701   596 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:42.478296 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:42.484447 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46631.6us
I20260709 13:13:42.458190 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.485633 29545 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.480183 29512 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:42.486725 29438 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:42.435441   842 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:42.500617 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.501417 29468 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:42.509135 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.510552 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.513957 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.516644 29463 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:42.517462 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:42.518499 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.520493 29469 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:42.525894 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.526921 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.531270 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:42.532120 29395 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:42.400535   847 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.541121 29545 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:42.530015 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.417690   819 consensus_queue.cc:1048] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:13:42.533708 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:42.547087 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.547907 29540 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:13:42.550086 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.490528   680 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:42.572925 29463 raft_consensus.cc:3055] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:42.573498 29463 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.538794 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.540510 32204 raft_consensus.cc:3055] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:42.576363 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.576622 32204 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.544646 29464 raft_consensus.cc:2393] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 10: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:42.483982   657 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:42.493237   818 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:42.486188   788 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:42.551059 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.552313 29467 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:42.585178 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:42.536068 29394 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:42.540089   451 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:42.587205 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:42.553573   852 log.cc:927] Time spent T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:13:42.546337 29292 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 5 to 7, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 7 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.557235   560 consensus_queue.cc:1059] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:42.491622   596 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.536743   665 consensus_queue.cc:1059] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:13:42.598644 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.564352 29435 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:42.565111   590 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.516026   784 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:42.606109 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:42.606829 29541 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:13:42.569314   676 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:42.534179   816 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:13:42.609882 29542 raft_consensus.cc:1275] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:42.584985 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.586103 30160 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:42.585079 29540 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:42.586937 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:42.468106 29294 rpcz_store.cc:269] 0709 13:13:13.067542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.068787 (+  1245us) service_pool.cc:224] Handling call
0709 13:13:14.519118 (+1450331us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890b090 00007f61e89a9f3a 00007f61ee7601cc 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc 00007f61ecd1e392 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:42.467329 (+27948211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:33.620962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:33.772903 (+151941us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:33.772947 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:13:33.772971 (+    24us) tablet.cc:662] Decoding operations
0709 13:13:33.773917 (+   946us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:33.773989 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:33.774037 (+    48us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:13:33.774763 (+   726us) tablet.cc:701] Row locks acquired
0709 13:13:33.774782 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:33.774965 (+   183us) write_op.cc:270] Start()
0709 13:13:33.775092 (+   127us) write_op.cc:276] Timestamp: P: 1783602813774911 usec, L: 0
0709 13:13:33.775111 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:13:33.893182 (+118071us) log.cc:844] Serialized 3272 byte log entry
0709 13:13:34.749960 (+856778us) op_driver.cc:464] REPLICATION: finished
0709 13:13:34.891873 (+141913us) write_op.cc:301] APPLY: starting
0709 13:13:34.891991 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:34.892220 (+   229us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:34.892348 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:34.893435 (+  1087us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:34.893675 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:13:34.893721 (+    46us) write_op.cc:312] APPLY: finished
0709 13:13:34.895473 (+  1752us) log.cc:844] Serialized 65 byte log entry
0709 13:13:34.896394 (+   921us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:34.896551 (+   157us) write_op.cc:454] Released schema lock
0709 13:13:34.896607 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:34.897055 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:34.897094 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":785189,"reported_tablets":46,"spinlock_wait_cycles":258211072,"child_traces":[["op",{"apply.queue_time_us":133959,"apply.run_cpu_time_us":3073,"apply.run_wall_time_us":5129,"num_ops":8,"prepare.queue_time_us":176179,"prepare.run_cpu_time_us":28998,"prepare.run_wall_time_us":474901,"raft.queue_time_us":373213,"raft.run_cpu_time_us":6044,"raft.run_wall_time_us":208210,"replication_time_us":934832,"spinlock_wait_cycles":164992,"thread_start_us":482837,"threads_started":4,"wal-append.queue_time_us":257664,"wal-append.run_cpu_time_us":87501,"wal-append.run_wall_time_us":4353927}]]}
I20260709 13:13:42.617842   603 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:42.546221   842 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:42.618554   603 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:42.619256   842 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.619674   603 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.589445 29467 raft_consensus.cc:3060] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:42.628082 29544 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:42.584724   818 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:42.504607   571 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:42.596449 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.602840 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:42.590636 29463 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.580555   680 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:42.617067 29360 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:42.630601   839 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:42.639824 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 75549us
I20260709 13:13:42.632058 29537 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:42.633340 29546 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:42.609882 32204 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.605294   675 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:42.639446 29463 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.589191   657 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:42.571307   800 consensus_queue.cc:1059] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:13:42.634568   818 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:42.642073 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.605417   784 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.644655 29292 catalog_manager.cc:5697] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:42.645233   680 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.633810   788 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:42.671999 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:42.672641 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.639676   704 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:42.647017 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.676371 29542 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.648041 32204 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.649960   790 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.650763   845 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 13:13:42.654539 30126 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:42.593349 29395 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
W20260709 13:13:42.687302 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53804.3us
I20260709 13:13:42.688519 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:42.638712 29545 raft_consensus.cc:1240] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:42.666863 29467 raft_consensus.cc:2468] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:42.652537   796 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:42.652486   535 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.706811 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.661540   571 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.708137 29546 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.671051   784 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:42.698902 30123 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:42.707507 29292 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:42.666122   654 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:13:42.706722   487 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:42.706985   653 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:42.682996   676 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:42.707074   509 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:42.743954 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:42.667042   657 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.658936   839 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.752558 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.808899 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:42.778780 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.814618 29545 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:42.820791 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 131273us
W20260709 13:13:42.826946 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.746688   837 raft_consensus.cc:3055] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:42.742223   575 raft_consensus.cc:2804] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:42.730926   664 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:13:42.843271 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.737309   560 consensus_queue.cc:1059] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:13:42.803534   509 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.745841   840 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.841048   847 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:42.751089   853 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:13:42.801682   831 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.817029   676 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:42.752175   452 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:13:42.891445 30160 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:13:42.751077   851 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:13:42.900876 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:42.844218   837 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:42.914654 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.947865 29545 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.745966   834 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.126s
W20260709 13:13:42.940001 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:42.952957 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 252121us
W20260709 13:13:42.945721 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 187203us
I20260709 13:13:42.756837   844 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:42.969300 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:42.956794 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.970877 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.972213 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:42.972820 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:42.962689 29468 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
W20260709 13:13:42.964425   857 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:13:42.829735 29283 maintenance_manager.cc:643] P 41140e47adf040c7a76a599e7698358d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.459s	user 0.196s	sys 0.095s Metrics: {"bytes_written":29573,"cfile_init":1,"dirs.queue_time_us":343149,"dirs.run_cpu_time_us":537,"dirs.run_wall_time_us":10981,"drs_written":1,"lbm_read_time_us":547,"lbm_reads_lt_1ms":4,"lbm_write_time_us":179277,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":63,"thread_start_us":233093,"threads_started":2,"wal-append.queue_time_us":484031}
W20260709 13:13:42.974628 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.974658 29471 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:42.860671   479 consensus_queue.cc:1059] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:13:42.968523 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:42.910953   590 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:42.982750 29545 raft_consensus.cc:2393] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.911859   575 raft_consensus.cc:697] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:42.981545 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.025991 29537 raft_consensus.cc:2393] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:42.900274   840 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:42.977275   849 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.368s	user 0.000s	sys 0.003s
I20260709 13:13:43.053388 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:43.053370 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 99326.7us
W20260709 13:13:43.054071 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.054308 29542 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:42.891057   571 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:43.061906 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.062608 29469 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 12: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:43.062704 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.065825   859 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.451s	user 0.003s	sys 0.000s
I20260709 13:13:43.066867 29284 maintenance_manager.cc:419] P 41140e47adf040c7a76a599e7698358d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8683 bytes on disk
I20260709 13:13:43.060514   590 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
W20260709 13:13:43.071321   863 log.cc:927] Time spent T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:13:43.069873   664 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:13:43.076396   837 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.078089   800 raft_consensus.cc:3055] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:43.078718   800 raft_consensus.cc:740] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.079905   800 consensus_queue.cc:260] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.081768   800 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.083060   840 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.061156   675 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:43.084769   676 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.084365   675 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.088555   487 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:43.089063   487 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:43.090909 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.092729   809 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:43.093238   809 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.094261   809 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.095708   809 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:43.091599   596 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.099459   487 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.091610 29542 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:43.102152   817 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:43.102684   817 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.103705   817 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:43.105329   817 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:43.109570   837 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:43.115077 29545 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:43.116784 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 269715us
W20260709 13:13:43.122810 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 67462.9us
I20260709 13:13:43.127354 29539 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:43.128684 29435 leader_election.cc:400] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:43.129081 29435 leader_election.cc:403] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:43.134680 29463 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:43.140802 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:42.976630   535 consensus_queue.cc:1059] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:13:43.131721 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:43.122586   821 consensus_meta.cc:287] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.001s
I20260709 13:13:43.170809 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:43.172039 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.174259 29283 maintenance_manager.cc:643] P 41140e47adf040c7a76a599e7698358d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.049s	user 0.002s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":841,"lbm_reads_lt_1ms":4}
I20260709 13:13:43.177152   803 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:13:43.177634   408 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:13:43.179348 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.180318 29545 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:43.180519 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.181003 30152 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:43.181283 29538 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 12.
I20260709 13:13:43.181558 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.182358 29544 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:43.183145 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.183920 29539 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:43.146198 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 118065us
W20260709 13:13:43.189613 29435 connection.cc:256] RPC call timeout handler was delayed by -1.4348442000000432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:13:43.190279 29435 connection.cc:256] RPC call timeout handler was delayed by -1.272844200000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 13:13:43.180337   653 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:13:43.200402   839 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.201012 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:43.201720 29546 raft_consensus.cc:2376] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4. Re-sending same reply.
I20260709 13:13:43.147068   487 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:43.162067   665 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:13:43.209178   596 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.209771   596 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.210955   657 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.212167   596 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.213351   844 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:43.212993   575 consensus_queue.cc:237] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.027859   509 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:43.193009 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.225896 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:43.226866 29468 raft_consensus.cc:606] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:43.227279 29468 raft_consensus.cc:614] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:43.228103 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:43.228621 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:43.228821 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:43.229578 29390 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:43.229465 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:43.230247 29392 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.231508 29397 raft_consensus.cc:2393] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:43.233067 29463 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:43.233152 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.233919 29391 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:13:43.226056 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:43.191800   847 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:43.239565   847 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.240486   843 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:43.241050   843 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.246801 29467 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:43.247212 29467 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.250273 29544 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:43.252152 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.252472 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:43.253090 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:43.256450 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.258055 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.260404 29464 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:43.245446   552 raft_consensus.cc:3055] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.262327 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.261759   552 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.268102 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:43.271070 29393 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:43.273916   818 consensus_meta.cc:287] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.003s
I20260709 13:13:43.235181   839 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:43.274719   790 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.001s
W20260709 13:13:43.283171 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.248139 29467 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.296104 29467 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.171984   654 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:13:43.283897 29388 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:43.284868 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 58919.2us
W20260709 13:13:43.300858 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.020s
I20260709 13:13:43.287660 29393 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:13:43.287627 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:43.301497 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.006s	sys 0.021s
I20260709 13:13:43.301462 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:43.264591   876 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.003s
I20260709 13:13:43.293840 29391 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:43.290314 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.285480 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.301883 29546 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:43.291208 29392 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
W20260709 13:13:43.303166 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.307799 29390 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:13:43.363059 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.283175   847 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:43.316054 30159 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:13:43.379678 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 78301.5us
I20260709 13:13:43.397039 29390 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:13:43.399106 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.400205 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:43.400563 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.293476   571 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:43.435478 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.304481   790 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:43.426208 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:43.441429 29464 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:13:43.445690 29467 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:13:43.450861 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.458706   866 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.371s	user 0.000s	sys 0.010s
I20260709 13:13:43.459019 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.459363   560 raft_consensus.cc:3055] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:43.459975   560 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.460322 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:43.450960 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:43.461614 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.462258 29467 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
W20260709 13:13:43.465315 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.466048 29467 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:43.467131 29546 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.463181   675 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:43.462534   571 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:43.469020   571 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:43.469458   571 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.470053   560 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.471318   560 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:43.477192 29542 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:43.479528   877 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:13:43.480012   803 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:43.481386   803 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:43.481700   664 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.482692   664 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.483598   664 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.483870   872 consensus_queue.cc:1059] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:43.485137   808 raft_consensus.cc:3055] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.485621   808 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.486572   808 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.488018   664 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.489502 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.490056 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:43.490386 29546 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:13:43.495680   784 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.756s	user 0.005s	sys 0.009s
I20260709 13:13:43.496160 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.496232   784 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.496810 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:43.490895 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.498909   665 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:43.499476   665 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:43.499934   665 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:43.500108   844 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:43.501525   784 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:43.501928   844 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:43.494784 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:43.502219 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47944.9us
I20260709 13:13:43.503123 29537 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:43.503492 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 77456.6us
I20260709 13:13:43.498279 29544 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:43.491091 29538 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:43.491312 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.491923 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.492729 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:43.493042 29397 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.491647 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.512079 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.514552 29546 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:43.418802   809 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:43.515509 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.522420 29537 raft_consensus.cc:2393] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:43.456831 29464 pending_rounds.cc:85] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 5
W20260709 13:13:43.516042 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 51583.6us
I20260709 13:13:43.522707 29470 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:13:43.295079   818 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.526998 29393 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.514238 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:43.523002 29464 pending_rounds.cc:107] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:13:43.528512 29464 raft_consensus.cc:2889] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.524253 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:43.524500 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:43.315842   821 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.187s
W20260709 13:13:43.530575 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.374963   871 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:13:43.531657 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.302402   839 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.502329   844 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:43.538014 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.545287 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:43.551113 29542 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:43.517465   675 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:13:43.535881   856 log.cc:927] Time spent T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:13:43.523598   809 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:43.579955 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 66946.1us
I20260709 13:13:43.582119 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:43.513898   654 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:13:43.587355 29395 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 12: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:43.581914   452 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:43.593511 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.594653 30157 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 9: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:43.597393 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:43.600603 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 55438.1us
I20260709 13:13:43.601805 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:43.605069 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.606490 29463 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:43.608574 30159 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:43.578900   847 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:43.608047   408 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:43.618113 29395 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.619614 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.591660   809 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:43.599700   451 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.005s	user 0.010s	sys 0.006s
I20260709 13:13:43.591305   675 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:43.576933   657 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:13:43.586066   819 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:13:43.640128 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:43.631454 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.619777   847 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:43.615924   784 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:13:43.635166   872 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.652319 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:43.665241 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:43.612416   680 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:13:43.667979 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:43.669021 30157 raft_consensus.cc:2410] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:13:43.632606   487 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:13:43.661800 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.662703 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.656481   847 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:43.660539 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58855.7us
I20260709 13:13:43.680218 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.682204 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:43.692525   839 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:43.694886   675 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.698171   704 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:43.698686   704 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:13:43.699406   883 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:13:43.701256 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:43.704074 30151 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:43.702425 29396 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:43.705286 29435 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:43.704317   880 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:13:43.707171 29435 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:43.703802   818 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:43.708355   535 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:43.712364   886 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:13:43.730314 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 85350us
I20260709 13:13:43.645385   844 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.726001   560 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.736061   680 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:43.755911 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 65085.1us
W20260709 13:13:43.759335 29509 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Timed out: RequestConsensusVote RPC to 127.27.150.132:38609 timed out after 2.140s (SENT)
I20260709 13:13:43.736485   867 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:13:43.710234   704 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.766884 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:43.768968 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.771723   831 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:43.773838   837 consensus_meta.cc:287] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.000s
I20260709 13:13:43.774550 29472 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
W20260709 13:13:43.784896 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2163738510000712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 13:13:43.785353 29509 connection.cc:256] RPC call timeout handler was delayed by -1.1767738510000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:13:43.785645 29509 connection.cc:256] RPC call timeout handler was delayed by -1.1362738510001691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 13:13:43.785928 29509 connection.cc:256] RPC call timeout handler was delayed by -1.1290738510001574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:13:43.788252 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:43.775806   784 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:43.798722 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.815519   895 log.cc:927] Time spent T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:13:43.788522   831 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:43.758406   680 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:43.811120   898 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:43.834759 29464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:43.835525 29464 raft_consensus.cc:606] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:43.818311   590 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.837226   590 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.837931   808 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.813083   535 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.839864   590 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.840221   535 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.840520   590 consensus_queue.cc:1059] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:43.842366   878 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.843212   839 raft_consensus.cc:3055] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.842916   878 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.843699   839 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:13:43.840520 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.805768   885 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:43.820803 29469 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:13:43.824714 29509 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:43.781198   788 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:43.827590   571 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.813832   784 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.869319 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.871449 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:43.875440 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:43.874061 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 49506.3us
W20260709 13:13:43.877579 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.889038 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.878077 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.878821 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:43.889837 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.830132   809 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.881309   839 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.890591 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:43.884442   571 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:43.847407   535 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:43.876870   788 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.886246 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:13:43.887946 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.893397 32204 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:43.894662 29467 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:43.898361 29388 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:43.844405   680 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:43.902443 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:43.846627   831 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:43.904796   664 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.905738 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:43.907452 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:43.926007 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.930317 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:43.886996   818 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:43.935434 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:43.936408   881 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.936036   904 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:13:43.940387 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.940858 29545 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:43.942703 29540 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:43.936523 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:43.951714 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.953421 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.943766 29541 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:43.943768 29544 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:43.941547 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:43.954245 29540 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:43.958575 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:43.978137 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:43.926035   790 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.980821 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:43.927636   839 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.985165 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:43.984766 29542 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:43.988497   874 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:43.932967   776 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:43.933336   664 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:43.937404   818 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:43.897989   665 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:43.992683   903 raft_consensus.cc:993] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:43.992367   916 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.959483   842 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:44.029176 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.031003   784 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:44.003085   907 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:13:44.032461 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:43.995568   809 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.000960   818 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.042169 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:44.046092 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.038615   874 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.053215 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:44.058421 30158 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:44.041842   821 raft_consensus.cc:1081] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:44.063501 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:44.038264   776 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.054277   878 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.080945   878 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.081532   878 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.071476 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.042259   916 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:44.086872 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:44.053236   847 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:44.071460   838 consensus_queue.cc:1048] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.201s
W20260709 13:13:44.079182   910 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:44.083067 29540 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:44.082231 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.084715 29541 raft_consensus.cc:1240] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:44.083806 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.087805 29546 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:44.091342 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:44.083359 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.068833   872 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.099784   452 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.403609 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:44.263836 30126 leader_election.cc:336] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.899s (SENT)
I20260709 13:13:44.264379 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:44.264993   916 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:44.265986 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:44.404479 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.269830 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:44.362694 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:44.363312 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 385332us
I20260709 13:13:44.408749 29363 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:44.364156 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.166772   843 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:44.367815 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:44.370515 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.366863   571 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:44.375439   818 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:44.405821   923 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.136s	user 0.000s	sys 0.005s
W20260709 13:13:44.375335   912 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.381s	user 0.004s	sys 0.000s
W20260709 13:13:44.378291 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.269641   881 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.390551 29470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 514) took 1246 ms. Trace:
I20260709 13:13:44.397130 29542 raft_consensus.cc:2410] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:13:44.411167 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:44.413658 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.394781   603 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.378906   845 raft_consensus.cc:3055] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:44.414564   657 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:44.414561 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:44.416621   571 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.418074   487 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:44.418308 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 154567us
I20260709 13:13:44.376089 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:44.428854   665 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:44.429466   560 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.018s
I20260709 13:13:44.414472   843 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.439035 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:44.437505 29470 rpcz_store.cc:276] 0709 13:13:43.118243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.118407 (+   164us) service_pool.cc:224] Handling call
0709 13:13:43.522345 (+403938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.523185 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.164831 (+641646us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400215550. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:44.364929 (+200098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927991552}
I20260709 13:13:44.444408 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.437274   790 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.459018 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.461736 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:44.456005   821 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.466166   821 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:44.466846   596 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:44.467342   596 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:44.467724   571 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.468487   788 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:44.468618   821 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:44.468899   509 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.469636   874 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.470104   847 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:44.456172   878 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.470914 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2412) took 1167 ms. Trace:
I20260709 13:13:44.442140   845 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:44.476636 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:44.473835 29539 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:44.475471 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.476887 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.477309 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:44.479369 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.483857 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2403) took 1248 ms. Trace:
I20260709 13:13:44.471330 29393 rpcz_store.cc:276] 0709 13:13:43.303363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.303580 (+   217us) service_pool.cc:224] Handling call
0709 13:13:43.420420 (+116840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.527429 (+107009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.470616 (+943187us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003a16d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:44.470817 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245979392}
I20260709 13:13:44.482791 29544 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:44.442816   657 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:44.485474 29540 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:44.486992 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.491286 29541 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:44.486349 29397 rpcz_store.cc:276] 0709 13:13:43.235250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.235415 (+   165us) service_pool.cc:224] Handling call
0709 13:13:43.492837 (+257422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.517041 (+ 24204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.483606 (+966565us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540031e550. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:44.483781 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591274880}
W20260709 13:13:44.496657 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.504410 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:44.507077 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.507097 29546 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:44.500552   571 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.512593 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.456791   560 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.513216 29471 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:44.467737   596 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:44.515609 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.479777   776 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.518157 29541 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:44.519217 30151 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:44.480427   881 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.517292   571 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:44.524269 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.500238   657 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.445804   603 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.528645 29541 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:44.529623 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.501893   452 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:44.506726   665 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.510746   878 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.510741   927 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:44.517943   921 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:13:44.513060   790 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.528645   874 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:44.526923   809 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.540190 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.536592   845 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:44.514271   867 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:44.569844   867 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.535306   665 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:44.539474 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:44.568243 29537 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:44.568833   809 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:44.572018 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 123285us
I20260709 13:13:44.543655 32204 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:13:44.575009 30154 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:13:44.576287 30154 pending_rounds.cc:85] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 10
I20260709 13:13:44.534667 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.576607 30154 pending_rounds.cc:107] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:13:44.576642 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:44.577188 30154 raft_consensus.cc:2889] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:44.539456   927 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.579420 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.585894 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.538954   838 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:44.573774   917 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.340s	user 0.004s	sys 0.010s
I20260709 13:13:44.591197 29546 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:44.597070 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 62551.3us
I20260709 13:13:44.564687   452 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.598868   818 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.596254   904 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.600718   452 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.583178   845 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:44.607355   925 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:13:44.609648   603 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:44.592520   838 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:44.611019   838 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.611081   867 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.611821   867 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.612923 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.615864 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:44.594507   808 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.756s	user 0.018s	sys 0.013s
W20260709 13:13:44.592793   842 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.014s
W20260709 13:13:44.592983   839 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.598s	user 0.026s	sys 0.000s
I20260709 13:13:44.621887 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.632009 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:44.635897 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.616133   776 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.588816   816 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:13:44.650216 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.595384   927 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.587392   788 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:13:44.620360   874 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.625531   919 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.667661 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.634227   842 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.593261   900 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:13:44.617439   867 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.674343   839 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.677737   871 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:44.697690 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 155969us
I20260709 13:13:44.701161 29438 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.711246 29438 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:44.720059   892 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:44.720670   892 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:44.721112   892 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.722652   926 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.683307   552 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:44.727516 29538 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:44.727991   571 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:44.728642   571 consensus_queue.cc:1059] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:44.731588   535 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:44.732028   535 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:44.733047   535 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.708384   919 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:44.741943 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.742424 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 148094us
I20260709 13:13:44.730209   571 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:44.744547 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:44.745550 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.727638   932 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:44.746083   535 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.762925   776 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.763954   867 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:44.743165   881 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.759056 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.727744   664 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:44.772356 29509 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.775015 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.777699 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:44.776593 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:44.743184   882 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:44.745966   571 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.787945 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:44.788669 29389 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:44.789696 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2194) took 1351 ms. Trace:
I20260709 13:13:44.793377 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:44.784482 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.782850   818 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:44.761140   916 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:44.802404 29396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47726 (request call id 575) took 2310 ms (client timeout 1508 ms). Trace:
I20260709 13:13:44.790093 29467 rpcz_store.cc:276] 0709 13:13:43.437840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.471426 (+ 33586us) service_pool.cc:224] Handling call
0709 13:13:43.471753 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.900776 (+429023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.789410 (+888634us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54002c4554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:44.789619 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972124032}
I20260709 13:13:44.803334 29391 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:44.808486 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:44.805840 29396 rpcz_store.cc:269] 0709 13:13:42.477901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.478015 (+   114us) service_pool.cc:224] Handling call
0709 13:13:44.788422 (+2310407us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001c57d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:44.788540 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585885568}
I20260709 13:13:44.813524 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:44.814354 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 146837us
I20260709 13:13:44.814935 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.815277 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.815666 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.817129 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:44.820700 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:44.820859 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:44.821696 29389 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:44.777575   842 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.823992 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.785962 29393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:13:44.756882   933 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:13:44.786604   928 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:44.788367   571 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:44.866837 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51680.6us
I20260709 13:13:44.811733   784 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.853874 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:44.829046 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.749791   816 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:13:44.868661 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:44.858548 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.869781 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 158633us
I20260709 13:13:44.825402   818 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.849057   590 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.851117   871 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.824914   675 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.825225   819 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.803334   882 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:44.828164   926 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:44.892978   926 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:44.895509   934 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:13:44.904338   837 raft_consensus.cc:3055] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:44.904821   837 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:44.872926   867 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:44.906858 29464 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:44.907029   867 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.907687   867 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:44.888911 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:44.870777   900 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:44.891503 29472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1932) took 1631 ms (client timeout 1982 ms). Trace:
I20260709 13:13:44.827953   834 consensus_queue.cc:1059] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:13:44.892361   919 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.827432   680 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:13:44.915416 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:44.918917 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 89993.8us
W20260709 13:13:44.915022 29472 rpcz_store.cc:269] 0709 13:13:43.251769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.251904 (+   135us) service_pool.cc:224] Handling call
0709 13:13:44.882789 (+1630885us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b540032d2d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:44.882910 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199639808}
I20260709 13:13:44.945887 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:44.946408 29540 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:44.881491   487 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.965587 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:44.914016   776 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:44.950263   938 log.cc:927] Time spent T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:13:44.995950 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 142156us
I20260709 13:13:44.909969   927 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:45.004671 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 124180us
I20260709 13:13:45.009443 29395 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:44.923449   818 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:13:45.015450 29438 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:44.942888   479 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:13:44.970638   452 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:45.019227 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.019784 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.021600 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.022746 29537 raft_consensus.cc:2393] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:44.890136   941 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:13:45.027084 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.027974 29544 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:45.029791 29394 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:13:45.029155 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 111676us
W20260709 13:13:45.036945 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.032967 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.011505   654 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:45.045462 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.046208 29537 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:45.050693 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.051468 29546 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:45.058569 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:45.060851 29397 raft_consensus.cc:2376] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7. Re-sending same reply.
I20260709 13:13:45.025640   881 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:45.062357 29397 raft_consensus.cc:1275] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:45.029423   479 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:45.013181   776 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:45.080523 29509 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.585s (SENT) [suppressed 73 similar messages]
I20260709 13:13:45.051721   654 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:45.027272   452 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.029583   596 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.073609   479 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.102523   479 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.052096   956 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.070684   843 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.059377   838 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.095455   845 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.136184 29391 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:45.131937 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.138397 29393 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.140491 29393 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.071854   950 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:13:45.109191   926 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:45.147260 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:45.149432 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:45.155750 29469 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:13:45.146296   927 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.138811   509 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.099179   936 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:45.154953 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:45.155864   944 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.162186   939 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.156697   947 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:45.149231   800 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:45.178844 29472 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:45.179000 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:45.143296   838 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:45.192905 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 149697us
I20260709 13:13:45.194355   596 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:45.137126   941 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:45.151010   882 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:45.166081 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 85582.9us
I20260709 13:13:45.141400   834 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:13:45.204087 29393 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.184597   936 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.133987   843 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.211206 29390 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 6. Ops: []
I20260709 13:13:45.215549 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:45.218144 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.163964   845 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.204717   939 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.219208 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:45.183665   509 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.237399   873 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.237846   776 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:45.238209   873 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.240854   879 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.241057   509 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.241523   879 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.245240   935 raft_consensus.cc:3055] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:45.245697   935 raft_consensus.cc:740] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:45.245879   845 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.253301 29544 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:45.214937   932 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:45.256343 29537 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:13:45.201573   947 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.197705   654 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.217226   936 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:45.222517   950 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:45.246626   874 consensus_meta.cc:287] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.568s	user 0.014s	sys 0.000s
I20260709 13:13:45.230841   939 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.198144   944 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.208271   800 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:45.308897   878 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.743s	user 0.013s	sys 0.002s
I20260709 13:13:45.272173   788 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.263307   817 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:45.262701   932 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:45.430840 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.508s (SENT)
I20260709 13:13:45.311085   950 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.340745   878 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:45.214532   941 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.317289   874 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:45.393067 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.343091   845 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.430517 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.261763   900 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:13:45.393466   923 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:13:45.443977 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:45.445654 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:45.447445   657 consensus_meta.cc:287] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.905s	user 0.017s	sys 0.007s
I20260709 13:13:45.436472   788 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:45.447191   817 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:45.447175   892 consensus_meta.cc:287] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.723s	user 0.022s	sys 0.000s
I20260709 13:13:45.393826   873 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:45.453161   790 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.006s
W20260709 13:13:45.529697 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.498567 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.498456 29395 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
W20260709 13:13:45.533215 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.434880   680 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:45.502704 29392 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:45.452849   950 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:45.448436   932 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:45.502791 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93330.7us
I20260709 13:13:45.503913   900 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.510181   788 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.537768 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:45.539098 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.506945   972 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:45.534977   790 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:45.556325 29395 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:45.544711   879 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:45.559110 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.503595   845 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.510578   657 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.536888   873 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.431816   935 consensus_queue.cc:260] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.537104   680 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.528877   892 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.599066 29389 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:45.578328   913 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 1.579s	user 0.000s	sys 0.019s
W20260709 13:13:45.598129   842 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.770s	user 0.016s	sys 0.000s
I20260709 13:13:45.607101 29395 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:45.621480 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:45.597859   871 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.706s	user 0.014s	sys 0.001s
I20260709 13:13:45.580173   843 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.596122   800 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.634004 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.635327 29395 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:13:45.635258 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.631140   571 consensus_meta.cc:287] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.007s
I20260709 13:13:45.624246   842 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.629240   871 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:45.636314   867 consensus_meta.cc:287] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.728s	user 0.015s	sys 0.002s
W20260709 13:13:45.634752   975 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:13:45.633023   935 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:45.641103   971 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:13:45.609210   873 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.655989   843 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:45.659778   956 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.007s
I20260709 13:13:45.635958   944 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.642839   800 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.673323   800 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:45.675482   974 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:13:45.654047   947 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:45.678922   966 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:13:45.684608   900 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:45.659385   817 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.641360   571 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.661892   941 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:45.678097   956 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:45.692997 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.656431   867 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.677750   843 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.699759   800 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.707126   845 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:45.713860   919 consensus_meta.cc:287] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.769s	user 0.016s	sys 0.000s
I20260709 13:13:45.719919 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:45.722069 29545 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.720760   892 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.731683   665 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:45.721168   887 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.685s	user 0.013s	sys 0.002s
I20260709 13:13:45.725834   919 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.740468   873 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.743793   571 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.745332   867 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.747541   809 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:45.752241   657 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:45.732641   843 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:45.746222   479 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
W20260709 13:13:45.736584   887 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.703s	user 0.013s	sys 0.003s
I20260709 13:13:45.740542   788 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.758940 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 2427) took 1015 ms. Trace:
I20260709 13:13:45.770855   479 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:45.766742   867 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:45.784896 29545 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:45.784495 29394 rpcz_store.cc:276] 0709 13:13:44.744039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.744208 (+   169us) service_pool.cc:224] Handling call
0709 13:13:45.758719 (+1014511us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54001c5cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:45.758867 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653917952}
I20260709 13:13:45.794149 29394 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:45.796121 29394 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:45.800449   867 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.803392   819 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:45.808651 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.799643   950 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.804016   819 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:45.765085   936 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.813961 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.815493 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:45.817780 30157 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:45.811151   487 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.817725 30156 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:45.826932   788 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:45.830777   950 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.832466   479 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.833201   844 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.832399 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:45.830813   936 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.842964   819 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.844509   819 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:45.820849   932 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.827497   487 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.846818 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 2436) took 1054 ms. Trace:
I20260709 13:13:45.847023   867 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.847268 29392 rpcz_store.cc:276] 0709 13:13:44.792398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.792990 (+   592us) service_pool.cc:224] Handling call
0709 13:13:45.846578 (+1053588us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b540042c7d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:45.846737 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628975872}
I20260709 13:13:45.850699   487 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.852108 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.852939 29545 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:45.856849   957 log.cc:927] Time spent T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.723s	user 0.003s	sys 0.000s
I20260709 13:13:45.857129   932 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.864621   452 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:45.865592   914 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.863s	user 0.000s	sys 0.012s
I20260709 13:13:45.871973 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2204) took 2098 ms. Trace:
I20260709 13:13:45.835469   939 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.872457 29465 rpcz_store.cc:276] 0709 13:13:43.773630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.773842 (+   212us) service_pool.cc:224] Handling call
0709 13:13:43.774314 (+   472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:43.779938 (+  5624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.779973 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:43.780703 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 13:13:43.888426 (+107723us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:43.888587 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.888670 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.864391 (+1975721us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:45.871527 (+  7136us) raft_consensus.cc:1685] finished
0709 13:13:45.871552 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.871866 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7699,"raft.queue_time_us":5728,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":4552064,"thread_start_us":93527,"threads_started":1,"wal-append.queue_time_us":206938}
I20260709 13:13:45.874250   552 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.877636 29435 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:45.878736   808 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:45.880982   972 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:45.880949   837 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.882684   837 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:45.883853 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.885720 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.887041 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.891306 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 520) took 1378 ms. Trace:
I20260709 13:13:45.891702 29464 rpcz_store.cc:276] 0709 13:13:44.513058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.513575 (+   517us) service_pool.cc:224] Handling call
0709 13:13:44.520806 (+  7231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.907400 (+386594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.890997 (+983597us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54001e4e54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:45.891229 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886887808}
I20260709 13:13:45.892189 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.890077   487 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.894263   487 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:45.895831 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.898718 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.901889 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.902179 30154 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:13:45.902616 29541 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:45.903244 29538 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:45.899948 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.908321 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.909055 29537 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:45.910215 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.911471 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.904628 29542 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:45.906543 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.913272 29538 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:45.897712   487 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:45.916364 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 818298us
I20260709 13:13:45.919538 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:45.921087 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.924588 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.925223 29537 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:45.929787 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.931391   603 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:45.931564 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.931880   603 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:45.932260 30159 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:45.933202 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.933542 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.934254 29392 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:45.934727 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.934962 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.935108 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.935357 29540 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:45.935731 29392 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:45.935619 29394 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:45.929916 29435 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:45.936707 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:45.937216 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.937879 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:45.937278 29392 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.938185 29394 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:45.942075 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.943395 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:45.943936 29394 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.881788   972 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.946600 29397 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:45.946982 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.947548 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:45.947608 30155 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:45.947957 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.948690 29396 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:45.947623 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:45.949661 29397 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:45.949808 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.948755 30158 raft_consensus.cc:2393] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 12: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:45.949898 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:45.951845 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:45.915112   819 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.952556 29465 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:45.953104 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.953718 29537 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:45.954756 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.956754 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.957291 29395 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:45.928956   816 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:45.958968 29435 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:45.962900 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.963274 29465 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:45.963579 29540 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:45.964536 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:45.964562 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:45.965879 29465 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:45.929401   808 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:45.966538   808 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.961374 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:45.936220   596 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.965104   819 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:45.967720 29472 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.961699 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.948521 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:45.968956 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:45.969483 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:45.971971 29537 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 5.
I20260709 13:13:45.972047 29471 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:45.972772 29391 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:45.974574 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:45.979174 29467 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:45.942850   916 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:45.981069 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 63360.8us
I20260709 13:13:45.973579 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:45.981851 29391 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.981848 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:45.982627 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.928654   575 consensus_queue.cc:1059] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:13:45.990622   992 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.990875   808 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:45.942068   939 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:45.984537 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 56259.6us
I20260709 13:13:45.984958 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:45.985852 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:45.953564   932 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:45.991298   992 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:45.968583   867 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:46.002720 30126 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:46.003059 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.009742 29395 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:46.010939 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:46.011631 29538 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:46.000329 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.003615 30159 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:46.004017 29537 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:46.008091 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:45.979254   903 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:46.013921 29541 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.014307 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:45.995237 29394 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:45.952495   818 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:13:45.985122   916 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.019384 29540 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:46.019948   924 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.020566   924 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.023214   924 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:46.025626   819 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:46.010618   969 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:13:46.030366 29435 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.037096 29435 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.031324 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:46.017799   776 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:45.956050   983 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:13:46.037892 29465 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:46.043143 29391 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:46.060449 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.061167 29391 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:46.045296 29435 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.050980 29468 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:46.063810 29396 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:46.066672 29538 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:46.066892 29469 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 5.
I20260709 13:13:46.055789 29392 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:46.009316   867 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.984339   596 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.070613 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:46.102913 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:46.103232 29538 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.103669 29540 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:46.079178 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.104760 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:46.092363 29463 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:46.106585 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.107405 29396 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.057090   487 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:46.110284   968 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.110553   844 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:46.110766 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:46.110983   968 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.112465   867 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:46.115630 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.116178 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.992223   982 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:46.116624 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.110318 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65122.4us
I20260709 13:13:46.027966   903 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.027768   916 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.128847 29541 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:46.119002 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.121867 29538 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:46.123791 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:46.126045 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.126516 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:46.123371   819 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:46.130426 29392 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:46.046030   776 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:46.203467 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.110301   487 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:46.110970   844 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:46.238186   844 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.211237 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:46.248279 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.126593   831 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:13:46.216531 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.247435 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:46.209545 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:46.130746 30154 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:13:46.137040 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.251420 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 119219us
I20260709 13:13:46.045130   939 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:46.259739 29472 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:46.217830 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 91881.3us
I20260709 13:13:46.218112 32204 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:46.137495   903 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.217845 29545 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.268522 32204 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:46.108637   808 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:46.224462 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:46.273277 29538 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:46.224119 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:46.225729 29471 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:13:46.228084 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:46.275588 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:46.262503 29512 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:46.226882   776 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.230145   487 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:46.231031   982 raft_consensus.cc:697] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:46.231400   596 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:46.233268 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:46.216176   972 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:46.117524   931 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.242717   704 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:46.123867   924 consensus_queue.cc:1059] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:13:46.313997 29360 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:46.300607   931 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.314975   931 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.315232   924 raft_consensus.cc:3055] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:46.315671   924 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:46.316771   654 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:46.316735   924 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.315502   874 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.326941   874 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:46.327391   874 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.329624   968 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:46.243149   990 log.cc:927] Time spent T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:13:46.268693   675 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:13:46.114760   967 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.223s
I20260709 13:13:46.244205   992 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.246413 29393 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.248696 29391 raft_consensus.cc:2368] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:13:46.007768   932 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.256341 29540 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:46.245816 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.258273 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:46.259393 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.268446 29435 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.229213 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.279449 29541 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.259446   818 consensus_queue.cc:1059] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:13:46.282140   937 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:46.335203 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.270112 32204 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:46.280975 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.282002 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:46.339879 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36874 (request call id 2428) took 1592 ms. Trace:
I20260709 13:13:46.367671 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.318189   924 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.286391 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:46.368006 29393 rpcz_store.cc:276] 0709 13:13:44.769288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.769473 (+   185us) service_pool.cc:224] Handling call
0709 13:13:46.243121 (+1473648us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540031ef54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8998a3d 00007f61ed968cd0 00007f61e6eed254 00007f61e6eed1e2 00007f61e6eed111 00007f61e6eed08c 00007f61e6eec342 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:46.339751 (+ 96630us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720248576}
I20260709 13:13:46.260054   939 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.298647 29545 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:46.271430   816 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:46.429245   816 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.429697   816 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:46.430259   970 log.cc:927] Time spent T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.797s	user 0.000s	sys 0.003s
I20260709 13:13:46.432224 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:46.277096   847 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:46.432909 29545 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:46.433223   847 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:46.434310   847 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.437671   871 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.438236   871 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.440546   871 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.306061 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 588) took 1297 ms. Trace:
I20260709 13:13:46.306427   982 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.308388 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.334239   560 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.341111 29392 raft_consensus.cc:2368] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:46.341465 29466 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:46.369593 29397 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:46.369760 29394 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:46.370878 29465 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:46.249482   943 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:46.452391 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.347515 29396 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 13: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.355249 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2432) took 1582 ms. Trace:
I20260709 13:13:46.340889 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.455034 29391 raft_consensus.cc:2368] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:46.289165 30152 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
W20260709 13:13:46.391909 29468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1936) took 2543 ms (client timeout 2613 ms). Trace:
I20260709 13:13:46.299706   979 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.498025 29360 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:46.499455   871 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.500142   871 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.500672   871 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:46.396008   977 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.771s	user 0.004s	sys 0.000s
I20260709 13:13:46.357779   818 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.503007   818 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:46.504274 29392 raft_consensus.cc:1275] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:46.504012   818 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.505393   818 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.339404   603 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.506757   560 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.389286   552 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.507840   552 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.403752   867 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:46.510588 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.512197   867 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:46.406744 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 138397us
I20260709 13:13:46.514008 29435 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.515003 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.407267   940 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.515770   940 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.516181   940 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.518929 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.519225 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.521297 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.522119 29397 raft_consensus.cc:2393] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.500428 29438 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.522966 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.408011   936 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.412647   892 raft_consensus.cc:3055] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.416927   784 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:46.425635   916 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.358166   937 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.342017   932 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.427997   904 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:46.428201 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 141945us
I20260709 13:13:46.531235 29388 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:46.228024   819 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.441409 29389 rpcz_store.cc:276] 0709 13:13:45.008820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.008981 (+   161us) service_pool.cc:224] Handling call
0709 13:13:45.023531 (+ 14550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.608640 (+585109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.305672 (+697032us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54000e6fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:46.305965 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323080576}
I20260709 13:13:46.443537 29395 raft_consensus.cc:2368] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:46.450186 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:46.478791   914 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:13:46.488525 30151 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:13:46.490254   931 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.453577 29390 rpcz_store.cc:276] 0709 13:13:44.773098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.774648 (+  1550us) service_pool.cc:224] Handling call
0709 13:13:44.775040 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.217252 (+442212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.354882 (+1137630us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540031ef54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:46.355155 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002430336}
W20260709 13:13:46.456468 29468 rpcz_store.cc:269] 0709 13:13:43.818997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.821260 (+  2263us) service_pool.cc:224] Handling call
0709 13:13:46.361867 (+2540607us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54003b6854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:46.362013 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5015141248}
I20260709 13:13:46.507158   603 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.343055   808 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.336105   675 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.428996   939 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:46.510200   552 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.540819 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.527356 29438 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:46.560273   837 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.529639 29541 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:46.539682 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.544998 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.546118 29435 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:46.551831 29394 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:46.548058 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.563802 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.538681   784 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:46.544543   821 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:46.547420   867 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:46.525413   892 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:46.663579   892 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.665416   892 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.668529   552 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:46.669370   552 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:46.547910   680 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:46.525403   979 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:46.673506   979 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.548484   452 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:46.682948   452 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:46.684244   452 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.569873 29542 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:13:46.581427 30151 pending_rounds.cc:85] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 9
I20260709 13:13:46.686771 30151 pending_rounds.cc:107] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:13:46.687084 30151 raft_consensus.cc:2889] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:46.592573   788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.008s	sys 0.016s
I20260709 13:13:46.586256 29545 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:46.687801   788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.008s	sys 0.016s
I20260709 13:13:46.590221 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.690742 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 619) took 2108 ms. Trace:
I20260709 13:13:46.691358 30151 rpcz_store.cc:276] 0709 13:13:44.582751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.583877 (+  1126us) service_pool.cc:224] Handling call
0709 13:13:44.614164 (+ 30287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.687598 (+2073434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.690234 (+  2636us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400133b54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:46.690611 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4309498752}
I20260709 13:13:46.694555   980 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.695367   980 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:46.699048   994 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.570s	user 0.002s	sys 0.000s
I20260709 13:13:46.583560   704 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:46.700795   704 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.590205   904 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:46.704761   904 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.591459   808 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.715406   821 raft_consensus.cc:697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:46.716841   821 consensus_queue.cc:237] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.590415   560 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.568766 29393 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:46.593937 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:46.601756 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 74509.6us
I20260709 13:13:46.603205 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.606040 29397 raft_consensus.cc:2368] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:46.737630 29392 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:46.608654 29391 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.607982 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.539227   936 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:46.623868 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 77840.7us
I20260709 13:13:46.742556 29394 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.742741 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.743489 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.743767 29391 raft_consensus.cc:2368] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:46.744103 29394 raft_consensus.cc:2376] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9. Re-sending same reply.
I20260709 13:13:46.608904 29388 raft_consensus.cc:2410] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:46.556154   776 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.613736   932 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.525651   943 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.604665   675 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:46.640128   916 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.642561   837 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:46.646687 30157 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:13:46.648058   937 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.648389   931 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.648978   871 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.649837   874 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.650619   819 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:46.653749   939 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.741175 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.798312 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.637790 29295 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 9, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 9 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:46.746152 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.749331 29438 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:46.800316 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51106.9us
I20260709 13:13:46.798274 29397 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:46.802165 29438 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:46.806331 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.745013 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.751153 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.807668 29394 raft_consensus.cc:2376] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9. Re-sending same reply.
I20260709 13:13:46.776643 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.807884 29392 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:46.808636 29391 raft_consensus.cc:2368] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:46.808674 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.569687   653 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:46.782029 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.804644 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:46.727964   924 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:46.796768 29395 raft_consensus.cc:2393] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.798696 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:46.819870 30151 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
W20260709 13:13:46.822055 29463 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.006s
W20260709 13:13:46.822584 29463 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.007s	sys 0.006s
I20260709 13:13:46.809383 29394 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:46.750494 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.809254 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.823935 29393 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:46.824224 29392 raft_consensus.cc:2368] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:46.825378 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.811268   704 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:46.628356   867 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.833781   867 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:46.834818   844 consensus_meta.cc:287] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.006s
I20260709 13:13:46.835444   844 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.836191   871 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:46.759917   887 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:13:46.838178   943 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:46.838145   844 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.841174   874 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:46.783564   552 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.843376   939 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.845170   936 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:46.800424   784 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.847637   784 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:46.819875   916 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:46.848919   916 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:46.849339   916 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:46.855602   903 consensus_meta.cc:287] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.572s	user 0.016s	sys 0.000s
I20260709 13:13:46.856173   903 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.856549   940 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:46.802965   968 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.858944   968 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.861344   968 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:46.799295 29390 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
W20260709 13:13:46.865518 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 60932.1us
I20260709 13:13:46.866778 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:46.818310 29389 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:46.826310 29392 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.871012 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.871119 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.831138 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.872658 29391 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:46.833146 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.874043 29388 raft_consensus.cc:2376] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7. Re-sending same reply.
W20260709 13:13:46.863502   487 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.560s	user 0.015s	sys 0.004s
I20260709 13:13:46.876641 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.896723 29392 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.872171 29389 raft_consensus.cc:2368] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:13:46.900988 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.901942 29389 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:46.906682 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.909443 29396 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:46.913319 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.923237 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:46.879092 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 77021.8us
I20260709 13:13:46.880402 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:46.946494 29396 raft_consensus.cc:2393] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.952989 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.968524 29388 raft_consensus.cc:2376] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6. Re-sending same reply.
I20260709 13:13:46.957041 32204 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:46.958976 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.970878 29397 raft_consensus.cc:2376] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8. Re-sending same reply.
I20260709 13:13:46.873441   945 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:46.965966 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:46.966414 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 86131us
I20260709 13:13:46.975759 29391 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:46.828154   653 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.831969   924 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.907476   844 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.934581   968 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.986578 29295 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.998220 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:46.863513   816 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:46.967140   903 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.019630 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:47.020833 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 76712.4us
W20260709 13:13:47.021962 29469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.011s	sys 0.028s
I20260709 13:13:46.973152 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:47.023007 29396 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.000798 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.932410   487 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.028299 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:47.030314 29391 raft_consensus.cc:2368] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:47.035204 29389 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:46.933531   819 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.000699 29435 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:47.013911 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 371212us
W20260709 13:13:47.022523 29469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.011s	sys 0.028s
I20260709 13:13:47.005656 29388 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:47.045291 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.018599 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:47.045852 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.046478 30152 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.048074 29388 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:47.049532 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.050731 29388 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 13: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:47.052176 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.053164 29388 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:46.965456   940 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:47.061337 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.000396   844 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.064137 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:47.066296 29389 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.067574 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:46.862823   675 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:47.065151 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 64600.3us
I20260709 13:13:47.069682 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.075430 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:47.075982 29395 raft_consensus.cc:2410] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:47.064924 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.076632 30156 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:47.076994 29391 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:47.068316 29397 raft_consensus.cc:2368] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:13:47.080190 29392 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:47.080622 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:47.083640 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:47.087131 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:47.092046 29388 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:47.087996 29389 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:13:47.088804 29512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.042s	sys 0.099s
W20260709 13:13:47.092962 29512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.042s	sys 0.099s
I20260709 13:13:47.093649 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:47.093756 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 831374us
I20260709 13:13:47.094367 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.094765 29389 raft_consensus.cc:2368] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:47.096048 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.097608 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.099228 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.102638 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.107733 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:47.111318 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.112386 29538 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:47.114502 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.117920 29545 raft_consensus.cc:2393] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:47.119510 29388 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:47.120265 29542 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:47.123099   560 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:47.125448 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.125469 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.123898 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:47.070389   844 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.073652   903 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:47.134572 29468 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:47.133811 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:46.966753   837 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.133776 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:47.137385 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53799.1us
I20260709 13:13:47.138490 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.144446 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.127717 29392 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:47.145303 29546 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:47.146859 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.147219 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.148165 29395 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:47.149209 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.149878 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.150486 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.151333 29543 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.147578 29545 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:47.153154 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.153878 29542 raft_consensus.cc:3060] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.154516 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.155242 29545 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.156334 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:47.160130   653 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:47.134191   818 consensus_meta.cc:287] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.623s	user 0.015s	sys 0.003s
I20260709 13:13:47.139314   575 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:13:47.129590   980 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.138744   831 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.167054   831 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.169811   831 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:47.139760   603 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.547s	user 0.022s	sys 0.003s
I20260709 13:13:47.081350   924 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:47.140796   560 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:47.126814   940 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.183782   487 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:47.135716   776 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.059890   819 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.172446   935 consensus_queue.cc:1048] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:13:47.148444 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.200372 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.196664 29295 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 6, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 6 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:47.214004 29539 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.214946 29546 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.151036   945 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:47.199837 29471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.066s	sys 0.082s
W20260709 13:13:47.218537 29471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.066s	sys 0.083s
I20260709 13:13:47.200143 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.200568 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:47.219425 29538 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.217440 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:47.210103 30157 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:47.222579 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:47.225201 29545 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:47.137810 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:47.228675 29360 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:47.229478 30152 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:47.088310 29396 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:47.223855   945 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:47.231845 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.232986 29538 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:47.220547   776 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:13:47.242784 29295 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 9, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:47.234671   933 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.017s	sys 0.050s
I20260709 13:13:47.262104   874 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:47.262390   933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.018s	sys 0.050s
I20260709 13:13:47.262555   874 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:47.263486   874 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:47.246842 29464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.016s	sys 0.008s
I20260709 13:13:47.264827   874 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.219300   916 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.242734   603 consensus_queue.cc:1059] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:13:47.272797   916 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.190373   808 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.273718   603 raft_consensus.cc:3055] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:47.274223   603 raft_consensus.cc:740] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:47.275879   808 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.275487   603 consensus_queue.cc:260] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:47.253010 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 115331us
I20260709 13:13:47.277274   603 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:47.208792   940 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.254565 29360 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:47.260540 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.278393 29435 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:47.277275 29472 raft_consensus.cc:1240] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:47.283541 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 538) took 1008 ms. Trace:
W20260709 13:13:47.265165 29464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.017s	sys 0.009s
I20260709 13:13:47.281072 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.289361 29466 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
W20260709 13:13:47.247234 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.019s	sys 0.034s
W20260709 13:13:47.290241 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.019s	sys 0.034s
I20260709 13:13:47.291774 29512 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:47.287504 29471 rpcz_store.cc:276] 0709 13:13:46.275042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.276338 (+  1296us) service_pool.cc:224] Handling call
0709 13:13:46.276798 (+   460us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:46.277283 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:46.277311 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:46.286472 (+  9161us) log.cc:844] Serialized 78 byte log entry
0709 13:13:47.219004 (+932532us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:47.219046 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.219117 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:47.283197 (+ 64080us) raft_consensus.cc:1685] finished
0709 13:13:47.283223 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.283464 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":18724,"thread_start_us":825879,"threads_started":1,"wal-append.queue_time_us":876097}
I20260709 13:13:47.300182 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:47.300873 29471 raft_consensus.cc:3055] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:47.301190 29471 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:47.247505   847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.011s	sys 0.020s
I20260709 13:13:47.258199   924 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:47.304464 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.305287 29466 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:47.306284 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.307152 29466 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:47.308066 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:47.308694 29466 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.304476 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:47.318972 29539 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:47.319432 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:47.259235   560 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:47.278752   940 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.326594 29435 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:47.380321 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53844.1us
I20260709 13:13:47.381449 29435 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:47.383863 29435 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:47.330772 29546 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:47.311502   680 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:47.301174   932 consensus_meta.cc:287] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.002s
I20260709 13:13:47.332726 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:47.247574   982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.012s	sys 0.011s
I20260709 13:13:47.314564 29471 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.337757 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:47.338006 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2216) took 1088 ms. Trace:
W20260709 13:13:47.306782   847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.012s	sys 0.021s
I20260709 13:13:47.472009   959 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:47.472636   842 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:47.472782   959 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.473444   842 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.331626   931 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.474859   931 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.475782   842 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:47.339864 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:47.477468 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.478057 29465 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:47.340883   816 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:47.341380   867 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.000s
I20260709 13:13:47.342711   945 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.308540   924 raft_consensus.cc:697] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:47.346532   784 consensus_queue.cc:1059] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:47.346673   998 consensus_queue.cc:1048] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:47.348563   871 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:47.349728 29542 raft_consensus.cc:2468] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:47.315266   879 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:47.352104 29509 leader_election.cc:400] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:47.525307 29509 leader_election.cc:403] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:47.357836   933 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.374825 29295 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.392247 29467 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:13:47.529526 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:47.370580   788 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.025s	sys 0.065s
I20260709 13:13:47.416194 29464 rpcz_store.cc:276] 0709 13:13:46.249813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.254423 (+  4610us) service_pool.cc:224] Handling call
0709 13:13:46.254766 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.361753 (+106987us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:46.451355 (+ 89602us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.308746 (+857391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:47.308814 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:47.308860 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.335187 (+ 26327us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54002a3fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:47.337733 (+  2546us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.337925 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20444,"prepare.queue_time_us":80988,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":20965,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9771,"spinlock_wait_cycles":245350144,"thread_start_us":836425,"threads_started":1}
I20260709 13:13:47.420521 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:47.427162 29292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 285) took 25203 ms (client timeout 15000 ms). Trace:
I20260709 13:13:47.429028   808 raft_consensus.cc:2804] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:13:47.536088 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 184188us
I20260709 13:13:47.537242 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:47.430383 29466 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:47.538975 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.394881   932 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.435611   819 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:47.436033   916 consensus_queue.cc:1175] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "88760af579b54a6393c6251aa3c6b870" responder_term: 6 status { last_received { term: 4 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 4. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:47.337442   936 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:47.396377   903 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:47.527627   879 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.279759   776 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:47.532013   788 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.026s	sys 0.066s
I20260709 13:13:47.561318 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:47.562673 29472 raft_consensus.cc:2368] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:13:47.565161   818 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:47.565876   818 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.559793   887 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.567194   887 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.568346   818 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:47.569379   887 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:47.569802 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.515507   867 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.486375 29543 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
W20260709 13:13:47.581200   968 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.002s
W20260709 13:13:47.488945 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.395424 29435 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:47.588899   968 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.487142   603 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:47.502677 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.548784   936 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.391278   680 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:47.487315   982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.013s	sys 0.012s
I20260709 13:13:47.532111   933 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.527779 29295 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:47.431180 29471 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.606859 29295 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.541138 29466 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:47.608557 29295 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:47.609862 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.544718 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.546285 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.372984   980 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.581741   776 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:47.584030 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:47.547103   842 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
W20260709 13:13:47.586127 29463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.017s	sys 0.049s
I20260709 13:13:47.378552   560 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:47.592928 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 197804us
I20260709 13:13:47.548856   808 raft_consensus.cc:697] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:47.527196   871 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.599749 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.626411 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:47.628119 29464 raft_consensus.cc:2410] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:47.558578   879 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:47.499282   892 consensus_meta.cc:287] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.011s
I20260709 13:13:47.560555   784 raft_consensus.cc:2764] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:13:47.610690 29466 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:47.574301   874 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.613374 29295 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 3 to 5, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 5 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:47.551697 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:47.585225   931 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:47.624943 29463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.018s	sys 0.049s
I20260709 13:13:47.551653   903 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:47.602640   968 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:47.638428 32204 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:47.589756   603 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:47.632352 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 80729.6us
I20260709 13:13:47.602725   680 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.644711 29509 leader_election.cc:400] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:47.645311 29509 leader_election.cc:403] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:13:47.646955 29509 leader_election.cc:400] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:47.647436 29509 leader_election.cc:403] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:47.603309   936 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:47.604737   552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.009s	sys 0.008s
I20260709 13:13:47.639194 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2218) took 1387 ms. Trace:
W20260709 13:13:47.639705 29469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.012s	sys 0.024s
W20260709 13:13:47.663897 29469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.012s	sys 0.025s
I20260709 13:13:47.625878   959 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.666903 29472 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:13:47.637581   847 raft_consensus.cc:2764] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:13:47.655189 32204 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:47.674319 32204 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.471856 29438 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:47.625677   560 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:47.662113 29463 rpcz_store.cc:276] 0709 13:13:46.251528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.251821 (+   293us) service_pool.cc:224] Handling call
0709 13:13:46.252113 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.252341 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:46.873915 (+621574us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.638110 (+764195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:47.638176 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:47.638225 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.638986 (+   761us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.639128 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32578,"prepare.queue_time_us":75124,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"thread_start_us":1283522,"threads_started":2}
I20260709 13:13:47.643908   903 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:47.676964 29463 raft_consensus.cc:1240] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:47.678684 29463 raft_consensus.cc:1240] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:47.668292 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:47.665577   552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.009s	sys 0.009s
I20260709 13:13:47.651914 29471 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:47.661219   842 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:47.696539 29472 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:13:47.664197   819 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.688495 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:47.663515   968 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:47.599725   924 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.666347   900 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.674026   999 raft_consensus.cc:3055] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:47.702838 29470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.025s	sys 0.038s
I20260709 13:13:47.626716   980 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:47.706547 30151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.025s	sys 0.017s
W20260709 13:13:47.708617  1004 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:13:47.708163   968 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.637873   874 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:47.711897 29470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.026s	sys 0.038s
W20260709 13:13:47.706769   452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.014s	sys 0.026s
I20260709 13:13:47.716658 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:47.697963   831 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:47.718241 30151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.025s	sys 0.018s
W20260709 13:13:47.716225   844 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.003s
I20260709 13:13:47.710676   847 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.711730   999 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:47.710881   808 consensus_queue.cc:237] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.731825   980 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.718818 32204 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.726850 30152 raft_consensus.cc:2410] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:13:47.726979   452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.014s	sys 0.027s
I20260709 13:13:47.738186   844 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.746742   844 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.748891   560 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.705631   776 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.714844   900 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:47.760358   560 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:47.753254 32204 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:47.764515   979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.006s	sys 0.026s
I20260709 13:13:47.763566   867 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:47.765067   871 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:47.768962   821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.017s	sys 0.029s
W20260709 13:13:47.777102   837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.020s
I20260709 13:13:47.775223   933 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:47.775142   979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.007s	sys 0.026s
W20260709 13:13:47.803313  1005 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:13:47.779644   999 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:47.636201 29295 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:47.787792   837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.005s	sys 0.020s
W20260709 13:13:47.788892   821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.017s	sys 0.029s
I20260709 13:13:47.933442   831 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:47.922156 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 205413us
W20260709 13:13:47.924301 30123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.015s	sys 0.036s
I20260709 13:13:47.931836 30153 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:47.938450 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:47.533452 29292 rpcz_store.cc:269] 0709 13:13:22.233625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.283760 (+ 50135us) service_pool.cc:224] Handling call
0709 13:13:47.427028 (+25143268us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:43.712645 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:43.791378 (+ 78733us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:43.791445 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:13:43.791468 (+    23us) tablet.cc:662] Decoding operations
0709 13:13:43.792732 (+  1264us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:43.792849 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:43.792883 (+    34us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:13:43.793564 (+   681us) tablet.cc:701] Row locks acquired
0709 13:13:43.793612 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:13:43.793847 (+   235us) write_op.cc:270] Start()
0709 13:13:43.794010 (+   163us) write_op.cc:276] Timestamp: P: 1783602823793764 usec, L: 0
0709 13:13:43.794045 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:13:43.842449 (+ 48404us) log.cc:844] Serialized 2545 byte log entry
0709 13:13:45.058330 (+1215881us) op_driver.cc:464] REPLICATION: finished
0709 13:13:45.313755 (+255425us) write_op.cc:301] APPLY: starting
0709 13:13:45.321189 (+  7434us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:45.790838 (+469649us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:45.790996 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:45.820093 (+ 29097us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:45.820432 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:13:45.820497 (+    65us) write_op.cc:312] APPLY: finished
0709 13:13:45.821974 (+  1477us) log.cc:844] Serialized 65 byte log entry
0709 13:13:45.822221 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:45.822349 (+   128us) write_op.cc:454] Released schema lock
0709 13:13:45.822413 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:45.822886 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:45.822913 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":576705,"reported_tablets":47,"spinlock_wait_cycles":27904,"child_traces":[["op",{"apply.queue_time_us":159238,"apply.run_cpu_time_us":19752,"apply.run_wall_time_us":518407,"cfile_cache_hit":22,"cfile_cache_hit_bytes":22935,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6212,"cfile_init":1,"lbm_read_time_us":97648,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":5,"lbm_reads_lt_1ms":1,"num_ops":6,"prepare.queue_time_us":454970,"prepare.run_cpu_time_us":10267,"prepare.run_wall_time_us":257506,"raft.queue_time_us":291665,"raft.run_cpu_time_us":28462,"raft.run_wall_time_us":188444,"replication_time_us":1231148,"thread_start_us":615559,"threads_started":4,"wal-append.queue_time_us":195259,"wal-append.run_cpu_time_us":48839,"wal-append.run_wall_time_us":2782536}]]}
I20260709 13:13:47.850636 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:47.895804 29467 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
W20260709 13:13:47.871091 29397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.015s	sys 0.039s
W20260709 13:13:48.018115 29397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.019s	sys 0.050s
I20260709 13:13:48.020274 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2470) took 1272 ms. Trace:
I20260709 13:13:48.020372   999 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.782351   603 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.947543   871 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.949831   874 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:47.930358   675 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:47.962981   959 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:47.964143   653 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:47.920006 29541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.009s	sys 0.003s
I20260709 13:13:47.888566 29463 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:47.885589 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 413593us
W20260709 13:13:48.028746   904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.020s
I20260709 13:13:48.029234   900 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:48.003597 29537 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.010s	sys 0.007s
I20260709 13:13:48.011813   831 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.012977 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:48.014004 30123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.015s	sys 0.041s
I20260709 13:13:48.015769 29512 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:48.034186 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 54140.2us
I20260709 13:13:48.026943   933 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:48.036186   933 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.036823   933 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.039578 29438 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:48.029342   904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.007s	sys 0.020s
W20260709 13:13:48.042598 29541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.012s	sys 0.005s
I20260709 13:13:48.043880 30159 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:13:48.044955   653 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.045730 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 626) took 1586 ms. Trace:
I20260709 13:13:48.021008 29397 rpcz_store.cc:276] 0709 13:13:46.747549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.141168 (+393619us) service_pool.cc:224] Handling call
0709 13:13:47.176303 (+ 35135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.176722 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.176756 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.177322 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.019244 (+841922us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:48.019367 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.019571 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.019700 (+   129us) raft_consensus.cc:1685] finished
0709 13:13:48.019726 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.020055 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1302,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":111,"thread_start_us":840954,"threads_started":1,"wal-append.queue_time_us":624697}
W20260709 13:13:48.046205 29363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.002s	sys 0.009s
I20260709 13:13:48.049021   653 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.042485  1031 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:48.050585   959 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.051307  1031 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:48.053114  1031 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.054049   959 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.054965 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 849) took 1623 ms. Trace:
I20260709 13:13:48.054859   871 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:48.056737 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 802497us
W20260709 13:13:48.049013 29363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.002s	sys 0.009s
I20260709 13:13:48.046197 30159 rpcz_store.cc:276] 0709 13:13:46.459054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.459284 (+   230us) service_pool.cc:224] Handling call
0709 13:13:46.480801 (+ 21517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.044445 (+1563644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.045295 (+   850us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54006bbcd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:48.045624 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3592617216}
W20260709 13:13:48.057389 29537 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.010s	sys 0.008s
I20260709 13:13:48.061841 30153 rpcz_store.cc:276] 0709 13:13:46.431700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.431899 (+   199us) service_pool.cc:224] Handling call
0709 13:13:46.432287 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.018975 (+1586688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.054510 (+ 35535us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54007a0154. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:48.054878 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3446044928}
I20260709 13:13:48.070984   784 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:48.064985   675 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:48.071658   784 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.082559   784 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.076349 29295 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130), VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131), VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:48.094730 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:48.094129 29436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.002s	sys 0.022s
W20260709 13:13:48.101826 29436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.003s	sys 0.022s
I20260709 13:13:48.112758   842 consensus_queue.cc:1059] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:48.119102 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:48.119499 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:48.119958 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.127563 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.129820 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.130712 29390 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:48.130829 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.131709 29397 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:48.132190 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.137161 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.143355 29393 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:48.146998   945 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:48.147845   945 raft_consensus.cc:697] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:48.148962 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.149663 29397 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.149312   945 consensus_queue.cc:237] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.155114   675 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.156386 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.175318 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.175733 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:48.158809   831 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:48.178457 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 87907.3us
W20260709 13:13:48.178365 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 440526us
I20260709 13:13:48.103219   959 consensus_queue.cc:1059] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:13:48.193089 29391 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:13:48.197532   936 consensus_meta.cc:287] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.004s
I20260709 13:13:48.197788   887 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:48.199282 29391 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:48.204031 29295 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 7, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 7 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.217830 29438 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:48.220971   680 consensus_meta.cc:287] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.013s
I20260709 13:13:48.221643   680 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.202695   831 raft_consensus.cc:3055] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:48.227278 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:48.228320 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 215721us
I20260709 13:13:48.229876 29509 leader_election.cc:400] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:13:48.230248 29509 leader_election.cc:403] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:13:48.231098   887 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
W20260709 13:13:48.231105 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.233770 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.234700 29395 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:48.234938   831 raft_consensus.cc:740] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:48.235484   903 consensus_meta.cc:287] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.011s
I20260709 13:13:48.236055   903 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.236408   831 consensus_queue.cc:260] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.227362   776 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:48.238112   831 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.238427   776 consensus_queue.cc:1243] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer c65265f20d7e42b6bfe314c5d109bdf7 log is divergent from this leader: its last log entry 9.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:48.208288   936 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.242026   892 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:48.252156   892 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:48.253084 29391 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.253372   892 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.243391   871 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.254809   968 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:48.255555   968 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:48.256457 29391 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.258483   892 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.249915 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:48.275941 29397 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:48.258538 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 59137.3us
I20260709 13:13:48.215687   945 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:48.246238 29363 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:48.266589   940 consensus_meta.cc:287] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.008s
I20260709 13:13:48.284453 29295 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.257201   968 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.285511 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 2003) took 1183 ms. Trace:
W20260709 13:13:48.295819   819 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.010s
I20260709 13:13:48.309938 29396 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:48.292718 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:48.319958 29394 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:48.292047   936 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.309793 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2659) took 1157 ms. Trace:
I20260709 13:13:48.288384   903 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.323871 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.326197 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.328868 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 535) took 1934 ms. Trace:
W20260709 13:13:48.328758 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 73333us
I20260709 13:13:48.303002   945 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:48.324018 29295 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:48.346146 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:48.339183   879 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.007s
I20260709 13:13:48.297200 29541 rpcz_store.cc:276] 0709 13:13:47.094626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.096419 (+  1793us) service_pool.cc:224] Handling call
0709 13:13:47.096774 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.124857 (+ 28083us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:47.360396 (+235539us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b1800493240. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61ec3993c7 00007f61e89ab9a7 00007f61e89bb0bf 00007f61e89bb038
0709 13:13:48.043572 (+683176us) log.cc:844] Serialized 14 byte log entry
0709 13:13:48.087717 (+ 44145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.112142 (+ 24425us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b48001c1658. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ed8caaa1 00007f61ed8c1b37 00007f61ed8c19ca 00007f61ed9b926f 00007f61ed9b8f37 00007f61ed9cd55c 00007f61ed9cd508 00007f61ed9cd488 00007f61ed9cd443 00007f61ed9cc6ec 00007f61ec8f6a96
0709 13:13:48.188588 (+ 76446us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.191591 (+  3003us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:48.208586 (+ 16995us) log.cc:844] Serialized 14 byte log entry
0709 13:13:48.208823 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.215383 (+  6560us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.267071 (+ 51688us) raft_consensus.cc:1685] finished
0709 13:13:48.267104 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.277579 (+ 10475us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":701244,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":119,"raft.queue_time_us":38691,"raft.run_cpu_time_us":3479,"raft.run_wall_time_us":45629,"spinlock_wait_cycles":55600256,"thread_start_us":710725,"threads_started":2,"wal-append.queue_time_us":85892}
I20260709 13:13:48.351923 29395 raft_consensus.cc:3060] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:48.372411   847 consensus_meta.cc:287] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.008s
I20260709 13:13:48.376098 29295 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:48.372757 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 43895.2us
W20260709 13:13:48.378407 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 132286us
I20260709 13:13:48.378810 30153 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:48.321534 29537 rpcz_store.cc:276] 0709 13:13:47.142651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.142849 (+   198us) service_pool.cc:224] Handling call
0709 13:13:47.143180 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.143470 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:48.100483 (+957013us) log.cc:844] Serialized 14 byte log entry
0709 13:13:48.210562 (+110079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:48.223137 (+ 12575us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:48.278893 (+ 55756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.287636 (+  8743us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.299978 (+ 12342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28269,"prepare.queue_time_us":666721,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":6521,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":19664,"thread_start_us":895675,"threads_started":2,"wal-append.queue_time_us":162668}
I20260709 13:13:48.329312 29469 rpcz_store.cc:276] 0709 13:13:46.256186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.256378 (+   192us) service_pool.cc:224] Handling call
0709 13:13:46.256757 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.257058 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:47.070998 (+813940us) log.cc:844] Serialized 14 byte log entry
0709 13:13:48.084528 (+1013530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:48.096654 (+ 12126us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:48.123784 (+ 27130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.168314 (+ 44530us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.190374 (+ 22060us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42645,"prepare.queue_time_us":70617,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":41467,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1054,"thread_start_us":1675327,"threads_started":3,"wal-append.queue_time_us":707463}
I20260709 13:13:48.385318 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.350106   871 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:48.298138   940 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.337548   819 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:48.336684   933 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.392253 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:48.395988 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 146501us
I20260709 13:13:48.425150   959 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:48.426357  1044 log.cc:927] Time spent T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:13:48.426023   959 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.427210 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.428045 29541 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.428817   959 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.395756   776 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:48.396710 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:48.432587 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:48.399214 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:48.378461   879 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.436084 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2219) took 1077 ms. Trace:
I20260709 13:13:48.399645   940 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.403527   680 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.436796   879 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.382716   945 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.437757 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:48.380879   847 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:48.440253 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:48.412359 29391 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:48.441136 30151 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:48.442337 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.442714 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:48.443687   776 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:48.436507 29465 rpcz_store.cc:276] 0709 13:13:47.358209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.658336 (+300127us) service_pool.cc:224] Handling call
0709 13:13:47.681800 (+ 23464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.123107 (+441307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.159309 (+ 36202us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.170067 (+ 10758us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.207917 (+ 37850us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:48.207965 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.216844 (+  8879us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.435727 (+218883us) raft_consensus.cc:1685] finished
0709 13:13:48.435752 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.435898 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33315,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3840,"thread_start_us":387085,"threads_started":2,"wal-append.queue_time_us":156261}
W20260709 13:13:48.446357  1047 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:13:48.434193 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:48.448643   933 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.450182   776 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:48.450590 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.416430  1042 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:48.416975 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 52125.8us
W20260709 13:13:48.452643 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.452852 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.453608 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:48.418577 29396 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:48.454681 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.455634 29537 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:48.425532 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:48.450742   776 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.457077   776 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.458870 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.459200   999 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:48.459657 29393 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.459734   999 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.460386   999 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:48.460654   680 consensus_queue.cc:1059] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:48.463359   887 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:48.463841   887 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:48.465068   979 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:48.472735 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.473474 29394 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:48.414404 32204 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:48.418727 29295 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 9, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 9 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:48.418897 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.420351 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:48.422120 30159 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:48.436228   784 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.443164 29391 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.413939 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:48.450515 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.442854 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.478407 32204 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.490247 29392 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.465660   979 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:48.465034   887 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.517282 29468 raft_consensus.cc:1240] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:48.509951 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 84587us
W20260709 13:13:48.523917 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 74669.1us
I20260709 13:13:48.504601 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:48.519088 29465 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:13:48.523299 29546 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:48.513720 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.507179 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:48.533516 29395 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:48.531730   892 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.531960  1042 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:48.519310  1030 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:48.534945   892 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.535219  1042 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.535765   887 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.535530  1030 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.537727  1042 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.537949  1030 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.510221   675 raft_consensus.cc:2764] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:13:48.510179   784 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.539000  1026 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.505374 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:48.539703  1026 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.540555 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:48.531984   979 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:48.531622   680 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:48.514397 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.510753 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.515242 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:48.507977 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:48.537590   892 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.545790 29537 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:48.542369 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.551611 29464 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:48.552122 29397 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.538512  1024 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:13:48.544961 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:48.547528 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:48.554911 29388 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:48.555316 29468 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.542208  1026 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.498315 29471 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:48.541385 29470 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:48.547331 32204 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.551744   680 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.557950 29467 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:48.493398 29295 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 9, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:48.558768 29541 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:48.560284 29472 raft_consensus.cc:2393] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:48.551157 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:48.544450 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.560819 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:48.564643 29391 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:48.567939 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.581034 30152 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:48.587388 29396 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:48.591851 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.593122 29541 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:48.595418 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:48.597687 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.605118 29396 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.607015 29295 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:48.611126 29394 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.611045 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.611897 29390 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:48.608790 29465 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:48.575975   831 consensus_queue.cc:1059] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:13:48.606036   784 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:48.614179  1024 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:48.617316 29392 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:48.627226 29390 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:48.643249 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:48.643399 29539 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:48.703187 29397 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
W20260709 13:13:48.650327 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48452.4us
W20260709 13:13:48.622397  1061 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:13:48.649238   933 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:48.642182   784 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.657543 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:48.706463   933 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.658154 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:48.707970 29538 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:48.654865   924 consensus_queue.cc:1059] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:13:48.634934 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:48.654560 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.657029   831 raft_consensus.cc:3055] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:48.708314   784 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.706965 29542 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.709383 29295 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 9, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:48.662787 29388 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:48.674804 30159 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:48.652267 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:48.712349 29438 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:48.662650 29540 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:48.650776 29546 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:48.698287 30151 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:13:48.655720 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:48.675032 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.620020  1029 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:48.704676 29468 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:13:48.643528 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:48.713613   831 raft_consensus.cc:740] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:48.722922 29541 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.722540 29394 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
W20260709 13:13:48.621277  1055 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 13:13:48.656567   675 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.742745   968 raft_consensus.cc:2764] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:13:48.745054   831 consensus_queue.cc:260] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.746734   831 raft_consensus.cc:3060] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.654168  1024 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.678074   874 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:48.747403  1026 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:48.748111   874 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.632830   871 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:48.750860   871 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.753533 29512 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:48.739893   900 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:48.741273  1029 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:48.674623   680 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:48.643900   776 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.746631   879 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:48.731308 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 79126.6us
I20260709 13:13:48.764091 29537 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:48.773923 29295 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 2 to 5, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:48.723503   933 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:48.790117 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 155243us
I20260709 13:13:48.796999 29393 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:13:48.747416  1024 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.765102  1029 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.800622   680 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:48.758149   784 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:13:48.801987 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 197697us
I20260709 13:13:48.802501   945 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.778930   879 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.806944   892 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:48.763573   900 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.771268   819 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:13:48.803642 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.822299 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:48.742513   675 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.775175   874 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.813185  1029 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.841802 29541 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:48.812919   871 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.848220 32204 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:48.849004 32204 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:48.848204 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:48.778723   968 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:13:48.834723   879 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:48.861068 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 217973us
I20260709 13:13:48.794998  1031 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:13:48.834170   900 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.865767 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:48.866755 29396 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:13:48.875798   680 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:48.876320   704 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:48.876766   704 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.877113   704 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.874811 32204 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:48.879968 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 57803.8us
W20260709 13:13:48.881469 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.860296   819 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:48.880748 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:48.883016 29438 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:48.897733   936 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:48.898288   936 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.898819   936 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:48.899194   932 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:48.899864   932 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:48.900926   932 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:48.906900 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:48.906818 29363 leader_election.cc:400] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:13:48.908994 29363 leader_election.cc:403] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:13:48.912124   675 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:48.914891 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58565.7us
I20260709 13:13:48.915975 29509 leader_election.cc:400] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:48.916244   819 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.917904 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:48.864310   979 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.921629   979 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.916306 29509 leader_election.cc:403] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:13:48.931077 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.932551 29542 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:48.935263 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:48.857577   945 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:48.936121   871 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:48.937515   680 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7.
I20260709 13:13:48.935420   776 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:48.955397 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.956418 29393 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.957053 29391 raft_consensus.cc:1275] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:48.960078 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:48.961474  1067 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:48.963207 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:48.964164 30159 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.967624 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:48.969445 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.948629   924 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:13:48.971618 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:48.972736 29394 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:48.944531 29438 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:48.990092 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.993248 29390 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:49.005075 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:48.933364   999 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.008351 29397 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:48.987900   784 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.035651 29469 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:49.052040 29389 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:49.053349 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:49.054555 29395 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:49.056881 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:49.051033 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:49.057768 30152 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:49.072371 30156 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:49.045413   933 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:49.082983 29392 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:49.085574 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:49.086047 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 141572us
I20260709 13:13:49.083033 29390 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:49.076534 29393 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:49.061858  1067 raft_consensus.cc:697] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:49.090489  1067 consensus_queue.cc:237] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.090962   879 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.093555   879 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:49.094600 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:49.097165   874 raft_consensus.cc:3055] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:49.097675   874 raft_consensus.cc:740] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:13:49.098606 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 163455us
I20260709 13:13:49.115391 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:49.116107 29541 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.124023 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.137949 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.115093   933 raft_consensus.cc:697] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:49.144214  1024 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.145147   933 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.142874 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:49.143590   704 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.148765 29388 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:49.155118 30159 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:49.188158 29541 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:49.188992 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.190390 30156 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:49.119370   847 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:13:49.196455 29467 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:49.201017  1068 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:13:49.201540 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.206997 30151 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:49.214314  1065 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:13:49.227698 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 109238us
I20260709 13:13:49.219671 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.234817 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:49.186502   680 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:49.187588  1024 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.240461 29469 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:49.218411   784 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.242512 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.241303 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:49.243067 29393 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:49.122486   874 consensus_queue.cc:260] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.250571 29463 raft_consensus.cc:1240] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:49.252213 29465 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:49.255378 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:49.270670 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.257546   936 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.263792  1024 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.264246   999 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:49.261094   900 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.278141  1029 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.279444  1073 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.283306 30123 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:49.265928   784 consensus_queue.cc:1059] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:13:49.269722   874 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:49.291882   900 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.297940   979 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.297793 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.314164 29509 leader_election.cc:400] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:13:49.314738 29509 leader_election.cc:403] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:13:49.315596  1080 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:49.305557  1073 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.320093  1073 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:49.320822 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.303622   979 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.321802   979 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.315589   784 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.327613   784 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.328431   936 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:49.330868  1066 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.331776  1066 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.336807  1029 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:49.338116 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.339293  1024 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.340103  1024 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:13:49.343668 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.331822 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:49.352512 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 54840us
I20260709 13:13:49.353524 29435 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:13:49.352399 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 49750.5us
I20260709 13:13:49.347430  1024 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:49.359969 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48831.4us
I20260709 13:13:49.348470   999 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:13:49.355760   936 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:13:49.366941  1041 raft_consensus.cc:3055] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:49.367507  1041 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:49.367889   784 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:49.368652  1041 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.369518 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.370380 29471 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:49.370613 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.372046   776 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.373044 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:49.374034   776 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.373087 29512 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:49.375792   784 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:49.369098 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:49.385496 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.376217   784 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.388170   784 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.392001 32204 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:49.392541 32204 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.392901 32204 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.394665   999 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:49.398089  1073 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.398842   776 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.398810  1073 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.399516   776 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.401467  1073 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.401712   776 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.359001  1067 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.367156  1066 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.410037 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.416507 29471 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:49.370322  1041 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.418859 32204 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.402331   776 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.427366   887 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:13:49.433279 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.434000 32204 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:49.437115 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 51742.8us
I20260709 13:13:49.444453 29541 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:49.451036 29435 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:49.435484   903 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.453593  1026 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:49.453943 29545 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:49.454087 29542 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:49.454285  1026 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.456701  1026 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:49.459229 29541 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:49.460372 29543 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:49.446429 29438 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:49.463143  1067 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:49.467571  1080 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:49.470384 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 101417us
I20260709 13:13:49.472126   979 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.475145 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:49.475344   979 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.475852   887 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.476040   936 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:49.476526   887 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.480684 29545 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:49.469576  1030 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:49.475903 29544 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:49.483253  1069 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.339s	user 0.005s	sys 0.000s
I20260709 13:13:49.471560 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.488629   819 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:49.489215   819 raft_consensus.cc:697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:49.489385 29509 leader_election.cc:400] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:49.489753 29509 leader_election.cc:403] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:49.490619   842 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:13:49.490260   819 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.496021   945 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:49.497215   704 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.498191  1042 raft_consensus.cc:3055] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:49.498625  1042 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:49.499469   887 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:49.499588  1042 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.500896  1042 raft_consensus.cc:3060] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.501777 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:49.504616  1091 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:13:49.506191 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 96318.3us
I20260709 13:13:49.507197 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.508437  1066 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.509564 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:49.511395 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:49.515338  1090 log.cc:927] Time spent T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:13:49.515563 29544 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:49.499563 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:49.519642 32204 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:49.521127   784 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.530963 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.543097 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:49.544274 29467 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:49.545214 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 105920us
I20260709 13:13:49.543387 29465 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
W20260709 13:13:49.525831 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 139089us
W20260709 13:13:49.549240 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 111307us
I20260709 13:13:49.550800 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:49.551254 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.552080 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:49.553086 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.554317 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:49.555140 29390 raft_consensus.cc:2376] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10. Re-sending same reply.
I20260709 13:13:49.556407 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:49.557153 29396 raft_consensus.cc:2376] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10. Re-sending same reply.
I20260709 13:13:49.560181 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:49.561654 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:49.562161 29468 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 10. Ops: []
I20260709 13:13:49.563932 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:49.565060 29395 raft_consensus.cc:2376] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9. Re-sending same reply.
I20260709 13:13:49.568506 29394 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:13:49.522419   887 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.570474 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:49.573975 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74485.4us
I20260709 13:13:49.450621   776 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.543334  1030 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:49.582067 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.590844  1076 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:49.591609 29438 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:49.592504   932 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:49.593878   968 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:49.598651 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:49.599962 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.601912 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:49.602787 29464 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.570204   940 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:13:49.605484 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 54406.3us
I20260709 13:13:49.607426 30123 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:49.610747 29435 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:49.589594  1080 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:13:49.586280   945 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:13:49.606830   887 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.610087   680 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:49.638630 29435 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:49.639917   784 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:49.641324 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:49.642094 29465 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.630030  1078 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:49.634210  1080 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:49.639994   940 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:49.633138  1031 raft_consensus.cc:2804] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:49.643920 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:49.648326 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:49.642195   776 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.644469  1080 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:49.650727 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 46730.4us
W20260709 13:13:49.653613 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:49.657860 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.658609 29435 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:49.663553 29542 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:49.645386  1030 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.667326   903 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:49.668040   903 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:49.668457 29545 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:49.669158   903 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.671700  1031 raft_consensus.cc:697] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:49.672868  1031 consensus_queue.cc:237] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.679319 29509 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:49.680617 29464 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:49.646883  1093 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:49.684633 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.652423  1078 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:49.695416 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 117745us
I20260709 13:13:49.698741 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:49.700708  1066 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:49.701500   776 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:49.703058 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:49.703845   776 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:49.704270   776 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.704639   776 raft_consensus.cc:3060] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.707155  1066 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:49.708390  1066 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:49.708737  1066 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:49.709013  1024 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.709861 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:49.710708 29395 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:49.711766 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53229.2us
I20260709 13:13:49.682267   940 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:49.683490   680 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:49.714015 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.709592   874 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.723820 29435 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:49.726871 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:49.727608 30123 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:49.692854  1084 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:49.797721 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 73957.1us
I20260709 13:13:49.798631 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:49.801632 29388 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.733876   784 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:49.723126   680 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:49.709619  1024 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:49.815433 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 87895.2us
I20260709 13:13:49.810644 29435 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:49.731582  1094 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.819947 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 101249us
I20260709 13:13:49.739318  1083 raft_consensus.cc:2804] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:49.815093  1069 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:13:49.831979 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.806488   959 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:49.735066  1033 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:13:49.844467   959 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:49.846601   959 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.817294  1041 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.818872   680 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:49.739126   874 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.804629  1084 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:49.821342  1065 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:13:49.870333 29543 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:49.871140  1083 raft_consensus.cc:697] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:49.871671 29546 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:13:49.872342 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.872927 32204 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:49.901513 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:49.876201   887 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.879024 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 49419.3us
I20260709 13:13:49.881868  1076 consensus_queue.cc:1048] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:49.892190  1041 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.910895  1083 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.838186  1078 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.920238 32204 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.860630   936 raft_consensus.cc:2804] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:49.931883 32204 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.741496  1066 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.936174 29471 raft_consensus.cc:1275] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:13:49.947284 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 111530us
I20260709 13:13:49.948611 30123 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:49.950982  1098 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260709 13:13:49.923493   940 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:49.952389  1102 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:13:49.952951   932 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:49.956009 30123 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:49.978353 32204 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:49.930063   887 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:49.950423  1095 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:49.931386  1033 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:13:49.830106  1094 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:49.989831  1076 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:49.994251  1080 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:50.000154 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.001611 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:50.040568 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 167466us
I20260709 13:13:50.044658 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:50.047451 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.048434 29543 raft_consensus.cc:2368] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:50.050670 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:50.052049   874 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:50.055982  1030 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:50.058110  1030 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:50.068727  1080 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:50.070971 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:50.072960 29391 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:50.074602 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:50.076979 29390 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:50.077116  1092 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:50.077883  1092 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.078341  1092 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:50.079907  1067 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:50.080600  1067 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.082053  1024 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:50.083437  1067 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:50.083719  1121 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:13:49.962895   932 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:13:50.092460  1084 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.093688 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:50.094666 30151 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.099062 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:50.103313  1041 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:50.119160 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 68611.2us
W20260709 13:13:50.083315  1109 log.cc:927] Time spent T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:13:50.127612 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.136844 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:50.141992 29390 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:50.147083 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:50.074717  1066 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:13:50.153807 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:50.154757 29396 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:50.159425 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:50.160005 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:50.161134 29391 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:50.164194 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:50.164808 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 176223us
I20260709 13:13:50.168143 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:50.163178 29388 raft_consensus.cc:2468] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:50.172251 30156 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:50.175627 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:50.176760 32204 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:50.177376 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:50.128903   959 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:50.128952  1041 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.165962 30123 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:50.201795 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.206532 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.206815 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:50.232221 30151 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
W20260709 13:13:50.202593  1104 log.cc:927] Time spent T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.378s	user 0.000s	sys 0.006s
I20260709 13:13:50.227022 29389 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
W20260709 13:13:50.227273 29435 consensus_peers.cc:597] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 133108182cae493ab908290bfa9179d1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:50.235916 29465 consensus_meta.cc:287] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.006s
W20260709 13:13:50.238917 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 60001.1us
I20260709 13:13:50.239253 29465 raft_consensus.cc:2468] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:50.240023 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:50.167809  1067 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:50.243142 29542 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:50.187868   933 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:50.167305   936 raft_consensus.cc:697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:50.236052   959 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:50.227021 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:50.292322 32204 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:50.242002 29363 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.973s (SENT) [suppressed 52 similar messages]
W20260709 13:13:50.293484 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51526.7us
I20260709 13:13:50.294600 29467 raft_consensus.cc:606] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:50.296687 32204 raft_consensus.cc:697] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:50.229308   784 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:50.297930 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 58049.6us
I20260709 13:13:50.297976 32204 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.317723 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:50.242933   874 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:50.296432  1069 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:13:50.222340  1041 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.337710 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.355600 29542 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:50.366549 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.370021 29546 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 13.
I20260709 13:13:50.371968   936 consensus_queue.cc:237] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.372761  1128 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:50.377038 29397 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:13:50.379073 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.326526   784 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.385702 29391 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:50.388110 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.389127 29539 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:50.343668   874 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.390836 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.391650 29540 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:50.391920 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.392527 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.393451 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.393949 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.394351 29541 raft_consensus.cc:2368] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:13:50.390125 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.395161 29539 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:50.395200 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:50.395817 29541 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:50.392764 29537 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:50.403462 30151 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:13:50.397563  1114 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:50.407395 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:50.318730  1119 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:50.411327 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.412571 29540 raft_consensus.cc:2410] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:50.418103 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.418464 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.419493 29546 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:50.292081  1067 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.458930   784 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:50.460487   879 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:50.421176  1083 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:50.489290 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.492807 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:50.487875 29537 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:13:50.452440   968 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.004s
I20260709 13:13:50.495483 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:50.490731 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49300us
I20260709 13:13:50.423202  1078 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:13:50.439257  1094 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:50.422801  1026 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:13:50.513993 29546 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:50.500481 29542 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:50.515503 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.520789 29537 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:50.516834 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:50.500504  1093 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.808s	user 0.016s	sys 0.000s
W20260709 13:13:50.522303 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:50.511993 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 217758us
W20260709 13:13:50.526985  1125 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 13:13:50.528465  1117 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:13:50.529711 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 363844us
I20260709 13:13:50.530777   887 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:50.531710  1067 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:50.532523  1126 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 13:13:50.533879  1123 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:13:50.535415  1041 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:50.500277   932 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:13:50.451411   959 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.559896 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:50.566257 30123 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:50.562562  1093 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:50.571480 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:50.551237  1115 log.cc:927] Time spent T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.644s	user 0.003s	sys 0.000s
I20260709 13:13:50.461439  1024 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:13:50.576984 29546 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:13:50.609570 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 208818us
I20260709 13:13:50.591928 29543 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:50.509954   933 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:50.594566 29512 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:50.569567   680 consensus_meta.cc:287] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.656s	user 0.014s	sys 0.000s
I20260709 13:13:50.600530  1096 raft_consensus.cc:2804] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:50.600188 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.604373 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:50.595146   784 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.584734  1067 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:50.617986 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.598021   887 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.638303 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.639482  1137 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:50.616053   933 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:50.635013   784 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.627152   680 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.644749 29397 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:50.648350 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 53882.1us
I20260709 13:13:50.650530 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:50.630616   776 consensus_meta.cc:287] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.920s	user 0.015s	sys 0.004s
I20260709 13:13:50.669943 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.673568 29540 raft_consensus.cc:1240] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:50.653538   933 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.665067  1042 raft_consensus.cc:2804] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:50.684463 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.659868  1096 raft_consensus.cc:697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:50.728993 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.731750 29538 raft_consensus.cc:2376] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 13. Re-sending same reply.
I20260709 13:13:50.647116  1067 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.666064   776 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.753576 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.757457 29542 raft_consensus.cc:2376] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6. Re-sending same reply.
I20260709 13:13:50.663201   887 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.753868 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:50.668126  1137 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.772588 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.743631  1042 raft_consensus.cc:697] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:50.777521 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:50.760347  1092 consensus_meta.cc:287] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.681s	user 0.015s	sys 0.000s
I20260709 13:13:50.755820  1128 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:50.801247 29545 raft_consensus.cc:2393] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:50.805727 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 188098us
I20260709 13:13:50.816663 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2715) took 1165 ms. Trace:
I20260709 13:13:50.777645  1144 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.776978  1024 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.820247 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.827742 29471 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:13:50.817353 29544 rpcz_store.cc:276] 0709 13:13:49.651660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.651911 (+   251us) service_pool.cc:224] Handling call
0709 13:13:49.669644 (+ 17733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.670167 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:49.800813 (+130646us) log.cc:844] Serialized 14 byte log entry
0709 13:13:49.845620 (+ 44807us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.846577 (+   957us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.846785 (+   208us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:49.846836 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.846950 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.546668 (+699718us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:50.801846 (+255178us) raft_consensus.cc:1685] finished
0709 13:13:50.816288 (+ 14442us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.816551 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132855,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":9425,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":1685,"spinlock_wait_cycles":17540480,"thread_start_us":117942,"threads_started":2,"wal-append.queue_time_us":65518}
I20260709 13:13:50.835988  1137 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:50.836882  1137 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:50.787266   932 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:13:50.844204 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 90430us
I20260709 13:13:50.804639  1092 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.817293   968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39032 (request call id 14) took 10605 ms. Trace:
I20260709 13:13:50.849571 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.852847 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.855116 29544 raft_consensus.cc:2368] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
W20260709 13:13:50.860463  1066 consensus_meta.cc:287] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.005s
I20260709 13:13:50.863492 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.865022 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.865676 29539 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:50.870507  1140 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:50.871038  1139 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.871219  1140 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.871948  1139 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.878085   680 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:50.879323  1143 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:50.880815   903 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:50.881309   932 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:50.885607 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.894305 29395 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:50.914206 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:50.918452 30126 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.630s (SENT)
I20260709 13:13:50.919075 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:50.927628 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133108182cae493ab908290bfa9179d1"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:50.928557 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.944794 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.950037 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.837471  1024 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.945881 29539 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:13:50.961094 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.852793  1137 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.832567  1144 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:50.829126  1096 consensus_queue.cc:237] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:50.986095 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 67687.5us
I20260709 13:13:50.986976 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.989723 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:50.968600  1140 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:50.955390  1093 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:51.015383 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:50.849767  1042 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:50.957598  1141 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.021000 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1974) took 1119 ms. Trace:
I20260709 13:13:50.958611   784 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:51.029266 29539 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:51.029739 30123 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:51.036703 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.034241 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:51.037223 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.036823 29463 rpcz_store.cc:276] 0709 13:13:49.901521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.901677 (+   156us) service_pool.cc:224] Handling call
0709 13:13:49.910940 (+  9263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.919717 (+  8777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.919770 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.936191 (+ 16421us) log.cc:844] Serialized 26 byte log entry
0709 13:13:50.425216 (+489025us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:50.716830 (+291614us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.020675 (+303845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.020752 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.020795 (+    43us) raft_consensus.cc:1685] finished
0709 13:13:51.020808 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.020934 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20400,"prepare.queue_time_us":523817,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":120166,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":12708,"spinlock_wait_cycles":1512320,"thread_start_us":922304,"threads_started":3,"wal-append.queue_time_us":616647}
I20260709 13:13:51.041110  1153 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:51.019222   680 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.042887 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.047497 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:51.048309 29542 raft_consensus.cc:2368] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8.
I20260709 13:13:51.055907 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:51.028570   776 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:51.041712  1153 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.070017  1153 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:51.068255 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.070391 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.038338  1067 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.066824 29544 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:51.079897 29542 raft_consensus.cc:2393] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 12: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:51.102752  1161 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:13:51.104976 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.105464 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:51.106169 29541 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:51.107043 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.108139 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:51.108771 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:51.110111  1163 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:13:51.110795 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:51.111881  1142 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 13:13:51.112222 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.113654 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.115213 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.115748   874 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.117298 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:51.119180 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:51.120278 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:51.131042  1130 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.580s	user 0.005s	sys 0.000s
I20260709 13:13:51.120568 29539 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:13:51.149595 29542 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:51.247574 30126 leader_election.cc:336] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.979s (SENT)
I20260709 13:13:51.065328   887 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.287985 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:51.119901  1150 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 13:13:51.120849  1158 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:51.295523 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.058069   680 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.327411 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.327368 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.329710 29539 raft_consensus.cc:2393] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:51.300410 30126 leader_election.cc:336] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.578s (SENT)
I20260709 13:13:51.327448 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:51.342053 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:51.303236 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 263622us
I20260709 13:13:51.344501 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:51.353511 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.356827 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:51.148083  1156 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:51.301359   887 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:51.380281 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.383728 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:51.375970 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:51.378316  1160 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:13:51.405630 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:51.407699 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.768s (SENT)
I20260709 13:13:51.396204 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:51.275133   784 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:51.430812 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:51.433084   879 raft_consensus.cc:993] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:51.372459   874 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.414151   887 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:13:51.448027 29389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.023s	sys 0.039s
W20260709 13:13:51.459988 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 428706us
W20260709 13:13:51.540670 29389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.023s	sys 0.039s
I20260709 13:13:51.380235  1092 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:51.379081  1067 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:51.366780  1139 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.520399 29537 raft_consensus.cc:1275] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:51.557885 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 2037) took 1022 ms. Trace:
I20260709 13:13:51.558362 29537 rpcz_store.cc:276] 0709 13:13:50.535616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.515984 (+980368us) service_pool.cc:224] Handling call
0709 13:13:51.516484 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.557472 (+ 40988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.557796 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:51.554261 29541 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:51.589108 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:51.590186 29465 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:51.602650 29537 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:51.603601 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2743) took 1048 ms. Trace:
I20260709 13:13:51.604030 29537 rpcz_store.cc:276] 0709 13:13:50.554965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.588796 (+1033831us) service_pool.cc:224] Handling call
0709 13:13:51.589286 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.603235 (+ 13949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.603516 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:51.605733 29537 raft_consensus.cc:1240] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:51.619017 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:51.622977 29464 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:51.523904  1066 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:51.621095 29539 raft_consensus.cc:2410] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:13:51.511574  1145 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:51.617969  1164 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.590s	user 0.000s	sys 0.001s
I20260709 13:13:51.563462  1137 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:50.853792   968 rpcz_store.cc:276] 0709 13:13:40.180916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.181604 (+   688us) service_pool.cc:224] Handling call
0709 13:13:40.248500 (+ 66896us) log.cc:844] Serialized 513 byte log entry
0709 13:13:40.509752 (+261252us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5400087da0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e891a142 00007f61e88faeaa 00007f61e8901d53 00007f61e8901cd9 00007f61e8901c69 00007f61e8901c31 00007f61e8900dfd 000000000038f354 000000000038f199 00007f61e58b4475
0709 13:13:40.523691 (+ 13939us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b180033c280. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:13:40.529532 (+  5841us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b180033c280. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8921b26 00007f61e891b49a 00007f61e891a714
0709 13:13:40.530171 (+   639us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b5400087da0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8921b26 00007f61e891b49a 00007f61e891a714 00007f61e88faeaa 00007f61e8901d53 00007f61e8901cd9 00007f61e8901c69 00007f61e8901c31 00007f61e8900dfd 000000000038f354
0709 13:13:40.580777 (+ 50606us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b180033c280. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:13:41.251268 (+670491us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4c0035f300. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e6c6da20 00007f61e6c7ea29 00007f61e6c7f13f 00007f61e6c432ab 00007f61e6c70f3c 00007f61e6c713fe 00007f61e6efe50b 00007f61e88fd381 00007f61e88fb26b 00007f61e8901d53 00007f61e8901cd9
0709 13:13:41.477423 (+226155us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b4c0035f300. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e6c6da20 00007f61e6c7ea29 00007f61e6c7f13f 00007f61e6c432ab 00007f61e6c70f3c 00007f61e6c713fe 00007f61e6efe50b 00007f61e88fd381 00007f61e88fb26b 00007f61e8901d53 00007f61e8901cd9
0709 13:13:50.775888 (+9298465us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":253,"mutex_wait_us":118604,"raft.queue_time_us":74028,"raft.run_cpu_time_us":14272,"raft.run_wall_time_us":1952950,"spinlock_wait_cycles":314966912,"thread_start_us":127301,"threads_started":1,"wal-append.queue_time_us":198625,"wal-append.run_cpu_time_us":2507,"wal-append.run_wall_time_us":1010625}
I20260709 13:13:51.539592   784 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.624747  1139 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:51.685958  1151 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:51.687875 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2529) took 1090 ms. Trace:
I20260709 13:13:51.688088  1189 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:51.688405 29397 rpcz_store.cc:276] 0709 13:13:50.597888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.666051 (+ 68163us) service_pool.cc:224] Handling call
0709 13:13:50.684313 (+ 18262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:50.896768 (+212455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.896815 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:50.917233 (+ 20418us) log.cc:844] Serialized 52 byte log entry
0709 13:13:51.125596 (+208363us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:51.125640 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.125736 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.687590 (+561854us) raft_consensus.cc:1685] finished
0709 13:13:51.687612 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.687793 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34918,"raft.queue_time_us":151915,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":317513,"threads_started":2,"wal-append.queue_time_us":729965}
W20260709 13:13:51.687923  1162 log.cc:927] Time spent T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:13:51.690855  1186 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:51.563073   874 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.044833  1141 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.702672 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.703516 30153 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:51.706352 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.602193  1067 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:51.707047 30152 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:13:51.714388 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2742) took 1187 ms. Trace:
I20260709 13:13:51.715180 29545 rpcz_store.cc:276] 0709 13:13:50.527091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.464066 (+936975us) service_pool.cc:224] Handling call
0709 13:13:51.538894 (+ 74828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.713618 (+174724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.713690 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.713777 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:51.713845 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.714004 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.714222 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":167308,"threads_started":1}
I20260709 13:13:51.717451 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.717942 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.719764 29388 raft_consensus.cc:1275] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:51.724586 30156 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 11: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:51.725407 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2533) took 1077 ms. Trace:
I20260709 13:13:51.647483  1066 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:51.686925  1151 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:51.725826 29392 rpcz_store.cc:276] 0709 13:13:50.647814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.445382 (+797568us) service_pool.cc:224] Handling call
0709 13:13:51.445773 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.724984 (+279211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.725025 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.725078 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:51.725114 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.725195 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.725328 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78328,"raft.queue_time_us":116120,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":27297,"thread_start_us":200351,"threads_started":1}
I20260709 13:13:51.738143 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.738168 29392 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:51.739151 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2534) took 1085 ms. Trace:
I20260709 13:13:51.739477 29392 rpcz_store.cc:276] 0709 13:13:50.653915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.737380 (+1083465us) service_pool.cc:224] Handling call
0709 13:13:51.737777 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.738879 (+  1102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.739086 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:51.740042 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.692464  1139 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.741147 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.742525 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.742796  1139 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:51.744318 30154 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:51.746628 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:51.747689 30157 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 11: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:51.748613  1190 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.749351  1190 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.752422  1190 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:51.738416  1151 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.700532   879 raft_consensus.cc:1081] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:51.753371 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:51.689018  1189 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.759727 30153 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:51.762085 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 638) took 1156 ms. Trace:
W20260709 13:13:51.765277  1185 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:13:51.765153 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:51.766180 30157 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:51.767465  1191 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:51.767508  1031 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:51.768136  1191 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:51.768424  1031 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:51.770882  1031 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.773483  1189 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:51.775108 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2522) took 1436 ms. Trace:
I20260709 13:13:51.650170  1145 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:51.711915  1024 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.762619 29394 rpcz_store.cc:276] 0709 13:13:50.597266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.644495 (+ 47229us) service_pool.cc:224] Handling call
0709 13:13:50.645007 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.807243 (+162236us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:50.918531 (+111288us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.066875 (+148344us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.337871 (+270996us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b180048bc80. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61e8999060 00007f61e89ab716 00007f61e89bc287 00007f61e89bc208
0709 13:13:51.338907 (+  1036us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.379485 (+ 40578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.379570 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:51.379628 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.752981 (+373353us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000a5ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:51.753052 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.753198 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307115,"prepare.queue_time_us":326886,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":6365,"raft.queue_time_us":327448,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":52253,"spinlock_wait_cycles":411475328,"thread_start_us":217783,"threads_started":2,"wal-append.queue_time_us":383005}
I20260709 13:13:51.784708 30157 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:13:51.779296 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 2032) took 1232 ms. Trace:
I20260709 13:13:51.787480 29539 rpcz_store.cc:276] 0709 13:13:50.533816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.343793 (+809977us) service_pool.cc:224] Handling call
0709 13:13:51.766224 (+422431us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540036cc54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:51.766393 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499044096}
W20260709 13:13:51.790288 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.775621 29390 rpcz_store.cc:276] 0709 13:13:50.325536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.326730 (+  1194us) service_pool.cc:224] Handling call
0709 13:13:50.361180 (+ 34450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.575837 (+214657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.575888 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.598622 (+ 22734us) log.cc:844] Serialized 26 byte log entry
0709 13:13:50.800674 (+202052us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:51.031951 (+231277us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.032619 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.032935 (+   316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.761733 (+728798us) raft_consensus.cc:1685] finished
0709 13:13:51.761766 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.761925 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188855,"prepare.run_wall_time_us":40,"raft.queue_time_us":184595,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"spinlock_wait_cycles":25311360,"thread_start_us":537900,"threads_started":3,"wal-append.queue_time_us":403278}
I20260709 13:13:51.795382 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:51.758302  1179 log.cc:927] Time spent T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
W20260709 13:13:51.765295  1168 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:13:51.803864 30158 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:51.725651  1172 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:51.807207 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:51.809887 30126 leader_election.cc:336] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.923s (SENT)
I20260709 13:13:51.807902 30152 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:51.726951   680 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:51.811692 29539 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:13:51.812036 29539 pending_rounds.cc:85] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 5
I20260709 13:13:51.810472 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:51.813985 29363 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.011s	sys 0.000s
W20260709 13:13:51.814312 29363 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.011s	sys 0.000s
W20260709 13:13:51.814646 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 764512us
I20260709 13:13:51.812260 29539 pending_rounds.cc:107] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:13:51.819211 29539 raft_consensus.cc:2889] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:51.805708  1183 log.cc:927] Time spent T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260709 13:13:51.828697 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.813021  1191 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.835002 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2741) took 1308 ms. Trace:
I20260709 13:13:51.840147 29544 rpcz_store.cc:276] 0709 13:13:50.526785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.462997 (+936212us) service_pool.cc:224] Handling call
0709 13:13:51.522633 (+ 59636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.834646 (+312013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.834678 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.834720 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:51.834750 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.834830 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.834940 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":220603,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":306349,"threads_started":1}
I20260709 13:13:51.819393  1095 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:51.843019 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.844746 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.839614 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:51.846935 30157 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:13:51.861840 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.862727 30159 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
W20260709 13:13:51.863330 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.867532 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.871420 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 595) took 1004 ms. Trace:
I20260709 13:13:51.849351  1189 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:51.874805  1189 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:51.877831  1189 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:51.881045  1116 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:51.828073  1144 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.910482  1141 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:51.819355  1172 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:51.839084   887 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:51.909952   874 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:51.871985 29537 rpcz_store.cc:276] 0709 13:13:50.867457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.621028 (+753571us) service_pool.cc:224] Handling call
0709 13:13:51.621425 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.851129 (+229704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.851184 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.851233 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:51.871053 (+ 19820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.871142 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.871332 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3689,"raft.queue_time_us":124023,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":225379,"threads_started":1}
I20260709 13:13:51.920481  1066 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.972625 29544 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:13:51.994380  1153 consensus_meta.cc:287] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.001s
I20260709 13:13:51.958587 29541 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:52.043419  1153 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.021374 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2527) took 1445 ms. Trace:
I20260709 13:13:52.035895 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.045832 29537 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:52.044768 29393 rpcz_store.cc:276] 0709 13:13:50.575601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.575975 (+   374us) service_pool.cc:224] Handling call
0709 13:13:50.607265 (+ 31290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.616472 (+  9207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.616506 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.635938 (+ 19432us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.904621 (+1268683us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b240011e118. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e573a9c4 00007f61e5738acb 00007f61e58f3dc9 00007f61e58f3a55 00007f61e58f2fb0 00007f61e8569488 00007f61e8569be8 00007f61e8541398 00007f61e853c76a 00007f61e853bbb6
0709 13:13:51.994093 (+ 89472us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b1800457fc0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1
0709 13:13:51.994320 (+   227us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:51.994371 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.994457 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.021061 (+ 26604us) raft_consensus.cc:1685] finished
0709 13:13:52.021079 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.021280 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133942,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":26281,"spinlock_wait_cycles":394177664,"thread_start_us":116090,"threads_started":1,"wal-append.queue_time_us":190121}
I20260709 13:13:52.046250 29537 pending_rounds.cc:85] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 3
I20260709 13:13:52.046406  1153 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:51.982415  1189 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:51.958313 29543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 2016) took 1628 ms (client timeout 1652 ms). Trace:
I20260709 13:13:51.971379 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 1979) took 1412 ms. Trace:
I20260709 13:13:52.046615 29537 pending_rounds.cc:107] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:52.037084 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:51.913677  1172 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:51.953640 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.048200 29543 rpcz_store.cc:269] 0709 13:13:50.330114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.330364 (+   250us) service_pool.cc:224] Handling call
0709 13:13:51.958019 (+1627655us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b54002d82d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:51.958211 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110409984}
I20260709 13:13:51.919783  1067 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:51.921465 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2519) took 1596 ms. Trace:
I20260709 13:13:52.044785 30152 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:52.037537 30151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 964) took 1132 ms. Trace:
W20260709 13:13:51.976589   933 consensus_meta.cc:287] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.245s	user 0.008s	sys 0.009s
W20260709 13:13:51.960530 29395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 2512) took 1923 ms (client timeout 2244 ms). Trace:
I20260709 13:13:51.962846 29389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2530) took 1364 ms. Trace:
I20260709 13:13:51.957561 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:51.912869 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2532) took 1277 ms. Trace:
I20260709 13:13:51.980321  1188 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:13:52.037942 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.066219 29391 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:52.050418 29471 rpcz_store.cc:276] 0709 13:13:50.559258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.559475 (+   217us) service_pool.cc:224] Handling call
0709 13:13:51.971128 (+1411653us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000d0554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:51.971272 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537147264}
I20260709 13:13:52.037268  1167 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.050999 29537 raft_consensus.cc:2889] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:52.051183 30154 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:52.043737 29542 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:52.069142 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2728) took 1644 ms. Trace:
I20260709 13:13:52.060269 29396 rpcz_store.cc:276] 0709 13:13:50.324557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.327023 (+  2466us) service_pool.cc:224] Handling call
0709 13:13:50.363976 (+ 36953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.738969 (+374993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.739116 (+   147us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.750969 (+ 11853us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.020358 (+269389us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:51.020409 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.020476 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.921128 (+900652us) raft_consensus.cc:1685] finished
0709 13:13:51.921163 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.921375 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143096,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":565336,"threads_started":2,"wal-append.queue_time_us":590960}
I20260709 13:13:52.064178 29388 rpcz_store.cc:276] 0709 13:13:50.635693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.353221 (+717528us) service_pool.cc:224] Handling call
0709 13:13:51.383297 (+ 30076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.720196 (+336899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.912555 (+192359us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54000a5fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:51.912789 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772900608}
I20260709 13:13:52.071290 29539 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:13:52.061545 29395 rpcz_store.cc:269] 0709 13:13:50.037438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.037629 (+   191us) service_pool.cc:224] Handling call
0709 13:13:51.960252 (+1922623us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54000a50d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:51.960414 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815476480}
I20260709 13:13:52.060774 29543 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:52.060635 30151 rpcz_store.cc:276] 0709 13:13:50.904782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.904952 (+   170us) service_pool.cc:224] Handling call
0709 13:13:50.905347 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.915742 (+ 10395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.915784 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.955943 (+ 40159us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.128956 (+173013us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:51.129008 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.129092 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.037261 (+908169us) raft_consensus.cc:1685] finished
0709 13:13:52.037288 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.037463 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":173,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19283,"thread_start_us":103238,"threads_started":1,"wal-append.queue_time_us":406356}
I20260709 13:13:51.912768  1145 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:52.074016 29540 rpcz_store.cc:276] 0709 13:13:50.424437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.426029 (+  1592us) service_pool.cc:224] Handling call
0709 13:13:50.450749 (+ 24720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.683908 (+233159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.068791 (+1384883us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b540017fcd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:52.069052 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511831936}
I20260709 13:13:51.920805   784 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:52.082736 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 457538us
I20260709 13:13:52.062623 29389 rpcz_store.cc:276] 0709 13:13:50.598215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.917421 (+319206us) service_pool.cc:224] Handling call
0709 13:13:50.917902 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.918501 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:51.541123 (+622622us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.777328 (+236205us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.796285 (+ 18957us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.796479 (+   194us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:51.796795 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.797012 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.797094 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.962526 (+165432us) raft_consensus.cc:1685] finished
0709 13:13:51.962556 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.962761 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18780,"prepare.queue_time_us":186661,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":10381,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":28820,"spinlock_wait_cycles":24789120,"thread_start_us":734682,"threads_started":2,"wal-append.queue_time_us":309024}
I20260709 13:13:52.028457 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.058640  1194 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:52.038275 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 198736us
I20260709 13:13:52.101094 29389 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:52.109103 29468 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:52.084110  1121 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:52.096858 29395 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:13:52.048175  1189 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:52.128583 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.135892 29468 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:13:52.141957 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.142714 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.077099   933 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.147097 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.147787 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.119484   887 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:52.150774 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 122488us
I20260709 13:13:52.161250 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.147416 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.155920 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.171322 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.173498 29391 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:13:52.180190 29466 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:52.193403 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.144847   819 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.197736 30154 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:52.209367 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.212118 30156 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.174264  1202 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:52.221140 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.224892 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:52.139206  1121 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.229614 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.235832 29471 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:52.187000   945 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:13:52.200104  1191 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:13:52.245949 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2744) took 1361 ms. Trace:
W20260709 13:13:52.248646 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.082464  1167 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.207064   819 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:52.267778 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 53242.3us
I20260709 13:13:52.246559 29546 rpcz_store.cc:276] 0709 13:13:50.884405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.768540 (+884135us) service_pool.cc:224] Handling call
0709 13:13:51.768889 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.769126 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:52.077566 (+308440us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.245473 (+167907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.245544 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:52.245609 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.245701 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.245864 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43472,"prepare.queue_time_us":376359,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":10844,"spinlock_wait_cycles":1623808,"thread_start_us":431268,"threads_started":2}
I20260709 13:13:52.275553 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2535) took 1541 ms. Trace:
I20260709 13:13:52.276007 29392 rpcz_store.cc:276] 0709 13:13:50.733988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.740813 (+1006825us) service_pool.cc:224] Handling call
0709 13:13:51.741187 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.741641 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.741671 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.742197 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.025970 (+283773us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:52.026037 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.026147 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.275298 (+249151us) raft_consensus.cc:1685] finished
0709 13:13:52.275322 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.275464 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2251,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":281149,"threads_started":1,"wal-append.queue_time_us":406998}
I20260709 13:13:52.276868 32204 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:52.277670  1172 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:52.126606  1194 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.279103  1172 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:52.279567  1148 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:52.280602  1194 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:52.278390 32204 consensus_queue.cc:1059] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:52.143651  1157 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:13:52.281874  1167 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:52.283188  1080 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:52.283584  1080 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:52.284518  1080 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:52.285791  1080 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:52.280529  1172 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:52.292016  1121 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:52.293303  1207 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:52.259625  1206 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:52.299770  1206 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:52.300256  1206 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.301492 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 1981) took 1165 ms. Trace:
I20260709 13:13:52.259833   784 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:13:52.301929 29463 rpcz_store.cc:276] 0709 13:13:51.135858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.274072 (+138214us) service_pool.cc:224] Handling call
0709 13:13:51.274741 (+   669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.462808 (+188067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.462861 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.477701 (+ 14840us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.833855 (+356154us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:51.833907 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.301000 (+467093us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540019c3d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:52.301058 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.301114 (+    56us) raft_consensus.cc:1685] finished
0709 13:13:52.301129 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.301417 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36559,"raft.queue_time_us":167274,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13269,"spinlock_wait_cycles":347127168,"thread_start_us":216219,"threads_started":1,"wal-append.queue_time_us":335277}
I20260709 13:13:52.269759 29509 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.308705 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.228252  1202 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:52.312805  1202 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:52.313936  1116 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:52.315225  1094 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:52.317067 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.325626 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.331297 29509 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:52.341265 30151 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:52.352200 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:52.377451  1202 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:52.378149  1202 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:52.379273  1202 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.380559 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:52.392139 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2746) took 1258 ms. Trace:
W20260709 13:13:52.394052 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 62919.5us
I20260709 13:13:52.392630 29545 rpcz_store.cc:276] 0709 13:13:51.133494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.824369 (+690875us) service_pool.cc:224] Handling call
0709 13:13:51.831639 (+  7270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.831932 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:52.158236 (+326304us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.391714 (+233478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.391782 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:52.391838 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.391921 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.392063 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64895,"prepare.queue_time_us":369531,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"thread_start_us":452350,"threads_started":2}
I20260709 13:13:52.377276 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.339803   784 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.339314  1192 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.377359 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:52.409616 30155 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
W20260709 13:13:52.417376 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 581400us
I20260709 13:13:52.422396 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.375284  1198 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:52.439167 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.428731   933 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:52.457696 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 140814us
I20260709 13:13:52.434262  1159 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.419409  1190 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:13:52.468338 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 598) took 1599 ms. Trace:
I20260709 13:13:52.472474 29541 rpcz_store.cc:276] 0709 13:13:50.868463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.642019 (+773556us) service_pool.cc:224] Handling call
0709 13:13:51.958226 (+316207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.043551 (+ 85325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.468044 (+424493us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54002d82d0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:52.468247 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726014720}
I20260709 13:13:52.436141   874 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:52.482550 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2536) took 1738 ms. Trace:
I20260709 13:13:52.483002 29394 rpcz_store.cc:276] 0709 13:13:50.744399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.786723 (+1042324us) service_pool.cc:224] Handling call
0709 13:13:51.787110 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.813573 (+ 26463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.813615 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.820771 (+  7156us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.164001 (+343230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:52.420383 (+256382us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.482176 (+ 61793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.482268 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.482317 (+    49us) raft_consensus.cc:1685] finished
0709 13:13:52.482335 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.482483 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":621446,"prepare.queue_time_us":46495,"raft.queue_time_us":7124,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7663,"spinlock_wait_cycles":13014272,"thread_start_us":499690,"threads_started":2,"wal-append.queue_time_us":415613}
I20260709 13:13:52.440908  1189 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:52.497675 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 75365us
I20260709 13:13:52.499356 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.507340 29363 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.431324  1198 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:52.531257 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:52.534179 29394 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:52.506217  1145 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:52.536567 29391 raft_consensus.cc:1275] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:52.566076 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:52.567791 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80844.3us
I20260709 13:13:52.556067 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:52.562114 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2541) took 1562 ms. Trace:
I20260709 13:13:52.569727 29395 rpcz_store.cc:276] 0709 13:13:51.000011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.088881 (+1088870us) service_pool.cc:224] Handling call
0709 13:13:52.089280 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.089559 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:52.173770 (+ 84211us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.548469 (+374699us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.561632 (+ 13163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.561706 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:52.561769 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.561877 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.562031 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109188,"prepare.queue_time_us":34840,"raft.queue_time_us":110600,"raft.run_wall_time_us":9539,"spinlock_wait_cycles":26876160,"thread_start_us":247036,"threads_started":1,"wal-append.queue_time_us":354875}
I20260709 13:13:52.571229 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:52.533591  1224 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:13:52.512648  1067 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:52.576524 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.507560   933 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:13:52.591346 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.560571  1151 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:52.478021  1159 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:52.585906 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.507417   874 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:52.598567 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.553561   819 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:52.586714 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.605680 30123 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:52.606606 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:52.605067 29468 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:13:52.605696 29470 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:52.607712 29389 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:13:52.611644 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.581629  1223 ts_tablet_manager.cc:933] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:52.603271 29363 connection.cc:256] RPC call timeout handler was delayed by -1.3645743790000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 13:13:52.620580 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1584743789999266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:13:52.621153 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1566968439999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 13:13:52.621269 29467 raft_consensus.cc:606] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:52.623003  1221 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:13:52.604759  1151 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:52.621613 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1278743790001045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
W20260709 13:13:52.629154 29363 connection.cc:256] RPC call timeout handler was delayed by -1.10089684400009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:13:52.631685 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.606316 29395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:13:52.632411 29395 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.632838 29395 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.612049  1076 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:52.617381  1116 raft_consensus.cc:2804] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:52.604552  1175 consensus_queue.cc:1048] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:13:52.646586  1218 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:13:52.607708  1121 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:13:52.648713 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.634258  1233 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:52.631403  1151 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:52.655795 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2539) took 1690 ms. Trace:
I20260709 13:13:52.656400 29396 rpcz_store.cc:276] 0709 13:13:50.965110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.073452 (+1108342us) service_pool.cc:224] Handling call
0709 13:13:52.085681 (+ 12229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.442019 (+356338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.442078 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.451695 (+  9617us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.457993 (+  6298us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:52.458032 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.458107 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.655456 (+197349us) raft_consensus.cc:1685] finished
0709 13:13:52.655494 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.655687 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":355698,"raft.queue_time_us":374216,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9793,"thread_start_us":5756,"threads_started":1,"wal-append.queue_time_us":170515}
W20260709 13:13:52.663491 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.668717 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.654816  1116 raft_consensus.cc:697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:52.648727  1140 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.644821  1076 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:52.675452  1220 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:13:52.674862  1116 consensus_queue.cc:237] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.675778  1159 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:52.676915  1231 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:13:52.727733  1229 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:13:52.728830 29538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 2030) took 2195 ms (client timeout 1857 ms). Trace:
I20260709 13:13:52.732963 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2540) took 1761 ms. Trace:
W20260709 13:13:52.740598 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 58170.3us
W20260709 13:13:52.675832  1216 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:13:52.755412 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 643) took 2106 ms. Trace:
W20260709 13:13:52.751474 29538 rpcz_store.cc:269] 0709 13:13:50.533021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.747571 (+214550us) service_pool.cc:224] Handling call
0709 13:13:52.728540 (+1980969us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002bbe54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:52.728723 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874911616}
I20260709 13:13:52.756040 29397 rpcz_store.cc:276] 0709 13:13:50.648638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.719999 (+1071361us) service_pool.cc:224] Handling call
0709 13:13:51.745348 (+ 25349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.786758 (+ 41410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.786811 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.786890 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:51.786939 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.755143 (+968204us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b54001257d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:52.755200 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.755341 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94477184}
I20260709 13:13:52.749467 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:52.751806 29388 rpcz_store.cc:276] 0709 13:13:50.971495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.073873 (+1102378us) service_pool.cc:224] Handling call
0709 13:13:52.085908 (+ 12035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.442259 (+356351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.442308 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.462600 (+ 20292us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.613216 (+150616us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:52.613266 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.613338 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.732705 (+119367us) raft_consensus.cc:1685] finished
0709 13:13:52.732732 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.732891 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":384825,"raft.queue_time_us":374102,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":32181,"thread_start_us":84726,"threads_started":1,"wal-append.queue_time_us":224528}
I20260709 13:13:52.752593 29396 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:13:52.749716  1242 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:52.768042 29397 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:52.746903  1157 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:52.784713 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:52.721616  1140 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:52.788424 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2538) took 1874 ms. Trace:
I20260709 13:13:52.788889 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:52.789223 29393 rpcz_store.cc:276] 0709 13:13:50.913836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.046762 (+1132926us) service_pool.cc:224] Handling call
0709 13:13:52.047169 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.448891 (+401722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.448936 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.449571 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.552556 (+102985us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:52.595133 (+ 42577us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.608120 (+ 12987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.608209 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.788183 (+179974us) raft_consensus.cc:1685] finished
0709 13:13:52.788210 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.788351 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":361542,"prepare.queue_time_us":40371,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":379176,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":5301,"spinlock_wait_cycles":7302400,"thread_start_us":45934,"threads_started":1,"wal-append.queue_time_us":171057}
I20260709 13:13:52.771641  1159 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:52.749804  1144 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:13:52.793042 29363 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.800695  1195 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.794620  1157 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.785804 29395 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:52.804329 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:52.809149  1219 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
I20260709 13:13:52.808881 29393 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.835235  1195 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:52.844471  1237 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:13:52.845790 29395 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:52.855981 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63007.5us
I20260709 13:13:52.857174 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:52.848829  1232 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:13:52.845914  1234 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:13:52.866997 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:52.868095 29395 raft_consensus.cc:2376] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10. Re-sending same reply.
I20260709 13:13:52.870685  1198 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:52.844566  1157 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:52.858853 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:52.895696   704 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:52.896533   704 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.897143 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2537) took 2137 ms. Trace:
I20260709 13:13:52.897675 29390 rpcz_store.cc:276] 0709 13:13:50.760147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.791449 (+1031302us) service_pool.cc:224] Handling call
0709 13:13:51.791936 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.380526 (+588590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.380566 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.381146 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.526001 (+144855us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:52.526061 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.526153 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.896868 (+370715us) raft_consensus.cc:1685] finished
0709 13:13:52.896900 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.897064 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622137,"raft.queue_time_us":579344,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":23193,"thread_start_us":144430,"threads_started":1,"wal-append.queue_time_us":259681}
I20260709 13:13:52.899480   704 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:52.900163  1137 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.900763  1137 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:52.903257  1137 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:52.851850   874 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:52.923650 29397 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.859339  1195 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:52.928911 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:52.955488 29393 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:52.934794  1076 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:52.964267 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 643) took 1134 ms. Trace:
W20260709 13:13:52.965183  1206 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.003s
I20260709 13:13:52.967391 30152 rpcz_store.cc:276] 0709 13:13:51.830016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.830179 (+   163us) service_pool.cc:224] Handling call
0709 13:13:52.963917 (+1133738us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54004736d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:52.964141 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454471424}
I20260709 13:13:52.942608   874 raft_consensus.cc:2764] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:13:52.980041  1076 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:52.986232  1076 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:52.998390 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 354748us
I20260709 13:13:53.013195  1140 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:53.032807 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 174030us
W20260709 13:13:53.041216 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.980351  1206 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.049552 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:53.053160 29363 leader_election.cc:400] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:53.054744 29363 leader_election.cc:403] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:53.063673  1206 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.066336  1151 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.069217 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:53.072438 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:53.080366  1093 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:53.081067  1093 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.078837  1140 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:53.102489 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.115243 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:53.078202  1073 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:53.121243 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:53.122412  1076 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:53.159441 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:53.161753 29509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.006s	sys 0.024s
W20260709 13:13:53.167178 29509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.006s	sys 0.024s
I20260709 13:13:53.137132   776 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:53.137542  1140 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:53.167948 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 772706us
I20260709 13:13:53.173607  1093 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:53.174846 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:53.161489  1165 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:53.180056  1165 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:53.180521  1165 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.180066 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 642) took 1359 ms. Trace:
I20260709 13:13:53.183020 30156 rpcz_store.cc:276] 0709 13:13:51.820265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.820411 (+   146us) service_pool.cc:224] Handling call
0709 13:13:51.825003 (+  4592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.212646 (+387643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.179757 (+967111us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400690fd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:53.179990 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889615744}
I20260709 13:13:53.178730  1151 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.195058   887 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:53.195667   887 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.196101   887 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:53.172468  1073 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:53.170426 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:53.200208  1024 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.200258  1139 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:13:53.208417 29394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.029s
W20260709 13:13:53.208909 29545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.010s	sys 0.030s
I20260709 13:13:53.202732  1151 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:53.213673 29545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.011s	sys 0.031s
W20260709 13:13:53.214569 29394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.004s	sys 0.029s
I20260709 13:13:53.201944  1024 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:53.227392 29539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.012s	sys 0.039s
W20260709 13:13:53.228459 29392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.018s
W20260709 13:13:53.229008 29392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.018s
W20260709 13:13:53.228477 29539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.039s
I20260709 13:13:53.238389 29466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 578) took 1130 ms. Trace:
I20260709 13:13:53.243117   776 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:53.244107   776 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:53.250993   776 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:53.256249   900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.016s	sys 0.040s
W20260709 13:13:53.258404   900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.016s	sys 0.040s
I20260709 13:13:53.239717 29466 rpcz_store.cc:276] 0709 13:13:52.107934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.108084 (+   150us) service_pool.cc:224] Handling call
0709 13:13:52.108419 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.181360 (+ 72941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.238006 (+1056646us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b540032d7d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:53.238296 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164466560}
I20260709 13:13:53.260605 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:53.262420 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59632.8us
W20260709 13:13:53.263723  1202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.009s	sys 0.027s
I20260709 13:13:53.270613 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:53.259579  1223 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.006s	sys 0.023s
I20260709 13:13:53.292582 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:53.279583  1250 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 13:13:53.317874 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:53.291242  1202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.009s	sys 0.027s
I20260709 13:13:53.318750 29390 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
W20260709 13:13:53.312125 29544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.019s	sys 0.029s
W20260709 13:13:53.325145 29544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.020s	sys 0.029s
W20260709 13:13:53.270219  1116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.008s
I20260709 13:13:53.292383 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.279570  1139 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:53.325047 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.325886 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.331077 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:53.306354 29537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.022s
W20260709 13:13:53.311389  1223 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.006s	sys 0.026s
I20260709 13:13:53.364130 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:53.403435 29537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.010s	sys 0.052s
W20260709 13:13:53.403638 29546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.005s	sys 0.018s
I20260709 13:13:53.370301 29393 raft_consensus.cc:1240] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:13:53.370698 29391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.000s	sys 0.020s
I20260709 13:13:53.334347 29545 raft_consensus.cc:2393] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:53.384495 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 73471.6us
I20260709 13:13:53.334291 29397 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:53.335182 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.365031 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.403574 29544 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:53.416026 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.452183 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:53.448838 29391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.000s	sys 0.031s
W20260709 13:13:53.449245 29546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.006s	sys 0.018s
W20260709 13:13:53.403573 29541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.006s	sys 0.018s
W20260709 13:13:53.453708 29541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.009s	sys 0.022s
I20260709 13:13:53.461215 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.462853 29392 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:53.461915 29544 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
I20260709 13:13:53.466091 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.466775 29544 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:13:53.467700 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.319924   874 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Leader election lost for term 5. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 5. Current term is 6.
I20260709 13:13:53.308034  1165 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.334489  1073 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:53.481890 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.485668 29545 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:53.489519 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2776) took 1073 ms. Trace:
I20260709 13:13:53.490103 29538 rpcz_store.cc:276] 0709 13:13:52.416172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.765322 (+349150us) service_pool.cc:224] Handling call
0709 13:13:52.783721 (+ 18399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.784029 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.784067 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.798468 (+ 14401us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.257551 (+459083us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:53.259241 (+  1690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.260749 (+  1508us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.489209 (+228460us) raft_consensus.cc:1685] finished
0709 13:13:53.489244 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.489441 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":441395,"threads_started":1,"wal-append.queue_time_us":598135}
I20260709 13:13:53.492746 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:53.497263  1235 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.738s	user 0.000s	sys 0.002s
I20260709 13:13:53.460889  1223 tablet_copy_client.cc:323] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:13:53.506057  1190 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:53.461278  1122 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.494223 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:53.476907  1273 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:13:53.517765 29469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 584) took 1133 ms. Trace:
I20260709 13:13:53.472004  1198 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:53.467027  1206 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:53.405162  1139 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:53.555495 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.524705 29469 rpcz_store.cc:276] 0709 13:13:52.384091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.384297 (+   206us) service_pool.cc:224] Handling call
0709 13:13:52.384719 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.385167 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.385209 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.397011 (+ 11802us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.525512 (+128501us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:52.525579 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.525687 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.496531 (+970844us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:53.511695 (+ 15164us) raft_consensus.cc:1685] finished
0709 13:13:53.511723 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.517687 (+  5964us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5952,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":16295,"spinlock_wait_cycles":8263552,"thread_start_us":87269,"threads_started":1,"wal-append.queue_time_us":225585}
I20260709 13:13:53.544991 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.546438 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.550904 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.476976  1202 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.557279 29388 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:53.556558 29397 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:53.557224 29394 raft_consensus.cc:2468] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:53.559760 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.577680 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.559352 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.584398 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.584568 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.581607 29390 raft_consensus.cc:2410] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:13:53.584517 29392 raft_consensus.cc:1240] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:53.587610 29394 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:53.589890 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:53.579365  1202 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:53.601958  1202 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:53.558549  1198 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:53.608125 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.559705  1206 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:53.538292  1190 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.611123 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.615257 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2773) took 1271 ms. Trace:
I20260709 13:13:53.552778  1122 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:53.617951 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:53.627206 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.628767 29537 rpcz_store.cc:276] 0709 13:13:52.344075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.731590 (+387515us) service_pool.cc:224] Handling call
0709 13:13:52.732081 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.750633 (+ 18552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.750668 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.751212 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.404058 (+652846us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:53.404108 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.404189 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.615009 (+210820us) raft_consensus.cc:1685] finished
0709 13:13:53.615030 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.615191 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18035,"raft.queue_time_us":24392,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":6135,"thread_start_us":628778,"threads_started":1,"wal-append.queue_time_us":785550}
I20260709 13:13:53.633893 29394 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:53.617578 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2779) took 1050 ms. Trace:
I20260709 13:13:53.635324 29543 rpcz_store.cc:276] 0709 13:13:52.566829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.180559 (+613730us) service_pool.cc:224] Handling call
0709 13:13:53.180997 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.181318 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:53.181355 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.181916 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.403248 (+221332us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:53.403304 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.403416 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.617305 (+213889us) raft_consensus.cc:1685] finished
0709 13:13:53.617337 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.617503 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":220835,"threads_started":1,"wal-append.queue_time_us":430976}
I20260709 13:13:53.620198  1147 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:53.638593 29544 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 4.
W20260709 13:13:53.642164  1225 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.002s	user 0.003s	sys 0.000s
I20260709 13:13:53.626566  1033 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:53.648357  1033 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.652973  1198 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:53.654790  1147 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.657773  1147 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.638384 29393 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
W20260709 13:13:53.658392 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.660365 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:53.666241 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.662254 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:53.666245 29397 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:53.677161 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:53.676388 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:53.679518 29469 raft_consensus.cc:2410] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:13:53.635394  1024 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.684664 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.686779 29393 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:53.685493 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2778) took 1244 ms. Trace:
I20260709 13:13:53.671401  1192 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.667802  1255 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:53.692682 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:53.687968 29542 rpcz_store.cc:276] 0709 13:13:52.441157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.903196 (+462039us) service_pool.cc:224] Handling call
0709 13:13:52.903671 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.904124 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.904158 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.904819 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.311339 (+406520us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:53.461646 (+150307us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.472696 (+ 11050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.472796 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.685184 (+212388us) raft_consensus.cc:1685] finished
0709 13:13:53.685215 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.685405 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10616,"prepare.queue_time_us":125320,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":5338,"raft.queue_time_us":44007,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":240,"thread_start_us":406125,"threads_started":1,"wal-append.queue_time_us":714300}
I20260709 13:13:53.697697 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.698585 29397 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:53.694357 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.699990 29537 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:53.701056 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.680511  1202 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:53.701166 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:53.692587  1033 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.691129  1253 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:53.706630  1253 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.709050  1253 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.712033 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.724023 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.725206 29393 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:53.727756  1122 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:53.700335  1255 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.803103 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:53.858395 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2774) took 1514 ms. Trace:
I20260709 13:13:53.812381 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.898586 29541 rpcz_store.cc:276] 0709 13:13:52.344382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.750207 (+405825us) service_pool.cc:224] Handling call
0709 13:13:52.861985 (+111778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.862487 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.862524 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.863125 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.454131 (+591006us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:53.454181 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.454275 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.858096 (+403821us) raft_consensus.cc:1685] finished
0709 13:13:53.858122 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.858310 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1411,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":14072,"thread_start_us":590607,"threads_started":1,"wal-append.queue_time_us":822515}
I20260709 13:13:53.904601 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:53.905449 29542 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:53.865319   887 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.669s	user 0.013s	sys 0.001s
I20260709 13:13:53.698676  1192 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:53.911842 29537 raft_consensus.cc:3060] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:53.913637  1192 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.921241 29537 raft_consensus.cc:2468] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:13:53.859360  1165 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.970570 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.911271   887 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:53.859983  1278 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.001s
I20260709 13:13:53.973410 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:53.973580 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:53.976801 29397 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:53.975870 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:53.980190 29538 raft_consensus.cc:2376] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8. Re-sending same reply.
I20260709 13:13:53.981187 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:53.984038 29545 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:53.989163 29543 raft_consensus.cc:3055] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:53.989753 29543 raft_consensus.cc:740] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:53.711166  1202 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:53.893325  1139 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:53.890887  1190 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.997725 29397 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:53.985031   887 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:53.990660 29543 consensus_queue.cc:260] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.012542 29543 raft_consensus.cc:3060] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.006058 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.052759 29545 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:54.064563  1202 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.065826  1255 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:54.138885 29396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.054s	sys 0.104s
W20260709 13:13:54.139493 29396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.054s	sys 0.104s
I20260709 13:13:54.256134  1202 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:54.269770 29512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.002s	sys 0.016s
W20260709 13:13:54.270596 29512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.004s	sys 0.016s
W20260709 13:13:54.293076 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 595996us
I20260709 13:13:54.293557 29388 raft_consensus.cc:1240] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:54.297514 29542 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:54.298990 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.299966 29394 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:54.301421 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.302438 29393 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:54.296136 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:54.303813 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.304832 29395 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:54.315538 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.317632 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.320071 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.322829 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.323465 29397 raft_consensus.cc:2393] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:54.326504 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:54.272475   968 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.009s
I20260709 13:13:54.327250 29388 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.331403 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.339352 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:54.339288 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.339975 29465 raft_consensus.cc:3055] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:54.340320 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.340490 29465 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:54.341190 30126 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.032s
W20260709 13:13:54.341645 30126 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.016s	sys 0.032s
W20260709 13:13:54.328703 29363 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.825s (SENT)
W20260709 13:13:54.341708 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.340076 29394 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:54.342322 29397 raft_consensus.cc:1275] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:54.330408 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 447174us
I20260709 13:13:54.343648 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.343851 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:54.342428 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.345686 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.345873 29394 raft_consensus.cc:1240] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:54.346736 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 538806us
I20260709 13:13:54.349897 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:54.349951 30126 leader_election.cc:336] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.123s (SENT)
I20260709 13:13:54.350576 29468 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.351162 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.346777 29465 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.352310 29465 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:54.330567   968 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.006s	sys 0.009s
I20260709 13:13:54.354666 29470 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:13:54.355118 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:54.355369 29470 pending_rounds.cc:85] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 9
I20260709 13:13:54.355721 29470 pending_rounds.cc:107] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:13:54.355981 29470 raft_consensus.cc:2889] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:54.357614 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.358553 29464 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:13:54.294602  1202 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.361373 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.370332 29471 raft_consensus.cc:2393] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:13:54.373842 29343 auto_rebalancer.cc:629] Failed to schedule move for tablet 29e2fd913c0b414a81386c129004967f: Illegal state: Replica 7c2e8d3e55c649e2b3acedef25d81e16 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:54.374899  1202 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:54.375795 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.376354 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.380944 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.381541 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 2059) took 1115 ms. Trace:
I20260709 13:13:54.381628 29542 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:54.381794 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:54.382076 29544 rpcz_store.cc:276] 0709 13:13:53.266216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.467421 (+201205us) service_pool.cc:224] Handling call
0709 13:13:54.381362 (+913941us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540037d7d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:54.381476 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391219456}
I20260709 13:13:54.384147 29388 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:54.384992 29468 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:54.388899 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:54.377455   887 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.390947  1287 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:54.393052 29465 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:54.393345 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.395088 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.386863  1283 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.395413  1139 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.397985  1139 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.398524  1139 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.387003  1280 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.401576  1042 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:54.403045 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.395078   887 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.405428 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.402012  1042 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.395370  1202 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.407676 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:54.408833  1190 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:54.409256  1190 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.409686  1190 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.412608 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:54.413491  1192 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.416040  1202 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:54.428120 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:54.408210  1280 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:54.408397  1042 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.431541 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.432602  1202 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:54.404979  1283 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.431092  1280 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.451287  1202 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:54.454768 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 83687.9us
W20260709 13:13:54.455571 29363 connection.cc:256] RPC call timeout handler was delayed by -1.4677225749999252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:13:54.456607 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1572225749998779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23660000000000003s for a response
I20260709 13:13:54.457567 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:54.452488  1228 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.822s	user 0.004s	sys 0.006s
I20260709 13:13:54.458813  1280 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:54.483852 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52443.8us
W20260709 13:13:54.479727 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 129787us
I20260709 13:13:54.458578  1202 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:54.484973 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.838s (SENT)
I20260709 13:13:54.485349 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.486023  1202 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.496397 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2275) took 2191 ms. Trace:
I20260709 13:13:54.496701 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2772) took 2153 ms. Trace:
I20260709 13:13:54.505582  1192 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:54.507690  1283 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.508440  1283 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.508852  1283 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.509243  1283 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:54.512357 29389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36874 (request call id 2548) took 1947 ms (client timeout 1973 ms). Trace:
W20260709 13:13:54.512848 29389 rpcz_store.cc:269] 0709 13:13:52.565475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.565687 (+   212us) service_pool.cc:224] Handling call
0709 13:13:54.512152 (+1946465us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b5400172ad4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:54.512284 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93465984}
W20260709 13:13:54.515451  1270 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.917s	user 0.011s	sys 0.009s
I20260709 13:13:54.518393 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2775) took 2173 ms. Trace:
I20260709 13:13:54.518818 29467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40742 (request call id 32) took 3615 ms. Trace:
I20260709 13:13:54.519253 29467 rpcz_store.cc:276] 0709 13:13:50.903367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.903548 (+   181us) service_pool.cc:224] Handling call
0709 13:13:54.518633 (+3615085us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54001e5d54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e899b853 00007f61ed96960a 00007f61e6eef7d4 00007f61e6eef762 00007f61e6eef691 00007f61e6eef60c 00007f61e6eee8c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:54.518724 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3893124480}
I20260709 13:13:54.520097   887 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.519912  1139 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.520888   887 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:54.518770 29546 rpcz_store.cc:276] 0709 13:13:52.344648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.749970 (+405322us) service_pool.cc:224] Handling call
0709 13:13:52.750466 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.750791 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.750828 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.751361 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.453736 (+702375us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:53.453790 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.453920 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.514793 (+1060873us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:54.518044 (+  3251us) raft_consensus.cc:1685] finished
0709 13:13:54.518072 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.518316 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3623808,"thread_start_us":671281,"threads_started":1,"wal-append.queue_time_us":711354}
I20260709 13:13:54.496872 29463 rpcz_store.cc:276] 0709 13:13:52.305469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.310548 (+  5079us) service_pool.cc:224] Handling call
0709 13:13:52.311029 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.311467 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.311502 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.312032 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.448583 (+136551us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:52.448649 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.448761 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.451813 (+2003052us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:13:54.493514 (+ 41701us) raft_consensus.cc:1685] finished
0709 13:13:54.493550 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.496279 (+  2729us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1280,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":10586368,"thread_start_us":136053,"threads_started":1,"wal-append.queue_time_us":266067}
I20260709 13:13:54.534725  1093 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.535491 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.537758 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.502072 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.497090 29539 rpcz_store.cc:276] 0709 13:13:52.343758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.539550 (+195792us) service_pool.cc:224] Handling call
0709 13:13:52.550925 (+ 11375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.555027 (+  4102us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:52.555291 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.233615 (+678324us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.233718 (+   103us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:53.233784 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.496452 (+1262668us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b54001b7954. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:54.496504 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.496638 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4632,"prepare.queue_time_us":466,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":7699,"raft.queue_time_us":2458,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":24416,"spinlock_wait_cycles":8802688,"thread_start_us":675267,"threads_started":1,"wal-append.queue_time_us":953001}
I20260709 13:13:54.542785 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.541229  1287 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:54.540418   979 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:54.535460  1093 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.568164  1093 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:54.569617  1202 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.550105  1042 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.571130  1190 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:54.572439  1042 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.573022  1202 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.574582 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.576263 29543 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:54.577255 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.577912 29543 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:54.578820 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.579373 29543 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:54.580036 29539 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:54.580376 29543 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:54.581640 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.581604 29543 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:54.587352 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.589329 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.591197 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:54.591607  1139 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.594244 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:54.595955 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:54.601579 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.602249 30159 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 3 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:54.602224 30156 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:54.606773 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.609017 29538 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:54.624863 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:54.626402 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:54.645565 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.651052 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.574237  1190 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.651983 30154 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:13:54.612447  1156 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:54.611357  1194 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:54.582090  1280 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:54.666239 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 123537us
I20260709 13:13:54.628194  1288 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.679131 29391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2551) took 2063 ms. Trace:
I20260709 13:13:54.684190 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:54.684907 30160 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.670076   900 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:54.687815   900 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.674906  1194 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.690421   900 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:54.691108 30158 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:54.716168 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:54.624130  1253 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:13:54.717504 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.680861 29391 rpcz_store.cc:276] 0709 13:13:52.615912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.616067 (+   155us) service_pool.cc:224] Handling call
0709 13:13:52.616477 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.616748 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:52.739356 (+122608us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.454170 (+714814us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.678415 (+1224245us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b18003969a0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61e8999060 00007f61e89ab716 00007f61e89bc287 00007f61e89bc208
0709 13:13:54.678611 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.678672 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:54.678758 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.678867 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.679039 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1288614,"prepare.queue_time_us":21226,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":3009,"raft.queue_time_us":1227998,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":7052,"spinlock_wait_cycles":14091648,"thread_start_us":815262,"threads_started":2,"wal-append.queue_time_us":908228,"wal-append.run_cpu_time_us":1883,"wal-append.run_wall_time_us":1002118}
W20260709 13:13:54.711778 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.693030 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:54.703092 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 245619us
W20260709 13:13:54.702054 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 264090us
I20260709 13:13:54.736467 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:54.693388 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.718423 30160 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:54.738128 29539 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:54.692672 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.701299 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.741902  1094 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.755028 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.673453  1286 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.679721  1151 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:54.762419  1251 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 1.311s	user 0.000s	sys 0.067s
I20260709 13:13:54.762898  1024 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:54.763001  1119 consensus_queue.cc:1059] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:54.708858  1194 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:54.703500  1195 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.704079   874 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:54.700582   776 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:54.695839  1206 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.763739  1280 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.769737 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:54.674327  1153 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:13:54.768396  1286 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.778247 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:54.678666  1156 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.796717 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:13:54.790032 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 162948us
I20260709 13:13:54.820158 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.823201 30158 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
W20260709 13:13:54.825614 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.819208 29363 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:54.828624 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:54.831009  1066 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:54.831643  1066 raft_consensus.cc:697] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:54.832235  1156 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:54.832770  1066 consensus_queue.cc:237] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.834071 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:54.834628  1137 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:54.835021  1137 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.835415  1137 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:54.835566  1286 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:54.792523  1279 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.838632 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:54.839411 30156 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.814287  1024 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:54.835587 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:54.850078 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.764793  1094 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.821164   874 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.879132 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:54.880066 29395 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
W20260709 13:13:54.881690 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 395031us
I20260709 13:13:54.883723 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:54.886610 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63135us
I20260709 13:13:54.850457  1024 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.888106  1024 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:54.888216  1167 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:54.889093  1167 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.815250   776 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:54.791559  1195 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:54.896298 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.891426 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:54.887440 29438 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:54.885787 29509 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:54.907099 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.907835 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:54.883623   874 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.909600 29438 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:54.919245 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.919200 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:54.853475  1279 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:54.924433  1193 consensus_queue.cc:1059] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:54.894387  1042 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.924456 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:54.944032 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 45483.6us
I20260709 13:13:54.940301 29360 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:54.903053  1307 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:54.923032  1139 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:54.893824   968 consensus_queue.cc:1059] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:13:54.895699  1073 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:13:54.911108  1172 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:54.950096 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:54.925865   874 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.927098  1194 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:54.957818 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:54.952816 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 2080) took 1406 ms. Trace:
I20260709 13:13:54.965721 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.958731 29396 rpcz_store.cc:276] 0709 13:13:53.543082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.554602 (+ 11520us) service_pool.cc:224] Handling call
0709 13:13:53.590066 (+ 35464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.602547 (+ 12481us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:53.602943 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.700507 (+1097564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:54.701273 (+   766us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.701451 (+   178us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:54.948562 (+247111us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.949020 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.949134 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.949190 (+    56us) raft_consensus.cc:1685] finished
0709 13:13:54.949207 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.949377 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":560174,"prepare.queue_time_us":324,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":563066,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":7406,"spinlock_wait_cycles":34688,"thread_start_us":783578,"threads_started":2,"wal-append.queue_time_us":758642}
I20260709 13:13:54.969544 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:54.930027  1042 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.901906 30156 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:54.947856  1144 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:54.992336 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:54.986701 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 146504us
I20260709 13:13:54.980392 29435 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:55.033771 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:55.041254 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:55.042878 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 62590us
I20260709 13:13:54.950549  1139 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:54.959784  1194 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.956753  1172 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:54.963191   900 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.971136  1116 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:55.092813  1281 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:13:55.039608  1181 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:55.043605  1042 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:55.038973   968 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:55.126827 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:55.130733  1181 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:55.137233 29542 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.048923 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:55.144363 30151 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:55.091665  1297 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:55.113296  1172 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:54.968081   933 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:13:55.108771  1139 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.106338  1206 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:13:55.119091  1304 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:13:55.116761   900 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:55.105093  1194 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.154343 29542 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:55.184981  1073 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.200860 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.128330  1144 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.091764  1307 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:55.042024  1294 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
W20260709 13:13:55.166929  1283 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.002s
I20260709 13:13:55.129335  1165 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:55.202837 29545 raft_consensus.cc:2393] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:55.156136   968 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:55.163522  1167 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:55.198930   900 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:55.206485  1307 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:55.216555   968 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:55.200539  1206 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.254065 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:55.254614 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.309171 29543 raft_consensus.cc:2368] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:13:55.220978  1195 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.207108  1144 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.216207  1283 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:55.268507 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2771) took 2925 ms. Trace:
W20260709 13:13:55.275240  1311 log.cc:927] Time spent T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:55.239322  1073 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:55.279597  1303 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:55.170740  1297 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.220646  1165 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:55.288568  1306 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:55.290153  1137 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:55.335659 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 77014us
I20260709 13:13:55.336530 29537 raft_consensus.cc:2368] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10.
I20260709 13:13:55.295848  1279 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:55.297773 29539 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
W20260709 13:13:55.306737 30126 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 2.097s (SENT) [suppressed 40 similar messages]
W20260709 13:13:55.352224 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 45536.9us
I20260709 13:13:55.310770 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:55.318421 29540 rpcz_store.cc:276] 0709 13:13:52.343438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.514905 (+171467us) service_pool.cc:224] Handling call
0709 13:13:52.550268 (+ 35363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.556645 (+  6377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.556693 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.569332 (+ 12639us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.615640 (+2046308us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18004afce0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e85410d1 00007f61e895ca0f
0709 13:13:54.958080 (+342440us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:54.958131 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.958220 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:55.268055 (+309835us) raft_consensus.cc:1685] finished
0709 13:13:55.268081 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:55.268410 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6354,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7720,"spinlock_wait_cycles":27437440,"thread_start_us":342200,"threads_started":1,"wal-append.queue_time_us":2630434}
I20260709 13:13:55.236812   776 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:55.343904 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:55.343987 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.243526  1307 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:55.376992  1312 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:13:55.342399  1144 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:55.400489 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 353348us
I20260709 13:13:55.402098 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:55.330080  1073 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:55.407665 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.421314 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:55.424907 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 383759us
I20260709 13:13:55.425805 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.403306  1206 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:55.426194 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 498262us
I20260709 13:13:55.436201 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:55.419201  1193 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:55.443363 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:55.453482 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.455106 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.456239 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:55.459723 29363 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.465687 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.470420 29472 raft_consensus.cc:2410] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:13:55.470484 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:55.457831  1144 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:55.472566  1324 log.cc:927] Time spent T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:13:55.457357  1193 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:55.460973  1066 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.460598   776 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:55.439566  1327 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:55.480448  1316 log.cc:927] Time spent T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:13:55.501099  1283 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:55.502334  1137 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:55.522981  1137 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:55.523438  1329 log.cc:927] Time spent T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:13:55.523840  1340 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.502969  1331 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:13:55.524434  1340 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:55.503106  1165 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.503548  1249 raft_consensus.cc:3055] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:55.505131  1337 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:55.466837  1334 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:55.475741  1195 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:55.506917  1323 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:13:55.535002 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:55.513705  1330 log.cc:927] Time spent T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:13:55.507352  1193 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:55.540199 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 103298us
I20260709 13:13:55.499212  1341 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.511533   776 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:55.503566  1335 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:55.520651  1327 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:55.530154  1249 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:55.530496  1334 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:55.545147  1341 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:55.518925  1167 consensus_queue.cc:1048] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:13:55.563491  1341 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.567322  1181 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:55.568825  1181 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:55.565623  1338 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:13:55.564010  1249 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.686268  1249 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.577687  1341 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.552851   776 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:55.691074  1341 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:55.693239 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.557931  1327 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.696228 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:55.582964 32204 raft_consensus.cc:3055] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:55.558272  1342 consensus_queue.cc:1059] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:13:55.591718  1042 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:55.561704   900 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.599699  1156 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:55.561960  1334 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.609593  1144 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:55.508462  1336 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:13:55.611384  1073 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.562312  1335 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:55.613118  1094 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.615479  1340 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.617863  1193 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.631699  1297 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:55.633445 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:55.719854 30158 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.642510 29290 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 4 to 6, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:13:55.722152 29290 catalog_manager.cc:5697] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:55.667644  1333 raft_consensus.cc:476] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Not starting pre-election -- already a leader
W20260709 13:13:55.680405 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 109468us
I20260709 13:13:55.698939 32204 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:55.730111 32204 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:55.730863  1042 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:55.731166 32204 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.731711  1042 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:55.730921 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.733994  1042 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:55.705585  1156 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:55.735759 29290 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:55.723145  1193 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:55.724140 29466 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:55.724438   900 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.647511 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 979) took 1042 ms. Trace:
I20260709 13:13:55.747030 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:55.747300 30152 rpcz_store.cc:276] 0709 13:13:54.605348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.607507 (+  2159us) service_pool.cc:224] Handling call
0709 13:13:54.607807 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.608047 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:54.914687 (+306640us) log.cc:844] Serialized 14 byte log entry
0709 13:13:55.646589 (+731902us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18003f66a0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e854123a
0709 13:13:55.646916 (+   327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:55.646995 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:55.647076 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.647184 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:55.647406 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":510799,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":1312,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":4664576,"thread_start_us":515417,"threads_started":2,"wal-append.queue_time_us":463831}
W20260709 13:13:55.750129 29295 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 178) took 14526 ms (client timeout 15000 ms). Trace:
I20260709 13:13:55.728754   776 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.732915  1202 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:55.736441  1156 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.707155  1301 raft_consensus.cc:3055] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:55.740394 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:55.756629 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.707131 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 269419us
W20260709 13:13:55.708719 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 238418us
I20260709 13:13:55.744700 30158 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:13:55.753288  1202 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:55.758167 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.758889 29360 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:55.760249 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:55.758428 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:55.762063 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.762017 29509 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.762300 29290 catalog_manager.cc:5697] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 2 to 6, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
W20260709 13:13:55.762954 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 208785us
I20260709 13:13:55.768989 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:55.769598 29544 raft_consensus.cc:2376] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10. Re-sending same reply.
I20260709 13:13:55.769733 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:55.770989 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:55.756407  1301 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:55.772094 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:55.772579 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.775120 29543 pending_rounds.cc:85] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 10
I20260709 13:13:55.777774 29537 raft_consensus.cc:2376] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10. Re-sending same reply.
I20260709 13:13:55.778019 29543 pending_rounds.cc:107] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:13:55.775907 29539 pending_rounds.cc:85] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 7
I20260709 13:13:55.776437 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.778800 29539 pending_rounds.cc:107] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:13:55.778992 29537 raft_consensus.cc:1240] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:55.771621 29544 raft_consensus.cc:2376] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14. Re-sending same reply.
I20260709 13:13:55.779124 29539 raft_consensus.cc:2889] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:55.778362 29543 raft_consensus.cc:2889] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:55.781791 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.762679  1195 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:55.785153 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.786085 29540 raft_consensus.cc:2410] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:13:55.762954   887 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:55.762826  1156 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.762931  1193 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:55.790187   968 consensus_meta.cc:287] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.514s	user 0.014s	sys 0.000s
I20260709 13:13:55.757236  1192 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:13:55.764353  1167 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:55.808365 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:55.783154  1194 consensus_meta.cc:287] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.002s
I20260709 13:13:55.810719 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.798827 29290 catalog_manager.cc:5697] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:55.801471 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:55.770723  1279 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.781431  1335 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.767109  1206 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:55.777395  1333 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.779299  1346 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:55.826213 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.826900 29469 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:55.827126 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.798774 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:55.809791   874 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.827s	user 0.015s	sys 0.000s
W20260709 13:13:55.810848 29343 auto_rebalancer.cc:629] Failed to schedule move for tablet 6aa3c8fa6cf741bdafed124439764c9c: Illegal state: Replica 7c2e8d3e55c649e2b3acedef25d81e16 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:55.807216 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:55.803624 30126 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:55.811753 30152 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:55.833520 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.816829 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.790766  1195 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:55.821779 29290 catalog_manager.cc:5697] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:55.819272 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:55.810822   887 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:55.835603 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.841562 29546 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:55.809342  1144 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:55.846026 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:55.816565  1139 consensus_meta.cc:287] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.001s
I20260709 13:13:55.809581   776 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:55.856254 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:55.831516  1024 consensus_meta.cc:287] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.943s	user 0.013s	sys 0.004s
I20260709 13:13:55.808207   968 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.865451 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.788594  1342 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:13:55.854177 29464 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:55.869155 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:55.854650 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.871059 29470 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
W20260709 13:13:55.750902 29295 rpcz_store.cc:269] 0709 13:13:41.224180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.224434 (+   254us) service_pool.cc:224] Handling call
0709 13:13:55.750023 (+14525589us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:49.275983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:49.286585 (+ 10602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:49.286656 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:13:49.286693 (+    37us) tablet.cc:662] Decoding operations
0709 13:13:49.290714 (+  4021us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:49.290854 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:49.290883 (+    29us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:13:49.292524 (+  1641us) tablet.cc:701] Row locks acquired
0709 13:13:49.292569 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:13:49.292794 (+   225us) write_op.cc:270] Start()
0709 13:13:49.292972 (+   178us) write_op.cc:276] Timestamp: P: 1783602829292714 usec, L: 0
0709 13:13:49.293004 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:13:49.298147 (+  5143us) log.cc:844] Serialized 8257 byte log entry
0709 13:13:49.641295 (+343148us) op_driver.cc:464] REPLICATION: finished
0709 13:13:49.688271 (+ 46976us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e58970ac 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61ec3d7ef0
0709 13:13:49.733313 (+ 45042us) write_op.cc:301] APPLY: starting
0709 13:13:49.733479 (+   166us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:50.541966 (+808487us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:50.542018 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:51.954387 (+1412369us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:51.995198 (+ 40811us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 13:13:51.995265 (+    67us) write_op.cc:312] APPLY: finished
0709 13:13:51.995834 (+   569us) log.cc:844] Serialized 180 byte log entry
0709 13:13:52.232738 (+236904us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:52.255384 (+ 22646us) write_op.cc:454] Released schema lock
0709 13:13:52.318487 (+ 63103us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:52.378359 (+ 59872us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:52.378399 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":735412,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":79513,"apply.run_cpu_time_us":59163,"apply.run_wall_time_us":2618574,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87527,"num_ops":20,"prepare.queue_time_us":139407,"prepare.run_cpu_time_us":48016,"prepare.run_wall_time_us":99790,"raft.queue_time_us":111206,"raft.run_cpu_time_us":7458,"raft.run_wall_time_us":89888,"replication_time_us":348045,"spinlock_wait_cycles":9543936,"thread_start_us":515468,"threads_started":5,"wal-append.queue_time_us":436842,"wal-append.run_cpu_time_us":39742,"wal-append.run_wall_time_us":2682296}]]}
I20260709 13:13:55.814244  1280 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:55.862727 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.850728 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:55.814272  1094 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:13:55.875072 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:55.844594  1193 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.877554 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.866146 29540 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:55.890632 29546 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:13:55.876623 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:55.869899   776 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.851236  1206 raft_consensus.cc:697] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:55.834617  1337 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:13:55.880002 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:55.866044  1172 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.690s	user 0.014s	sys 0.001s
W20260709 13:13:55.882091 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.882867 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.952636 29396 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:13:55.953727 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.883461 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.956113 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.957228 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:55.957762 29392 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.884480 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.961757 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:55.962972 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:55.963217 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.878214 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.965430 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:55.966769 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.968073 29467 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:55.913383 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93343.7us
I20260709 13:13:55.916491 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.917141 29391 raft_consensus.cc:1275] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:55.971282 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:55.972401 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:55.972929 29391 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.917025 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:55.976537 29390 raft_consensus.cc:2376] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10. Re-sending same reply.
I20260709 13:13:55.977422 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.978153 29390 raft_consensus.cc:2410] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:55.859184  1279 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.978319 29397 raft_consensus.cc:2393] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:55.818848  1194 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:55.979523 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.981034  1194 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:55.918913 29463 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:55.919787 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 116237us
I20260709 13:13:55.981766 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:55.923141 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 89700.4us
I20260709 13:13:55.983217 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.940006 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.984759 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:55.946787 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.868031  1349 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:55.938869 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:55.986982 29390 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.984902 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.989178 29546 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 4.
I20260709 13:13:55.940838 29395 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:55.992094 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.993045 29395 raft_consensus.cc:2393] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 5: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:55.993950 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.990573 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:55.996896 29546 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:56.000218 29395 raft_consensus.cc:2410] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:56.001425 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.009953 29438 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:55.999511 29546 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:56.017132  1333 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:56.028925 29391 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:56.030030 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.031203 29390 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:55.842100   874 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:55.876477  1280 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:55.939321   900 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:55.877579  1335 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:55.917656  1319 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:56.034986 29290 catalog_manager.cc:5697] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 6 to 8, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:56.035622 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:56.036294 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.039728 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:55.859987  1139 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:56.040267 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:55.948417  1287 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:55.839444  1301 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:56.057040 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 74001us
I20260709 13:13:55.917042  1116 consensus_queue.cc:1048] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:13:56.035431 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.050336 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:56.043371 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 59759.3us
I20260709 13:13:56.043098 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:56.056532 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 86305.6us
I20260709 13:13:56.056720 29388 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:55.877040  1024 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:56.033109 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:56.100129 29546 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:56.041193  1348 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.039256 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 133108182cae493ab908290bfa9179d1 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:13:55.944921   776 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:56.101516 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:56.100284 29390 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:56.114485 29290 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
W20260709 13:13:56.103853 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53643.1us
I20260709 13:13:56.116595 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:56.034271  1195 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.123664 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:56.109378 29538 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.125501 29363 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:56.056182  1349 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:56.034934  1172 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:56.117002 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:56.136698 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:56.137390 29388 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:56.131310 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.115443 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:56.059657  1287 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:56.139153 29390 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.146411  1346 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:56.020539 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.079713   900 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:56.144872 29395 raft_consensus.cc:2468] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:13:56.150842  1094 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:56.150743  1349 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.151582  1094 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.111415  1334 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.156002 29389 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:56.157333  1334 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:56.135601 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 133108182cae493ab908290bfa9179d1 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-133108182cae493ab908290bfa9179d1
I20260709 13:13:56.142968  1280 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.159078  1280 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:56.059999  1335 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:56.052486   887 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.061596  1319 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.042878  1333 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.165323   900 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.102465  1358 consensus_queue.cc:1059] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:13:56.166806 29393 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:56.113812  1348 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.167498  1358 raft_consensus.cc:3055] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:56.167791  1202 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.168094 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.169986 29393 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:13:56.170820 29537 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:56.171206 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.172676 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.162298 29391 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:56.173450 29393 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:13:56.175158 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.182607 29537 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:56.050580 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 174091us
I20260709 13:13:56.175927 29393 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:56.106350  1073 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:56.136936  1194 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:56.189322 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63678.3us
I20260709 13:13:56.191521  1348 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:56.191744 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:56.264222 29389 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.265810 29396 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:56.268814 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.208986 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.211792 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.197834 29537 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:56.167945  1358 raft_consensus.cc:740] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:56.129454  1151 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:56.318902 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:56.320004 29391 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:56.228538 29465 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:56.224601 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93948.5us
W20260709 13:13:56.148057 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 193561us
I20260709 13:13:56.186889 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.136528  1341 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:56.240399 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:56.241631 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:56.251909 29390 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:56.255296 29392 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
W20260709 13:13:56.211081  1351 log.cc:927] Time spent T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:13:56.271565 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.196310  1319 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:56.283120  1024 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:56.169065   968 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:56.275234 29290 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:56.214335   874 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:56.273401 29389 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
W20260709 13:13:56.284430 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 274588us
I20260709 13:13:56.212365  1139 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:56.289556 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 225631us
I20260709 13:13:56.296614 29396 raft_consensus.cc:2393] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 14: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:56.273483 29388 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:56.343699 29395 raft_consensus.cc:2410] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:13:56.309175 29546 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:13:56.315371 29537 raft_consensus.cc:1240] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.260828  1334 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:56.345549 29290 catalog_manager.cc:5697] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:56.327344 29397 raft_consensus.cc:2393] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:56.330178 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 89930.5us
I20260709 13:13:56.331056 29393 raft_consensus.cc:2368] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:56.286365  1194 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:56.331349 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:56.333992 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:56.288965  1283 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:56.348982 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 243666us
I20260709 13:13:56.322962  1346 raft_consensus.cc:697] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:56.333298  1342 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:56.368953 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:56.352666 29363 leader_election.cc:400] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:13:56.353410 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:56.359017 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:56.372483 30158 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:56.363011  1167 consensus_queue.cc:1059] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:56.335455  1348 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:56.351747  1156 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.546s	user 0.014s	sys 0.000s
I20260709 13:13:56.212493  1206 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.197373  1287 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:56.382565 29542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.012s
W20260709 13:13:56.416864 29542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.012s
I20260709 13:13:56.337029  1297 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:56.414588 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 66716.6us
I20260709 13:13:56.343050  1353 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:13:56.418220 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.420698 29290 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:56.468284 29466 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:13:56.471911 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 51963.1us
W20260709 13:13:56.472308 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 220036us
I20260709 13:13:56.356019  1335 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:56.472572 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 131389us
I20260709 13:13:56.519649 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:56.369629  1342 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.524139 29290 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:13:56.526320 29290 catalog_manager.cc:5697] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.349094  1337 consensus_queue.cc:1059] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:13:56.387905  1333 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:56.415916  1279 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:56.351346  1334 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:56.348827  1253 consensus_queue.cc:1059] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 13:13:56.354983  1357 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:13:56.523505  1353 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.358894  1336 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.159s
W20260709 13:13:56.539573 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 68536.5us
I20260709 13:13:56.542910 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:56.549878 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.528887  1342 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:56.523519  1073 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:56.531872  1335 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:56.473459  1297 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:56.420110  1358 consensus_queue.cc:260] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.550827   968 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:57.128755 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.836876 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 2004) took 1011 ms. Trace:
I20260709 13:13:57.189563 29465 rpcz_store.cc:276] 0709 13:13:55.825858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.829008 (+  3150us) service_pool.cc:224] Handling call
0709 13:13:55.829299 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:56.321400 (+492101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.836547 (+515147us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540019c3d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:56.836788 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917635968}
W20260709 13:13:56.885358 29538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.101s	sys 0.117s
I20260709 13:13:57.176780 29363 leader_election.cc:400] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10.
W20260709 13:13:57.190991 29538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.103s	sys 0.130s
I20260709 13:13:57.191107 29363 leader_election.cc:403] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:13:57.175020 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.023s
W20260709 13:13:57.191890 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.010s	sys 0.023s
I20260709 13:13:57.191927 29538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2803) took 1263 ms. Trace:
I20260709 13:13:56.849998 32204 raft_consensus.cc:3055] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:56.735114 29509 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.580s (SENT)
I20260709 13:13:57.193231 32204 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:56.921627 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 386579us
W20260709 13:13:57.182734 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.195621 29390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.006s	sys 0.018s
W20260709 13:13:57.096614 29541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 649) took 1320 ms (client timeout 1647 ms). Trace:
W20260709 13:13:57.196856 29390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.018s
W20260709 13:13:57.018778 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.197043 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 461950us
I20260709 13:13:56.863845 29438 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:56.647140 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 288819us
I20260709 13:13:57.194039 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:13:57.196997 29541 rpcz_store.cc:269] 0709 13:13:55.776269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.778369 (+  2100us) service_pool.cc:224] Handling call
0709 13:13:57.096251 (+1317882us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002bc354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:57.096513 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649078016}
I20260709 13:13:57.098073 29539 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:57.194168 32204 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.202342 30151 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:57.202764 32204 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.196105 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:57.204885 29466 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:56.804174  1356 log.cc:927] Time spent T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.482s	user 0.001s	sys 0.000s
W20260709 13:13:56.737622  1365 log.cc:927] Time spent T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 13:13:56.801862  1375 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:13:57.160645  1376 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:13:56.568609  1094 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:56.806567  1359 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.518s	user 0.001s	sys 0.001s
I20260709 13:13:57.208729  1333 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.248441  1333 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:56.982954  1249 consensus_meta.cc:287] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 1.296s	user 0.016s	sys 0.000s
W20260709 13:13:57.015316  1280 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.856s	user 0.015s	sys 0.000s
W20260709 13:13:56.826046  1181 consensus_meta.cc:287] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.122s	user 0.012s	sys 0.003s
W20260709 13:13:56.582752  1307 consensus_meta.cc:287] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.206s	user 0.016s	sys 0.001s
W20260709 13:13:57.213456 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 356306us
W20260709 13:13:56.843284  1327 consensus_meta.cc:287] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.148s	user 0.015s	sys 0.000s
I20260709 13:13:57.257382 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2816) took 1320 ms. Trace:
W20260709 13:13:57.218169 29509 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.592s (SENT)
I20260709 13:13:56.848246  1287 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:57.043795  1202 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:57.044066  1363 raft_consensus.cc:3055] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:57.221661 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:56.850522  1334 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.183602  1301 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.094247  1116 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:56.648671   874 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:56.769497  1362 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:13:57.228034  1357 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:13:57.267323  1195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.010s	sys 0.034s
I20260709 13:13:57.229977  1297 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:57.225605  1336 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.239310  1380 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:56.952732  1172 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:57.246626 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.250259 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 642) took 1475 ms. Trace:
I20260709 13:13:57.185401   776 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.186898   968 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:57.258039 29539 rpcz_store.cc:276] 0709 13:13:55.937217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.413348 (+476131us) service_pool.cc:224] Handling call
0709 13:13:57.097742 (+684394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.201586 (+103844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.257066 (+ 55480us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54002bc350. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:57.257287 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572894592}
I20260709 13:13:57.272274  1341 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:57.264492 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:57.211758  1370 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:57.271183 29290 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.011s
I20260709 13:13:57.206619  1335 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.222729   933 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:57.206203  1073 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:56.631197  1194 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:57.269258  1371 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.476s	user 0.001s	sys 0.001s
I20260709 13:13:57.295650 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 659) took 1492 ms. Trace:
I20260709 13:13:57.331045 30159 rpcz_store.cc:276] 0709 13:13:55.802896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.803056 (+   160us) service_pool.cc:224] Handling call
0709 13:13:55.805871 (+  2815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.806118 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.806147 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:55.824622 (+ 18475us) log.cc:844] Serialized 26 byte log entry
0709 13:13:56.046837 (+222215us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:56.281055 (+234218us) log.cc:844] Serialized 14 byte log entry
0709 13:13:56.281296 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.281382 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.295337 (+1013955us) raft_consensus.cc:1685] finished
0709 13:13:57.295404 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.295576 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524816,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":36848,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9607,"thread_start_us":436718,"threads_started":2,"wal-append.queue_time_us":396326}
I20260709 13:13:57.295689 29543 rpcz_store.cc:276] 0709 13:13:55.774369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.774551 (+   182us) service_pool.cc:224] Handling call
0709 13:13:55.774902 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.793066 (+ 18164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.793091 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:55.793419 (+   328us) log.cc:844] Serialized 26 byte log entry
0709 13:13:56.046829 (+253410us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:56.413370 (+366541us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18003f75a0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61ec3993c7 00007f61e89ab9a7 00007f61e89bb0bf
0709 13:13:56.413587 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 13:13:56.413924 (+   337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.414024 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.249891 (+835867us) raft_consensus.cc:1685] finished
0709 13:13:57.250008 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.250174 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215883,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3640,"raft.queue_time_us":1962,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":94959,"spinlock_wait_cycles":26604928,"thread_start_us":401101,"threads_started":2,"wal-append.queue_time_us":324132}
I20260709 13:13:57.261389 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:57.333914 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 115793us
W20260709 13:13:57.334831 29509 leader_election.cc:336] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.657s (SENT)
I20260709 13:13:57.334991 29543 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:57.266595  1363 raft_consensus.cc:740] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:13:57.289777  1195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.010s	sys 0.035s
I20260709 13:13:56.714653  1346 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.283255   874 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:57.308645 29290 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.006s	sys 0.011s
W20260709 13:13:57.314738 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93297.4us
W20260709 13:13:57.314997 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.278468  1116 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.300140  1336 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.315667  1391 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.316201  1345 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:57.316473 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.268594  1307 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.268167  1327 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.290606  1280 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:57.310254 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 2078) took 1489 ms. Trace:
I20260709 13:13:57.302110   968 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:57.337181 29509 leader_election.cc:336] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.684s (SENT)
W20260709 13:13:57.383715 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 46566.7us
W20260709 13:13:57.384661 29509 leader_election.cc:336] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.718s (SENT)
I20260709 13:13:57.385186 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:57.333930 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 133349us
I20260709 13:13:57.386901 32204 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.387462 32204 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.379983 29544 rpcz_store.cc:276] 0709 13:13:55.821101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.821242 (+   141us) service_pool.cc:224] Handling call
0709 13:13:55.821588 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.852405 (+ 30817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.852439 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:55.858143 (+  5704us) log.cc:844] Serialized 26 byte log entry
0709 13:13:56.229825 (+371682us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:56.284844 (+ 55019us) log.cc:844] Serialized 14 byte log entry
0709 13:13:56.285160 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.285284 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.310014 (+1024730us) raft_consensus.cc:1685] finished
0709 13:13:57.310040 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.310180 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182815,"prepare.queue_time_us":193952,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":22574,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":16339,"thread_start_us":291273,"threads_started":1,"wal-append.queue_time_us":454953}
I20260709 13:13:57.343343 29543 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.417079 29388 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:13:57.295317  1380 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:57.350720 29469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 2008) took 1517 ms (client timeout 1927 ms). Trace:
I20260709 13:13:57.354964 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51828 (request call id 647) took 1579 ms. Trace:
W20260709 13:13:57.423604 29469 rpcz_store.cc:269] 0709 13:13:55.832893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.868895 (+ 36002us) service_pool.cc:224] Handling call
0709 13:13:57.331715 (+1462820us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540032c3d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:13:57.350629 (+ 18914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110252800}
I20260709 13:13:57.315254  1357 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:57.425284 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:57.358383 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 161964us
W20260709 13:13:57.357903 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 160792us
W20260709 13:13:57.426687 30123 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.699s (SENT)
W20260709 13:13:57.427999 29509 leader_election.cc:336] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.804s (SENT)
W20260709 13:13:57.428264 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.774s (SENT)
I20260709 13:13:57.428706 30123 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:57.328153   776 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10.
W20260709 13:13:57.374035 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 197465us
I20260709 13:13:57.351763  1283 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.390139 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:57.390139 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:57.409677 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:57.469885 29395 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:57.411705 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:57.420307 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:57.471216 29389 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:57.421222 29394 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:57.472461 29388 raft_consensus.cc:1240] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.367098  1195 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.428608 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:57.475890 29397 raft_consensus.cc:2393] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:57.365494  1172 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:13:57.312008  1341 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.432833 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
W20260709 13:13:57.479705 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 51759.9us
I20260709 13:13:57.480036 29469 raft_consensus.cc:606] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:57.423696 29542 rpcz_store.cc:276] 0709 13:13:55.775757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.779379 (+  3622us) service_pool.cc:224] Handling call
0709 13:13:55.795906 (+ 16527us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:55.796331 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.796363 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:55.796959 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:13:56.417471 (+620512us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:56.612249 (+194778us) log.cc:844] Serialized 14 byte log entry
0709 13:13:56.762125 (+149876us) log.cc:844] Serialized 14 byte log entry
0709 13:13:56.770396 (+  8271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.770527 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.100484 (+329957us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b180029a520. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:13:57.354704 (+254220us) raft_consensus.cc:1685] finished
0709 13:13:57.354737 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.354897 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204435,"prepare.queue_time_us":571391,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":101,"raft.queue_time_us":177158,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":17844,"spinlock_wait_cycles":32468736,"thread_start_us":565292,"threads_started":1,"wal-append.queue_time_us":701920}
I20260709 13:13:57.462945 30159 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:57.463022 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:57.464409 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.097s (SENT)
I20260709 13:13:57.482059 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:57.464987 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:57.462090 32204 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.480620 29469 raft_consensus.cc:614] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:57.466639 29392 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:57.467612 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:57.480778 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 115729us
I20260709 13:13:57.425926 30126 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:57.311648  1370 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.307121  1342 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.346560  1333 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.470238 29396 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:57.474951 29471 raft_consensus.cc:1240] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.475296 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:57.374897 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 2136) took 1325 ms. Trace:
W20260709 13:13:57.480682 29509 leader_election.cc:336] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.821s (SENT)
I20260709 13:13:57.414599   887 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.420169  1345 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:57.493224 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:57.366807  1391 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.470217   900 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:57.494199 32204 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:57.475790  1375 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:13:57.496362 29390 rpcz_store.cc:276] 0709 13:13:56.049605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.324649 (+275044us) service_pool.cc:224] Handling call
0709 13:13:56.325108 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.325610 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.325653 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:56.326229 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:13:56.537205 (+210976us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:57.197303 (+660098us) log.cc:844] Serialized 14 byte log entry
0709 13:13:57.374417 (+177114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.374547 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.374598 (+    51us) raft_consensus.cc:1685] finished
0709 13:13:57.374610 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.374798 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14614,"prepare.queue_time_us":732468,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":6814,"raft.queue_time_us":106683,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":15332,"thread_start_us":933253,"threads_started":3,"wal-append.queue_time_us":310875}
I20260709 13:13:57.507956 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:57.508072 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:57.508852 29390 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:57.390682  1280 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.512193 30157 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.497033 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:57.496150 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 70365.3us
I20260709 13:13:57.515692 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:57.515985 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:57.517843 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:57.518724 29542 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:57.485354  1192 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:57.529585 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 64706.5us
I20260709 13:13:57.544538  1307 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.549816 29363 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:57.503463 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:13:57.528317 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 47669us
W20260709 13:13:57.552117 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.192492 29538 rpcz_store.cc:276] 0709 13:13:55.928368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.130947 (+202579us) service_pool.cc:224] Handling call
0709 13:13:56.131362 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:56.131620 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:56.352709 (+221089us) log.cc:844] Serialized 14 byte log entry
0709 13:13:57.191542 (+838833us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:57.191605 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:57.191652 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.191731 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.191854 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105992,"prepare.queue_time_us":236409,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":6172,"raft.queue_time_us":128,"thread_start_us":961851,"threads_started":2}
I20260709 13:13:57.478003  1195 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.497615 30156 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:57.522089 29389 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
W20260709 13:13:57.499749  1395 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:13:57.500422  1398 log.cc:927] Time spent T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:13:57.562311  1333 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:57.561409 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46943.4us
I20260709 13:13:57.536137   900 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.571348 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:57.514215  1283 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.511924  1353 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.500622  1249 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.566490 29389 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:57.498646  1335 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:57.582546 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.568563   776 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.536090  1297 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.502112  1389 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.502089  1392 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:57.589713 29469 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:57.437646  1363 consensus_queue.cc:260] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.511062  1390 consensus_queue.cc:1059] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:13:57.602205 29470 raft_consensus.cc:1240] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:57.559648 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:57.612565 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:57.600976  1348 consensus_meta.cc:287] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.128s	user 0.010s	sys 0.006s
I20260709 13:13:57.626941 30159 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:13:57.627720 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.631433 30156 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:13:57.631749 29438 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:57.512751  1345 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:57.639348 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 136026us
W20260709 13:13:57.639604 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 80062us
I20260709 13:13:57.633177 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:57.640316 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:57.597678  1283 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.663844 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:57.666290 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:57.639262  1348 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.646680  1181 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:57.646242  1363 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:57.639046  1307 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:57.689754 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:57.690372 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a320582e5c548dd888eb981df817079"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:57.691108 29470 raft_consensus.cc:606] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:57.691488 29470 raft_consensus.cc:614] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:57.647235  1397 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:57.647524  1024 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.692391 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:57.687776  1390 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.694288  1360 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.550513  1380 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.663486  1336 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.659634  1116 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.656895   874 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.688092  1181 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.712023 29542 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:57.597165  1357 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.718281  1370 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.702910 29435 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:57.707841  1397 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:57.657423  1404 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:13:57.728626 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:57.643275  1392 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.707657  1024 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:57.729929 29435 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:13:57.732259 29540 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:57.710933  1327 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.692895  1194 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:13:57.723963  1181 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.742223 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:57.742609 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:57.708956  1307 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.744355 29540 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.728634  1390 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:57.731616  1380 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.731851  1397 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.769675 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47726 (request call id 671) took 1886 ms. Trace:
I20260709 13:13:57.770313 29394 rpcz_store.cc:276] 0709 13:13:55.883360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.883536 (+   176us) service_pool.cc:224] Handling call
0709 13:13:55.883917 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.472785 (+1588868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.769323 (+296538us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000e5bd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:57.769585 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3534997248}
W20260709 13:13:57.772245 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.779196 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2310) took 2582 ms. Trace:
I20260709 13:13:57.779699 29471 rpcz_store.cc:276] 0709 13:13:55.197315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.197595 (+   280us) service_pool.cc:224] Handling call
0709 13:13:55.210266 (+ 12671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.501746 (+2291480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.778863 (+277117us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54002a44d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:57.779117 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5207753088}
I20260709 13:13:57.739053  1024 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:57.749497 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.740108 29481 tablet_copy_source_session.cc:215] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:57.729769  1391 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:57.757104  1407 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:13:57.741638  1418 log.cc:927] Time spent T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:13:57.812496 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 70388.2us
I20260709 13:13:57.736901  1167 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:13:57.743377  1342 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:57.746963  1386 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.817137 29438 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:57.799715  1379 raft_consensus.cc:3055] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:57.798858  1172 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:57.799500  1297 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:13:57.851895 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.856114 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:57.844415  1280 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.842200  1195 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.845526  1139 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.863524  1139 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.866080  1139 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.842809  1386 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.868708  1386 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:13:57.869285 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.868826   968 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.870707 29466 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:57.872267 29481 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:39036 (request call id 591) took 2077 ms. Trace:
I20260709 13:13:57.875286 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:57.877017 30158 raft_consensus.cc:1240] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:57.883059 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45048.8us
W20260709 13:13:57.873234  1301 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.002s
I20260709 13:13:57.886945 29543 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.827862  1424 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:57.811044  1192 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:13:57.817066   887 consensus_queue.cc:1059] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:13:57.838603  1379 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:13:57.890574 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.892505 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:57.880137  1341 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.872740 29481 rpcz_store.cc:276] 0709 13:13:55.805477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.879268 (+ 73791us) service_pool.cc:224] Handling call
0709 13:13:57.728372 (+1849104us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400087da0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8918dc0 00007f61e89ab4a5 00007f61e89ab3ee 00007f61ed941036 00007f61ed94aa3e 00007f61e520e27b 00007f61ed94a9ba 00007f61ed945acc 00007f61ed940c7b 00007f61ed9358d1
0709 13:13:57.872127 (+143755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843283328}
I20260709 13:13:57.881177  1409 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.851356  1297 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:57.948055  1353 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.948868  1353 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:57.950829  1283 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:57.951376  1353 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:57.952793  1420 log.cc:927] Time spent T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:13:57.905293 29392 raft_consensus.cc:2955] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:13:57.956310  1202 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.007s
I20260709 13:13:57.963302 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:57.963696  1411 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:57.964157 29470 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:57.902223  1424 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:57.970012 29538 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:13:57.979420 29512 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:57.907609  1345 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:57.991546  1192 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.992216  1192 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.992695  1192 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.000067  1172 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:58.003309  1172 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:58.004711 30123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.017495 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.021026 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.021698  1379 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.022841 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.023296  1379 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.027210  1073 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:58.029070 29509 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.996s (SENT)
I20260709 13:13:58.029659 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.032696  1202 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:58.034323 29509 leader_election.cc:336] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.014s (SENT)
I20260709 13:13:58.034857 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:58.037569 29509 leader_election.cc:336] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.044s (SENT)
I20260709 13:13:58.038663  1202 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:58.052274  1181 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.056473 29435 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.038173 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:58.058400 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.059537 30158 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 12: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:58.061276 29509 leader_election.cc:336] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.081s (SENT)
I20260709 13:13:58.061923  1172 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.061911 29509 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:58.063793  1202 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:58.064672  1202 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.064761  1358 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.068806  1380 consensus_queue.cc:1059] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:58.070015 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 429746us
I20260709 13:13:58.070691   776 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:58.070891 29363 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.071229   776 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:58.071791   776 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.071934  1335 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:58.072842  1348 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:13:58.070149 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 417418us
I20260709 13:13:58.076378  1405 raft_consensus.cc:476] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:13:58.079420 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.080899 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.082880 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.083055  1341 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:58.083688  1341 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.084348 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:58.085196 29390 raft_consensus.cc:2393] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 6: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:58.086829 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.087560 29394 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:13:58.079653  1223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133108182cae493ab908290bfa9179d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:58.092212  1116 consensus_queue.cc:1048] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:58.093097 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.095121 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:58.098610 29391 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:58.100099 29388 raft_consensus.cc:1240] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:13:58.106494 32204 raft_consensus.cc:3055] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:58.106979 32204 raft_consensus.cc:740] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:58.107883 32204 consensus_queue.cc:260] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.108969 32204 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:58.111819  1340 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:58.112279  1340 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:58.112932 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.113497  1340 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:58.112046 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:58.117723  1392 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.121968  1396 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:58.122481  1396 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:58.122978  1396 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:58.086184  1341 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.128489 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.129609 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:58.130625 29466 raft_consensus.cc:2393] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 6: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:58.135165  1181 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:58.135686 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 67088.9us
I20260709 13:13:58.137282  1387 consensus_queue.cc:1059] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:13:58.142956 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 81718.7us
I20260709 13:13:58.138991  1401 consensus_queue.cc:1059] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:58.145675 29509 leader_election.cc:336] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.123s (SENT)
I20260709 13:13:58.146718 29509 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:58.150914 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.143785  1387 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:57.915057  1409 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.153614 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:57.911976  1139 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:58.157064  1387 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:58.163076  1340 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.163501  1139 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:58.164552  1139 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.165813  1139 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.167059 29472 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:13:58.171201  1287 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.904s	user 0.013s	sys 0.000s
I20260709 13:13:58.174626 30151 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:13:58.179261  1307 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.179917  1094 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.180423  1094 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.172765 29543 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:58.184072  1297 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:58.188009  1397 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.189019 29543 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:58.158149 29509 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.193s (SENT)
I20260709 13:13:58.190936 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.193491 30151 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:58.194293 29471 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:58.214781 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:13:58.214614 29389 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:58.217336 29472 raft_consensus.cc:606] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:58.218704 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.220822 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.145622  1253 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.219648 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:58.222714 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 64599.9us
I20260709 13:13:58.222991 29543 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.224442 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.144713  1424 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:58.224911 29509 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.243s (SENT)
I20260709 13:13:58.190299  1397 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.266067 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:58.192620  1116 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:58.267366 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 44538.3us
I20260709 13:13:58.267486 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:58.267841 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 43510.6us
I20260709 13:13:58.191948  1363 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:58.269011 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 72792.4us
W20260709 13:13:58.273140 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48277.4us
I20260709 13:13:58.196409  1409 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.222249  1297 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.222831  1421 raft_consensus.cc:3055] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:58.274195  1202 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:58.219224  1024 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.302101   968 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.295006  1408 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:58.274318  1287 consensus_queue.cc:1059] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:13:58.294312  1421 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:58.318010  1409 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.321241  1287 raft_consensus.cc:3055] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:58.321616  1287 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:58.322992  1409 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.322389  1396 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.325443  1396 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.322641  1287 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.327720  1287 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.310762  1408 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:58.337332  1424 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.379895 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:58.381208 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 133207us
W20260709 13:13:58.383343 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.378522 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:58.386092 29389 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:58.387960 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 121941us
I20260709 13:13:58.379896 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.393541 29388 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.402328 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:58.415561 29463 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:13:58.425457 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.429733 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.431188 29465 raft_consensus.cc:2393] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 13: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:58.432367 29388 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:58.433416 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.435199 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.435397 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.448817 29469 raft_consensus.cc:2410] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:13:58.436441 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.439996 29389 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:58.449329 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.434299 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.450480 29467 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:58.451648 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.456140 29363 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.459520 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:58.462479 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:58.465510 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.466848 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.469888 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:58.484313 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.486289 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.487211 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:58.495358 30156 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:13:58.500013 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.299950   776 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.503535  1073 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.504364  1073 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.505071   776 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.507149   874 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:58.507697   874 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:58.508131   874 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.509071  1024 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.512636  1024 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:58.512923   968 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:58.506172   776 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:58.514259   968 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.514974   968 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.515226   776 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.516822  1073 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.519498  1073 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:58.519831  1024 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:58.520905  1024 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:58.522959  1024 consensus_queue.cc:1059] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:58.518693 30156 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:58.276167  1116 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.533576  1094 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:58.535288 30152 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:58.536443  1139 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:58.536584  1094 consensus_queue.cc:1059] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:58.537519  1116 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.537370  1139 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.539891  1094 raft_consensus.cc:3055] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:58.541946  1094 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:58.543170 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.543900  1139 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.517908   776 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.544987   776 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:58.518743 29509 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 2.560s (SENT)
I20260709 13:13:58.546849 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.547175  1024 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.519511 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.520027  1073 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.555541  1073 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.543634  1094 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.292716  1192 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.549619  1206 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:58.549636  1195 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:58.563406  1192 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:58.565635 29543 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:58.557888  1202 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:58.553944 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:58.568955  1195 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:58.571177 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:58.571012  1202 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.572551 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:13:58.573494 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 54180.7us
I20260709 13:13:58.279126  1253 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.574187  1202 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.567278  1094 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.547488 29463 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:58.574863 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.574954  1192 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.593514 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:58.594199  1192 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:58.528105 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 126491us
I20260709 13:13:58.578267 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.585893 29541 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:13:58.571206 29542 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.584903 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:58.529819 32204 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:58.596684 29472 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:13:58.583455 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:58.591161 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:58.577409  1253 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.592634   776 raft_consensus.cc:3055] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:58.584088  1223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49108 (request call id 966) took 6418 ms. Trace:
I20260709 13:13:58.592852  1139 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:13:58.657414 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:58.589135   968 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.589672  1194 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.662122 29543 raft_consensus.cc:2410] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:58.664634 29538 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.657184   776 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:13:58.672979 29540 consensus_meta.cc:287] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.927s	user 0.016s	sys 0.008s
I20260709 13:13:58.673511 29540 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
I20260709 13:13:58.674427 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:58.675130 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:58.675944 29537 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.676139 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:58.679549 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 988) took 1208 ms. Trace:
W20260709 13:13:58.679838 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 105116us
I20260709 13:13:58.682643 29467 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:58.663520  1195 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:58.687578 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:58.687680  1374 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.684484 29363 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:13:58.690740 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48588.5us
I20260709 13:13:58.693441 29512 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:58.703068 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.706416  1391 raft_consensus.cc:993] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:58.707278  1433 raft_consensus.cc:1081] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:13:58.707489   776 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.709184  1405 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:58.680040 30154 rpcz_store.cc:276] 0709 13:13:57.470645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.471234 (+   589us) service_pool.cc:224] Handling call
0709 13:13:57.498014 (+ 26780us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:57.628298 (+130284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.628353 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:57.643776 (+ 15423us) log.cc:844] Serialized 52 byte log entry
0709 13:13:57.740895 (+ 97119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:57.740949 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.016258 (+275309us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400601654. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:13:58.016331 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:58.678797 (+662466us) raft_consensus.cc:1685] finished
0709 13:13:58.678865 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.679245 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7408,"raft.queue_time_us":30764,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":6340,"spinlock_wait_cycles":280822528,"thread_start_us":56801,"threads_started":1,"wal-append.queue_time_us":247996}
I20260709 13:13:58.711828 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.711565  1387 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.688366 29545 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:13:58.713187 29393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2578) took 1267 ms. Trace:
I20260709 13:13:58.712100  1073 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.717510 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2586) took 1250 ms. Trace:
I20260709 13:13:58.717813   968 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.718771  1421 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.687991 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:58.725669 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:58.724685 29469 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:58.737313 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:58.739101  1192 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.724038  1253 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:58.746786 29546 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:58.697376   874 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.752610 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:58.754269  1424 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.692687  1408 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.727393  1421 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.715432 29393 rpcz_store.cc:276] 0709 13:13:57.415586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.435360 (+ 19774us) service_pool.cc:224] Handling call
0709 13:13:57.468539 (+ 33179us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:57.489084 (+ 20545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.489108 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:57.489538 (+   430us) log.cc:844] Serialized 52 byte log entry
0709 13:13:57.889567 (+400029us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:57.929500 (+ 39933us) log.cc:844] Serialized 14 byte log entry
0709 13:13:58.075880 (+146380us) log.cc:844] Serialized 14 byte log entry
0709 13:13:58.076146 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.076255 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:58.659206 (+582951us) raft_consensus.cc:1685] finished
0709 13:13:58.661405 (+  2199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.683033 (+ 21628us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109114,"prepare.queue_time_us":80356,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":100,"raft.queue_time_us":148698,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":21145,"thread_start_us":388015,"threads_started":1,"wal-append.queue_time_us":679442}
I20260709 13:13:58.740206  1405 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.775542 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.745057  1253 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.782167  1363 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:58.717924 29392 rpcz_store.cc:276] 0709 13:13:57.466750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.484027 (+ 17277us) service_pool.cc:224] Handling call
0709 13:13:57.487449 (+  3422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:57.905083 (+417634us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:58.005737 (+100654us) log.cc:844] Serialized 14 byte log entry
0709 13:13:58.049837 (+ 44100us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b48001c2858. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ed8caaa1 00007f61ed8c1b37 00007f61ed8c19ca 00007f61ed9b926f 00007f61ed9b8f37 00007f61ed9cd55c 00007f61ed9cd508 00007f61ed9cd488 00007f61ed9cd443 00007f61ed9cc6ec 00007f61ec8f6a96
0709 13:13:58.194710 (+144873us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:58.214602 (+ 19892us) log.cc:844] Serialized 52 byte log entry
0709 13:13:58.217048 (+  2446us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:58.217084 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.217156 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:58.716864 (+499708us) raft_consensus.cc:1685] finished
0709 13:13:58.717003 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.717303 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86908,"raft.queue_time_us":69560,"raft.run_cpu_time_us":3445,"raft.run_wall_time_us":510393,"spinlock_wait_cycles":8700672,"thread_start_us":527265,"threads_started":2,"wal-append.queue_time_us":301001}
W20260709 13:13:58.785341 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 49526.2us
I20260709 13:13:58.800479 29469 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:13:58.722807  1194 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.782224  1192 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:58.807367   874 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:13:58.808059  1442 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:13:58.804814 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:13:58.814975 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 70478.8us
I20260709 13:13:58.792258  1253 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:58.825927 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.790303  1363 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.829795  1363 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.830603  1202 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:58.831120  1202 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.831498  1202 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:58.834617  1431 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:13:58.835599  1431 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.827404 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:58.843046 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 131342us
I20260709 13:13:58.811041  1073 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:58.657930  1223 rpcz_store.cc:276] 0709 13:13:52.179740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.196745 (+ 17005us) service_pool.cc:224] Handling call
0709 13:13:52.617997 (+421252us) ts_tablet_manager.cc:934] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
0709 13:13:58.077871 (+5459874us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:13:58.324612 (+246741us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:58.324741 (+   129us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:13:58.558124 (+233383us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:13:58.583130 (+ 25006us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:58.583672 (+   542us) ts_tablet_manager.cc:989] Replica registered.
0709 13:13:58.583794 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":56114,"tablet-copy.queue_time_us":259208,"thread_start_us":822652,"threads_started":2}
I20260709 13:13:58.811439  1192 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:58.846604 29542 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:58.848590  1192 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.848596  1287 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:58.850855  1287 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.853308  1287 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:58.854414  1223 tablet_copy_client.cc:806] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:58.855258  1223 tablet_copy_client.cc:670] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:58.856424  1422 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:58.856910  1422 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.857285  1422 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:58.862951 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.863926  1424 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:58.866859  1401 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:58.867341  1401 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:58.868572  1401 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.867201 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:58.874845  1406 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:58.869871  1387 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:58.876672 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:58.878047 29435 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:58.878746  1409 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:58.879196 32204 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:58.879413  1409 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:58.879823 32204 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:58.881042  1409 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:58.882673 30152 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.870155  1401 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.890265 29538 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:13:58.898921 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:58.902706 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.905035 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:58.909461 29389 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:58.910768 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.911482 29388 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:13:58.911967 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:58.912807 29545 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:58.914252 29396 raft_consensus.cc:1240] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:58.916185   776 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.917112 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.919797  1431 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:58.881038 32204 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:58.836385  1391 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:13:58.945981 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:58.946491 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:58.947103 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.947602 29388 raft_consensus.cc:2393] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 10: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:58.962610 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.969553 29396 raft_consensus.cc:1240] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:58.971552 29389 raft_consensus.cc:1240] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:58.973062 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.973906 29391 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:13:58.975868 29392 raft_consensus.cc:1240] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:58.978765 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.981123 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:58.978853 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:58.990022 29537 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:58.993001  1195 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:58.998318 29467 raft_consensus.cc:2393] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:58.999394  1435 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.000257  1379 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:59.000021  1435 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.000675  1379 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:58.994164 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:13:59.005286 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.006490 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.009123  1408 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:59.001725  1379 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.024080 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.025619 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:58.993918  1195 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.022141  1435 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.031134  1379 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:59.036198  1195 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.036854 29438 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:59.037566  1192 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.041819  1192 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.042209 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.043825  1202 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.044632 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:59.046489  1433 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:59.050185 29438 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:59.027487 29394 raft_consensus.cc:2376] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8. Re-sending same reply.
W20260709 13:13:59.054790 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 317680us
I20260709 13:13:59.056908  1253 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.060228 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.060362 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.061192 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.061353 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.061964 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.062791 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.064055 30151 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
W20260709 13:13:59.069159 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.022965 30152 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:13:59.080847 29397 raft_consensus.cc:2393] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:13:59.081357 29391 raft_consensus.cc:2368] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:13:59.089650 29438 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:59.083081  1435 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:59.099377  1194 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.102614  1357 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:59.126472 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.127218 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.102789 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.127859 29465 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:59.128412 29540 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:59.102623  1396 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:59.130676  1396 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:13:59.130793 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.131166  1396 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:59.131601 29544 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:59.132974 29546 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:59.103777 29392 raft_consensus.cc:2376] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8. Re-sending same reply.
I20260709 13:13:59.099452 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:59.108589 30123 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.502s (SENT)
W20260709 13:13:59.111263 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 86065.3us
I20260709 13:13:59.111521 29360 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:59.113291  1253 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.114522 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.115615  1202 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.116268 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.117045 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.116261 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.119410 29541 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:59.119880 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.097575  1433 raft_consensus.cc:697] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:59.148566 29438 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:59.124687 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.135628 30123 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:59.162606 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.157006 29395 raft_consensus.cc:2376] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10. Re-sending same reply.
I20260709 13:13:59.164788   776 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.172257   776 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.174825 29542 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:59.175164 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.179124  1431 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.181519  1431 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.184453  1431 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.185940  1433 consensus_queue.cc:237] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.186285 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:59.187052 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 78708.7us
I20260709 13:13:59.187270 29466 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:13:59.188354  1404 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:59.188616  1372 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:59.191527 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:59.191922 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.192127  1336 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:13:59.193486 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.194649 29472 raft_consensus.cc:2410] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:13:59.178175  1357 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:59.159871  1379 consensus_queue.cc:1059] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:13:59.194729 29396 raft_consensus.cc:2368] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:13:59.192504  1431 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:59.198566 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:59.203755 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:59.148129  1435 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:59.206336 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.206216  1435 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.196636  1357 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.210896 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.214453 29465 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 14.
I20260709 13:13:59.217864   776 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.220667 29512 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:13:59.204396  1431 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.233285 29465 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:59.233752  1431 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:59.234395 29541 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:13:59.236994 29541 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:59.238397 29541 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:59.239223 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.240298 29543 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 13: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:13:59.241284 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.248528  1434 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:59.249219  1434 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.249650  1434 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:59.253334  1380 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:13:59.255537 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.256778 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.253657  1404 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:59.197950  1360 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:13:59.258411  1404 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.261634 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:13:59.267807 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 47226us
I20260709 13:13:59.268893 29546 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:13:59.275704 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.274392 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:13:59.198622  1392 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:59.280972 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.285522 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49609.4us
I20260709 13:13:59.291080 29469 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:59.290792 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:59.294742 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 96313.5us
I20260709 13:13:59.283324  1192 raft_consensus.cc:2804] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:59.294823 29390 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:13:59.283557  1392 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.297519  1348 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.294064  1391 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:59.308477 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:59.300388  1392 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:59.302547  1348 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:59.322939 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.303236  1192 raft_consensus.cc:697] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:13:59.302733  1428 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.311268  1387 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.342278 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.318692  1374 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.349258 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 43652.6us
I20260709 13:13:59.328859 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.352977  1416 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.346258  1387 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.353225  1192 consensus_queue.cc:237] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.353576  1416 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.355134 29469 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:13:59.355561 29469 pending_rounds.cc:85] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 8
I20260709 13:13:59.360481  1387 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.341513  1391 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:59.355798 29469 pending_rounds.cc:107] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:13:59.355788  1416 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.373210 29363 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:59.393744 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.394196 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:13:59.373929 29469 raft_consensus.cc:2889] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:59.406819 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.412983 29538 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:13:59.426378 30152 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:13:59.381538   874 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:59.324666  1422 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:13:59.444775 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 71419.6us
W20260709 13:13:59.458961 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 348245us
I20260709 13:13:59.471122 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:59.473012 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.373754  1401 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:13:59.380841  1406 consensus_queue.cc:1059] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:13:59.351652  1374 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.478941 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:59.492760 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:59.438194   776 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.498292 30154 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 13: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:13:59.503597 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:59.504537 30156 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:13:59.507606 30123 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:59.524677 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.526322 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.438383  1428 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:13:59.527993 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.528606 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.476948  1421 consensus_queue.cc:1059] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:13:59.526340 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 79639.9us
I20260709 13:13:59.531548 29470 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:13:59.532521 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.534116  1416 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:59.535578  1422 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.536273 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:59.541536  1416 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:59.501770  1073 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:59.546388 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:13:59.548521 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.542620  1094 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:59.553565 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 67871.9us
I20260709 13:13:59.542804   776 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.558040 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.560655 30123 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:13:59.568876 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:59.529536  1387 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.570539 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.506866  1396 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.581472   776 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.589592 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:59.592538   776 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.605484   776 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.581130  1406 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:59.568694  1401 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:13:59.582494   874 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.638079 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:59.638958 30156 raft_consensus.cc:3060] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:59.640659   776 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.610025  1372 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:59.583529  1387 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.594040  1348 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:13:59.652971 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 163307us
I20260709 13:13:59.651693 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:59.653403 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:13:59.636312  1409 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.659307 30155 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:13:59.660759 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72705.5us
I20260709 13:13:59.661918 29541 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:59.662005 29363 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:59.667750 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.634249   874 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:59.678743 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.680254  1372 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:59.684432   968 raft_consensus.cc:3055] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:59.684882   968 raft_consensus.cc:740] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:13:59.686142 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.649652  1421 consensus_queue.cc:1059] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:13:59.693640 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.695286 29390 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.696326 30159 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:59.696696 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:13:59.735872 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 69313.7us
I20260709 13:13:59.737773 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:13:59.747393  1465 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:59.708441   968 consensus_queue.cc:260] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.791997 29396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:13:59.792948   968 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.672675  1404 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:59.793817  1404 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.794369  1404 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:59.694155  1409 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.697999 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:59.788582 29542 raft_consensus.cc:1275] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:59.691936  1391 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:13:59.790840  1202 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.705356  1387 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.797399  1202 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.711510  1421 raft_consensus.cc:3055] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:59.791584 29541 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:59.799880  1421 raft_consensus.cc:740] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:59.792903 29396 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:59.800721 29396 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:59.800762 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 122193us
I20260709 13:13:59.801084  1421 consensus_queue.cc:260] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.800827  1202 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:59.801832 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:13:59.790937 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 129026us
I20260709 13:13:59.806972 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.697906 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:13:59.809312 30156 raft_consensus.cc:2468] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 14.
I20260709 13:13:59.810995 29393 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:13:59.812314 30156 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:13:59.813861  1348 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:59.815261  1396 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.815753 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.816780  1348 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:59.816919  1462 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 13:13:59.818287  1422 raft_consensus.cc:3055] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:59.818383 29363 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:59.818874  1422 raft_consensus.cc:740] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:13:59.819324  1406 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:59.819885  1406 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:59.820061  1422 consensus_queue.cc:260] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.820901  1406 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.822041  1422 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:59.822687 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:13:59.823704   776 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:59.824556 29395 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:59.831996 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.836823 30156 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:13:59.840013 29390 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:13:59.787249 30123 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:13:59.849140 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.844798 29396 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.708762  1471 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.852131 29394 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:59.709790   874 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.853223 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.861560 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.862067 29390 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.708072  1428 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.857458 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.865583 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:13:59.859265 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 72104.5us
I20260709 13:13:59.862217 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:13:59.693981  1374 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.786373  1357 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.862950 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.806667  1387 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:59.828604  1421 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.871070 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.868417 29393 raft_consensus.cc:2376] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10. Re-sending same reply.
I20260709 13:13:59.869328  1094 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:59.869901 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.828389  1192 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:59.876994 29541 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:59.874024 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:13:59.877629   776 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:59.872272 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:59.876394 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.882692 29397 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
W20260709 13:13:59.887573 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 233535us
I20260709 13:13:59.888176 29396 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.897297 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.900671 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.873624   874 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.878399  1094 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.866277  1379 consensus_queue.cc:1048] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:13:59.902763 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.908746 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.908887 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:13:59.912175 29389 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:59.913044 30123 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:13:59.914137 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 53672.4us
I20260709 13:13:59.919102 29393 raft_consensus.cc:2376] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10. Re-sending same reply.
I20260709 13:13:59.917703   776 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:13:59.902649  1401 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:59.923704  1401 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:13:59.924147  1401 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:59.906253  1434 consensus_meta.cc:287] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.656s	user 0.014s	sys 0.005s
I20260709 13:13:59.898247  1409 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:13:59.935441 30158 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:13:59.911216  1195 raft_consensus.cc:3055] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:59.911625  1094 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:59.918116  1387 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:59.946980 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.944644 29393 raft_consensus.cc:1240] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:13:59.955880 29389 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
W20260709 13:13:59.954712 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 92591us
W20260709 13:13:59.950062 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 85891.8us
I20260709 13:13:59.881042  1471 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.947847  1195 raft_consensus.cc:740] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:13:59.965660 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:13:59.913636  1357 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:13:59.918455   874 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.971575 29544 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:13:59.972728 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 90566.6us
I20260709 13:13:59.969869 29541 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:13:59.964833 29390 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:13:59.965378  1374 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:13:59.979446  1374 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.981758  1374 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.982821  1195 consensus_queue.cc:260] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.984378  1195 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.985901  1471 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:13:59.987362 29395 raft_consensus.cc:1240] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:59.943377  1434 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:13:59.989606  1434 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:13:59.974839 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:13:59.990363 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:13:59.991693 29465 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:13:59.936532  1253 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:13:59.992322  1392 consensus_meta.cc:287] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.005s
W20260709 13:14:00.014559 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 126016us
I20260709 13:14:00.021341 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:00.022951  1479 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:00.023736  1479 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.020182 29396 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:00.017246 29463 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
W20260709 13:14:00.026891 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.027525 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:00.015547  1428 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:00.028146 29469 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:00.028234  1428 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.028759  1428 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:00.031215  1476 log.cc:927] Time spent T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:14:00.031374 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:00.031898  1481 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.032117 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:00.033087  1193 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.033669  1193 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.035317 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:00.036235  1408 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.965895  1336 consensus_queue.cc:1059] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:14:00.036895  1408 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.037348  1336 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:00.037724  1336 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:00.032538  1481 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.044776  1481 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.049427 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:00.050676  1483 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:13:59.997167  1431 consensus_meta.cc:287] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.763s	user 0.014s	sys 0.004s
I20260709 13:14:00.054822  1431 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.057367  1431 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.032598 30154 raft_consensus.cc:1240] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:00.059924  1428 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.028578 29469 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:00.074651 29466 raft_consensus.cc:3055] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:00.074999 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:00.075220 29469 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.061129  1392 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.075937 29470 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.076351 29469 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.077839  1392 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.075232 29466 raft_consensus.cc:740] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:00.079370 29466 consensus_queue.cc:260] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.080015 29388 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:14:00.080471 29466 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.082002 29390 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:00.082861 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:00.083487 29389 raft_consensus.cc:1275] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:00.083678 29393 raft_consensus.cc:2393] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:00.083878  1428 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.084966 29397 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:00.086119  1193 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:00.093011  1470 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.380s	user 0.001s	sys 0.001s
I20260709 13:14:00.096093  1336 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.097694  1336 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:00.045109  1357 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.089210 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:00.117507 29470 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:00.117889 29397 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:00.105890  1474 log.cc:927] Time spent T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:14:00.121191  1360 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:00.062314  1479 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.128841  1193 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:00.132350  1401 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.132850  1348 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:00.136421 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 157317us
I20260709 13:14:00.142023 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:00.128328  1404 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.160952  1094 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.163278 30158 raft_consensus.cc:2368] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 11. Current term is 12.
I20260709 13:14:00.165884 29392 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:00.165635 29467 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:00.166949  1401 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.166988 30153 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
W20260709 13:14:00.161985 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 52092.2us
I20260709 13:14:00.155896  1479 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:00.165624 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 192128us
I20260709 13:14:00.169857 29435 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:00.170025  1479 raft_consensus.cc:697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:00.171258  1479 consensus_queue.cc:237] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.173677  1193 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:00.174536  1193 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:00.175438  1404 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.175629  1193 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.178879 29466 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 13:14:00.165792 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.179252 29466 pending_rounds.cc:85] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 9
W20260709 13:14:00.180001 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 157778us
I20260709 13:14:00.186525 29466 pending_rounds.cc:107] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:14:00.190567 29466 raft_consensus.cc:2889] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:00.180143 29435 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:00.183452 29469 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
W20260709 13:14:00.221068 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.220670 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:00.222222 29396 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:14:00.215122  1431 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:00.229036 29470 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:00.220670 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:14:00.242569 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 55784.8us
I20260709 13:14:00.244753 29509 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:00.248371 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:00.248323 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:00.249552 29389 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:00.251157 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:00.252039 29390 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.255399 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:00.256348 29393 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:00.261991 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:00.273023 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:00.277745 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:00.278151 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:00.278473 29388 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:00.231707  1483 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.233522  1392 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:00.260002  1396 consensus_queue.cc:1059] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:14:00.231849  1431 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:00.263666  1404 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:00.284462   776 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:00.294800  1431 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.301569 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.302655 29541 raft_consensus.cc:2410] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:00.303612 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.304203 29541 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:00.305092 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.306720  1480 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:00.307202 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.308518 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.309077 29546 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:14:00.309885 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.263371  1422 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.310770  1422 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.311831 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.313045 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.313223  1422 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.313782 29545 raft_consensus.cc:2468] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:14:00.314924 29543 raft_consensus.cc:1240] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:00.315858 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:00.316411 29539 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.319734 29390 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:00.323364 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.282377  1223 tablet_copy_client.cc:538] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:00.329412 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:00.330116 29544 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.330511  1484 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:00.332152  1485 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:00.334299  1486 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:00.335181  1486 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.339099  1379 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:00.341670  1379 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:00.342633  1392 consensus_queue.cc:1048] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:00.324656  1192 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:00.347752  1192 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:00.289996  1471 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:00.339241  1297 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:14:00.285445  1408 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.355290 29546 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:14:00.338166  1486 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:00.357424 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:00.366715 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.367239 29470 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 11: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:00.357059 29541 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:00.359373 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:00.367936 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.368281 30156 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 5.
I20260709 13:14:00.366281 29545 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:00.274612  1253 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:14:00.292233  1094 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:00.371086 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 116083us
W20260709 13:14:00.380354 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 129741us
I20260709 13:14:00.327672  1404 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:00.398732 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.380754 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:14:00.409286 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.412405 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.424717 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:00.425504 29543 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:00.428738 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 90311.1us
I20260709 13:14:00.354878  1483 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.439472 29546 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:14:00.443455 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:14:00.518618 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 72983.2us
I20260709 13:14:00.519680 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:00.526901 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.535465 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:00.536379 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.528151 32204 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:00.445595  1421 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.001s
I20260709 13:14:00.563997 32204 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.560925 30157 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:00.564428 32204 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.437841  1401 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.571434  1475 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.560s	user 0.000s	sys 0.006s
W20260709 13:14:00.565378 30126 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.652s (SENT) [suppressed 21 similar messages]
I20260709 13:14:00.572954 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:00.573915  1404 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.442270  1479 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:14:00.578810  1195 consensus_meta.cc:287] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.004s
I20260709 13:14:00.582891  1491 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:00.583046 29545 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:00.585709  1483 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.589785 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:00.595378 29544 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:00.610358 30156 raft_consensus.cc:2410] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:14:00.595499 29539 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:00.597477 29543 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:00.599486 29397 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:00.602921 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:00.612810 29540 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.604251 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:00.607123 29435 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:00.613481 29538 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.574741  1433 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:00.589380   968 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:00.517819  1396 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:14:00.608443  1406 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:00.617244  1073 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:00.619587 29435 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:00.620213  1379 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:00.609359  1491 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.609081  1253 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:00.620882  1501 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:00.598091  1401 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.623634  1195 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:14:00.648741 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.628453  1379 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.614121  1431 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:00.661862 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 98190.6us
I20260709 13:14:00.658794  1408 raft_consensus.cc:2804] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:00.662727 29540 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:00.633440  1491 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:00.679207  1094 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.679833  1094 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.633821  1433 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.684666  1491 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:00.693248 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 120413us
W20260709 13:14:00.704519 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 85019.8us
I20260709 13:14:00.626263   968 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.631961  1479 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.667205  1379 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.633334  1406 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.646020  1073 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.710342 32204 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:00.736923  1297 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:00.737751  1297 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.758993 32204 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.768751 29538 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:00.775729  1094 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.777302  1192 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.729487  1195 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:00.769140 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:00.798905  1509 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:00.799948  1297 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.799803  1509 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:00.801801  1505 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:14:00.803328  1194 raft_consensus.cc:3055] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:00.803848  1194 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:00.804957  1194 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.807988   968 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.808743  1194 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:00.812266  1336 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.714s	user 0.008s	sys 0.006s
I20260709 13:14:00.813834  1491 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.815354  1195 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.816015  1479 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.817111   874 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:00.818719  1502 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:00.879935 29540 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:00.880453 29546 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:00.880668 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.819283 29537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2894) took 1006 ms. Trace:
I20260709 13:14:00.820422  1431 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.822093 29435 leader_election.cc:400] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 11. Current term is 12.
I20260709 13:14:00.885394 29435 leader_election.cc:403] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:00.881204 29537 rpcz_store.cc:276] 0709 13:13:59.812924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.813050 (+   126us) service_pool.cc:224] Handling call
0709 13:13:59.859624 (+ 46574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.875525 (+ 15901us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:59.902928 (+ 27403us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.096430 (+193502us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b180049f960. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61e8999060 00007f61e89ab716 00007f61e89bc287 00007f61e89bc208
0709 13:14:00.268136 (+171706us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b180049f960. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:14:00.317907 (+ 49771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.317971 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:00.318026 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.818995 (+500969us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b54001a0c54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:00.819053 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.819206 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6072,"prepare.queue_time_us":27147,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":42300,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"spinlock_wait_cycles":48499200,"thread_start_us":179922,"threads_started":1}
W20260709 13:14:00.886327 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 104728us
I20260709 13:14:00.887758 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:00.888010 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:00.888482 29545 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.806928  1406 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.827538  1509 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.831223  1401 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:00.835179 29392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2627) took 1009 ms. Trace:
I20260709 13:14:00.894279 29392 rpcz_store.cc:276] 0709 13:13:59.826206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.826562 (+   356us) service_pool.cc:224] Handling call
0709 13:13:59.829452 (+  2890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.166520 (+337068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.834847 (+668327us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001720d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:00.835091 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773130624}
I20260709 13:14:00.836108  1391 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:00.837256 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:00.896184 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:00.907655 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 70479.4us
I20260709 13:14:00.907744 30152 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:00.838315  1073 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:00.840189 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 109712us
I20260709 13:14:00.840976  1472 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:00.846527 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:00.849895 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:00.852833  1485 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.857215  1223 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:00.875512 32204 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.917778  1509 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:00.980685 32204 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.878091 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:00.884863 29360 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:14:00.983340 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 101239us
I20260709 13:14:00.892220 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:00.858273  1433 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.896590 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:00.896814 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:00.918883 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.987488 29544 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:00.987526 29435 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:00.945722 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:00.944634 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:00.989233 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:14:00.989621 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.923769 29470 raft_consensus.cc:2410] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:14:00.922634 30151 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:14:00.990150 29465 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:00.921243  1406 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:00.945731  1192 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:00.986905 30159 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:00.995070 29396 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:14:00.999420 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:00.992475 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:00.947432  1408 raft_consensus.cc:697] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:01.000337 29389 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:01.001546 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.003886 29395 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:01.001243 29438 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:01.004719 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:01.007174 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:01.007946 29544 raft_consensus.cc:3060] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:01.008984 32204 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:01.009557 32204 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:01.010025 32204 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:01.014590 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:01.014992 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:01.014616 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:01.015955 29394 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:01.016271 30159 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:01.023425 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:01.023205 32204 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.024518 29464 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:01.026590 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:01.030668 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:00.991773   874 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:00.993696  1406 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.045782 29542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2896) took 1189 ms. Trace:
I20260709 13:14:01.052515 29539 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:01.052610 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:01.046401 29542 rpcz_store.cc:276] 0709 13:13:59.846006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.846187 (+   181us) service_pool.cc:224] Handling call
0709 13:13:59.866644 (+ 20457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:00.009170 (+142526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:00.009210 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:00.133448 (+124238us) log.cc:844] Serialized 26 byte log entry
0709 13:14:00.532782 (+399334us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:00.532825 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.532929 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.034714 (+501785us) raft_consensus.cc:1685] finished
0709 13:14:01.034756 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.034939 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":385,"raft.queue_time_us":43758,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":24880,"thread_start_us":513111,"threads_started":2,"wal-append.queue_time_us":561907}
W20260709 13:14:01.058944 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 60967.5us
I20260709 13:14:00.985188  1379 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:00.955637  1391 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.065752 29509 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:00.985504  1485 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:01.067369 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.045085   874 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.032720  1494 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:01.077997 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:01.060134  1192 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:01.048692  1406 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:01.069326 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 63540.6us
I20260709 13:14:01.015417  1416 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:14:01.088285 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:01.085685 29472 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
W20260709 13:14:01.088960 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 101526us
I20260709 13:14:01.100811 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:01.102212 29468 raft_consensus.cc:2410] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:14:01.103097 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.103660 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:01.104612 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.096813 29544 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:01.104815 29389 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:01.109930 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:01.079810   874 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.098591  1431 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:01.072914  1515 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:01.106710 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:01.143723 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:01.144837 29544 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
W20260709 13:14:01.154183 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 88529.5us
I20260709 13:14:01.154418 29544 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:01.156317 29509 leader_election.cc:400] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:01.156746 29509 leader_election.cc:403] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:14:01.157809  1511 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:14:01.163616  1516 log.cc:927] Time spent T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:14:01.168172  1379 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:01.174510  1409 raft_consensus.cc:3055] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:01.175165  1409 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:01.180330  1391 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:01.183653  1485 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:01.131990  1192 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:01.134296  1491 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:01.135496  1499 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:01.141317  1515 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.085685  1494 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.197132  1392 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:01.205600 29394 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:01.099534  1408 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.139401  1501 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 13:14:01.247305 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 91149.4us
I20260709 13:14:01.208649  1491 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.191112  1493 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:01.209844  1472 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:01.230767  1515 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.266165 29509 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:01.249032  1416 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.257910  1491 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:01.279976 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.243006  1392 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.271540  1472 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.299580  1472 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:01.300074 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:01.302933 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:01.307964 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 219844us
W20260709 13:14:01.291033 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 204250us
W20260709 13:14:01.310029 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 180624us
I20260709 13:14:01.291071  1493 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:01.318925 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 68618.1us
I20260709 13:14:01.317296 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:01.451826  1530 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:01.356787  1523 log.cc:927] Time spent T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:14:01.457846  1479 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:01.458117  1530 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.458557  1479 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.461161  1479 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:01.461424  1530 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:01.289729  1416 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.320636  1501 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:14:01.251641  1409 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.316553  1192 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:01.456679 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.475231 29545 consensus_meta.cc:287] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.559s	user 0.023s	sys 0.008s
I20260709 13:14:01.475960 29545 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
W20260709 13:14:01.477626 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 160414us
I20260709 13:14:01.472087 29466 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:01.452891  1392 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:01.486369 29466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59308 (request call id 2360) took 1208 ms. Trace:
W20260709 13:14:01.478585  1518 log.cc:927] Time spent T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.184s	user 0.000s	sys 0.008s
I20260709 13:14:01.455248  1387 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:01.501916 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 182074us
I20260709 13:14:01.502214 29393 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:01.503052 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:01.487596 29466 rpcz_store.cc:276] 0709 13:14:00.272262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.272431 (+   169us) service_pool.cc:224] Handling call
0709 13:14:01.299892 (+1027461us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b5800175898. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed9670a0 00007f61ed966984 00007f61e6ee16d4 00007f61e6ee1662
0709 13:14:01.480075 (+180183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12219264}
I20260709 13:14:01.507402  1532 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:01.508020  1532 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.508566  1532 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:01.505721  1387 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.511457 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:01.512384  1387 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:01.513798 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:01.514417 29391 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:01.516650  1416 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:01.518337 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:01.519186 30152 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:01.519428 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.520184 29390 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
W20260709 13:14:01.527521 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54922.8us
I20260709 13:14:01.529214 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:01.537796   874 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.486959  1520 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:14:01.549839 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.537766 29438 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:01.555153 29391 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:01.558837 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:01.566361 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:01.567916  1499 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:01.568912 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65956.8us
I20260709 13:14:01.599502 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:01.572252  1494 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:01.542476  1483 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:01.600906  1483 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.578886  1223 tablet_bootstrap.cc:700] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent opening tablet: real 0.183s	user 0.003s	sys 0.000s
W20260709 13:14:01.609723  1509 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.619s	user 0.016s	sys 0.000s
I20260709 13:14:01.610276  1509 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 11. Current term is 12.
I20260709 13:14:01.615187  1486 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:01.615749  1486 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:01.616914  1486 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.022856 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:01.584617  1406 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:01.565683  1253 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.585901  1194 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:01.587013   874 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:01.581936  1491 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.589711  1532 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:01.590811  1515 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:01.619135 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52897.6us
I20260709 13:14:01.654690 29470 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
W20260709 13:14:01.645159 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 175620us
I20260709 13:14:01.654873 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:01.656092 29543 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:01.644771 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:01.658048 29542 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:01.659163 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:01.659775 29539 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:01.662098 29545 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:01.619417  1514 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:01.673349 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:01.618419  1486 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.675105 29388 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:01.648342  1431 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:01.683967 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.648648  1194 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:01.687443 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.691511 29392 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:01.606021  1499 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.702474 29394 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:14:01.658879  1530 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:14:01.707743 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 195120us
I20260709 13:14:01.707304 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:01.708936 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.709517 29390 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:01.709769 29392 raft_consensus.cc:2393] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 10: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:01.710932 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:01.713341 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:01.717559 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.727115 29393 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:01.723664 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:01.720810  1387 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:01.729255 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 129886us
W20260709 13:14:01.853338 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.829272 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.894953 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 171410us
I20260709 13:14:01.895860 29435 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:01.730350 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:01.719444 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.727913 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:01.719009  1514 raft_consensus.cc:697] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:01.882426 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:01.690451  1202 raft_consensus.cc:2764] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:14:01.918155 29539 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:01.968771 30152 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.704566  1194 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:01.865599  1525 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:01.974952 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 186083us
I20260709 13:14:01.978121 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:01.886368  1387 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:01.905458  1502 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:14:01.968953 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 247934us
I20260709 13:14:01.855237  1253 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.717644  1431 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:01.994180 29390 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:14:02.001360 32204 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.702682  1193 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.270s
I20260709 13:14:01.972700  1529 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:02.014767 32204 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:01.921096  1533 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.029131 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:01.981501  1472 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:01.999066  1387 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:01.984656  1416 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:02.040942 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 52403.1us
I20260709 13:14:02.012055  1485 raft_consensus.cc:2764] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:14:02.041543  1491 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.042160  1472 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.030289  1533 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:01.921561  1372 consensus_queue.cc:1059] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:14:01.780380  1530 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.044262  1406 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.012785  1525 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.016566  1253 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:02.191256 30126 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.550s (SENT)
W20260709 13:14:02.206282 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 298182us
W20260709 13:14:02.051252 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83759.4us
I20260709 13:14:02.221493 32204 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.252218 29466 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:02.252687 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:02.255981 29544 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:02.259814 30152 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:14:02.112941  1515 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.213394  1533 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.087625  1483 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.114786  1499 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:02.274104 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 121052us
W20260709 13:14:02.279716 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 229094us
W20260709 13:14:02.264856 29472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 2055) took 1418 ms (client timeout 1643 ms). Trace:
I20260709 13:14:02.234329  1433 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:02.282724 29472 rpcz_store.cc:269] 0709 13:14:00.845954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.846213 (+   259us) service_pool.cc:224] Handling call
0709 13:14:02.264555 (+1418342us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54001e6254. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:02.264745 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376756992}
I20260709 13:14:02.287899 29360 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:02.054335  1416 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.116384  1514 consensus_queue.cc:237] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.293725  1529 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:02.302016  1515 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:02.086722  1431 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.337500 29544 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:02.315071  1493 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:02.343150 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 110737us
I20260709 13:14:02.319697  1557 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.301878  1433 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.335851  1348 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.370625 29509 leader_election.cc:400] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:14:02.386474 29509 leader_election.cc:403] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:02.380448  1561 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:02.389621 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:02.385874  1557 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.390383 30154 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.391410 30153 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:02.389469  1561 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.392421  1557 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.393070  1557 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.393612  1557 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.394073  1561 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.394906 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:02.395605 30160 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:02.342017  1515 raft_consensus.cc:697] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:02.408020  1558 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:14:02.427050  1563 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
W20260709 13:14:02.428766 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.410492  1348 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.432605  1557 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.428134  1192 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.433835  1348 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.433924  1192 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.436879  1515 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:02.444766  1551 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
W20260709 13:14:02.479142 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 134810us
W20260709 13:14:02.483922 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53201.2us
I20260709 13:14:02.494369  1387 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.497710  1406 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.498481  1406 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.500563  1406 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.497773  1387 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.447108  1525 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.514149  1433 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:02.515246  1416 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.481706  1567 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.516127  1567 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.515352  1555 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.517195  1555 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.520381  1555 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:02.524228 30154 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
W20260709 13:14:02.521937  1194 consensus_meta.cc:287] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:14:02.532275 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:02.490787  1530 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.503528  1253 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.525930  1567 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:02.472465  1529 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.536620  1555 raft_consensus.cc:2764] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:14:02.536924  1192 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.551329 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:02.552901 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:02.554023  1253 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.554487 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:02.555065  1253 raft_consensus.cc:2764] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:14:02.555351  1431 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:02.556754 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:02.557590  1431 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.557993  1431 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.558430  1431 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.566555  1409 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.568881  1431 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:02.569969 29537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2918) took 1543 ms (client timeout 1797 ms). Trace:
W20260709 13:14:02.570536 29537 rpcz_store.cc:269] 0709 13:14:01.027013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.060467 (+ 33454us) service_pool.cc:224] Handling call
0709 13:14:02.569654 (+1509187us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b540036cc54. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:02.569848 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338881280}
I20260709 13:14:02.537431  1194 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:02.548799  1486 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.861s	user 0.017s	sys 0.002s
I20260709 13:14:02.574879 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:02.583014 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:02.586402  1194 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.579195  1297 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.593001 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:02.595116  1486 raft_consensus.cc:2764] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:14:02.595918  1486 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:02.596302  1486 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:02.596685  1486 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:02.599347  1534 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.744s	user 0.004s	sys 0.001s
W20260709 13:14:02.601059 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.604755 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:02.606058 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:02.606720 30160 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:02.602794 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:02.615622 30160 raft_consensus.cc:1275] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:02.616766 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:02.617775 30156 raft_consensus.cc:2368] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11.
I20260709 13:14:02.619724 29360 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:02.622962  1530 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.623559  1530 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.624012  1530 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.612948  1504 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:02.639119 29472 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:02.642984 30156 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:14:02.643618 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.644500 29472 raft_consensus.cc:2393] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:02.645455 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:02.646232 30154 raft_consensus.cc:2368] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:14:02.654860 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.655848 29472 raft_consensus.cc:2410] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:14:02.661525 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:02.662674 30156 raft_consensus.cc:2368] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:02.662912 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:02.663636 30154 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:02.649415  1494 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.644879  1431 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:02.677565 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:02.651818  1504 raft_consensus.cc:697] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:02.683897 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:02.684768 30160 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:02.684901 30154 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:14:02.685272 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:02.679543 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.697152 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:02.698016 30160 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
W20260709 13:14:02.688866  1569 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:14:02.711303 30123 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:02.712282  1567 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:02.719132 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2663) took 1617 ms. Trace:
I20260709 13:14:02.681782  1494 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.702744  1431 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.762135 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:02.755584 29545 raft_consensus.cc:1240] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:02.763092 29537 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:02.748090 30160 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:02.755118 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.719668 29395 rpcz_store.cc:276] 0709 13:14:01.101532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.103161 (+  1629us) service_pool.cc:224] Handling call
0709 13:14:01.611121 (+507960us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5800002a98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9b90ab 00007f61ed9b9131 00007f61ed97afc0 00007f61ed965929 00007f61ed9653d2 00007f61e6edcbd4
0709 13:14:01.611381 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.781368 (+169987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.781406 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.781458 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:01.781490 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.718790 (+937300us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400160654. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:02.718856 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.719045 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399773184}
I20260709 13:14:02.785604 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:02.766830 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:02.791440 29545 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:02.792986 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.894340 29467 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:02.902293 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.886395 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:02.883363 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.996351 29542 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:02.756341 29509 connection.cc:256] RPC call timeout handler was delayed by -1.2812206109999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 13:14:02.924389 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.829162 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:02.973172 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2926) took 1345 ms. Trace:
W20260709 13:14:02.942123 29470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39036 (request call id 638) took 1953 ms (client timeout 1640 ms). Trace:
I20260709 13:14:02.927809 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.799820 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:02.924536 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.940449 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:02.889964 29466 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:02.999207 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.002130 29541 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:02.870255 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:03.003484 29463 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:02.765502 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.999586 29469 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:03.001047 29540 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:14:03.005847 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.006753 29540 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:02.830802 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:02.827108  1202 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:02.900336  1435 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:03.010897 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.011657  1435 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.012045  1530 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.012424 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.013175 29544 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:02.906409 29438 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:14:03.016099 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.999084 29470 rpcz_store.cc:269] 0709 13:14:00.988659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.999138 (+ 10479us) service_pool.cc:224] Handling call
0709 13:14:02.941881 (+1942743us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54000d0554. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:02.942029 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406971648}
I20260709 13:14:03.017737 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:14:02.798467 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 86081.2us
W20260709 13:14:03.016585 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 110292us
I20260709 13:14:03.019909 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:03.020885 29540 raft_consensus.cc:2368] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11.
I20260709 13:14:03.020953 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:03.019848 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 79506.8us
I20260709 13:14:03.022181 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.022812 29545 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:03.019989 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.024416 29537 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 13: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:02.998196 29546 rpcz_store.cc:276] 0709 13:14:01.627578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.629552 (+  1974us) service_pool.cc:224] Handling call
0709 13:14:01.629808 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.684821 (+ 55013us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:01.731939 (+ 47118us) log.cc:844] Serialized 14 byte log entry
0709 13:14:02.000615 (+268676us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:02.001376 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 13:14:02.001543 (+   167us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:02.001580 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.001656 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:02.943052 (+941396us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b180048f040. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:14:02.972788 (+ 29736us) raft_consensus.cc:1685] finished
0709 13:14:02.972913 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.973079 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62465,"prepare.queue_time_us":370341,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":102746,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":19913,"spinlock_wait_cycles":22355328,"thread_start_us":134740,"threads_started":2,"wal-append.queue_time_us":287591}
I20260709 13:14:03.027925 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.029286 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:03.029834 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 200837us
W20260709 13:14:02.929774  1540 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 1.026s	user 0.002s	sys 0.004s
W20260709 13:14:02.932408  1578 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.214s	user 0.000s	sys 0.010s
I20260709 13:14:03.024302  1357 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:02.828301  1506 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.032725 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.034027 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:14:02.938001  1535 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 1.122s	user 0.006s	sys 0.001s
I20260709 13:14:02.733001  1494 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.043646 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:02.791213  1253 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:03.032125 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:02.745402  1431 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.040073 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.086628 29467 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:14:03.090648 29544 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:14:03.029105  1379 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:02.963115  1567 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.100487 29542 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:03.101331 29539 raft_consensus.cc:1240] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:03.087102 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46959.3us
I20260709 13:14:03.044847 29438 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:03.088299 29469 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:02.753803  1533 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:02.730368  1472 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.098131 29464 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:03.098261 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.110054 29543 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:14:03.032811  1404 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:03.122332  1485 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.123136  1485 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.126921 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.127151  1485 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.127737 29469 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:03.036535  1522 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:14:03.131309  1485 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.132496  1431 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.132249  1485 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:02.907294  1504 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.135551  1485 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.136157  1485 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.104372  1253 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.139532  1253 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:02.867775  1552 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.293s
I20260709 13:14:02.800796  1555 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.264s
I20260709 13:14:03.142161  1555 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:03.142664  1555 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:03.033054  1195 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.035924  1479 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.084899 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:03.111454  1336 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:03.040359  1357 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:03.094424  1194 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:03.111814  1073 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:03.112636 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.115199  1435 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.116042 29465 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:03.103721  1372 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:03.136742  1485 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.153643  1195 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.161399  1485 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.010973  1202 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.161718  1195 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.150646  1194 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:14:03.101887  1409 consensus_meta.cc:287] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.002s
W20260709 13:14:03.152017 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 67217.8us
I20260709 13:14:03.171231 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:03.172166 29542 raft_consensus.cc:2410] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:14:03.153662 29544 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:03.150480  1357 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:03.157591 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:03.148046  1223 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:14:03.085435  1532 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.153162  1336 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:03.089473  1512 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
W20260709 13:14:03.154244  1535 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:03.168043  1202 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.176851 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:03.197203 29541 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:03.177597 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:03.165591 30126 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.652s (SENT)
I20260709 13:14:03.183990 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:03.143911  1555 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:03.086671  1506 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.157384  1391 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:03.173768   968 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.193444 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:03.203410 29543 raft_consensus.cc:2368] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11.
I20260709 13:14:03.108669  1567 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.198763 30126 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:03.156540  1479 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.174523  1194 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:03.198330 30156 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:03.200729 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:03.180750  1409 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.185626  1379 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:03.215801  1479 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.211306 30155 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:03.164595  1372 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.224258 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.226089 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:03.227219 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:03.227519 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.227821 30152 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:03.202522  1528 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.232635 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:03.233273 29395 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:03.234247 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2656) took 2228 ms. Trace:
I20260709 13:14:03.228790 29541 raft_consensus.cc:2393] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 13: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:03.202636  1391 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:03.234683 29397 rpcz_store.cc:276] 0709 13:14:00.991952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.992093 (+   141us) service_pool.cc:224] Handling call
0709 13:14:00.992416 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.009813 (+ 17397us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:01.255162 (+245349us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.546421 (+291259us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:01.595672 (+ 49251us) log.cc:844] Serialized 26 byte log entry
0709 13:14:01.595847 (+   175us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:01.595885 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.595983 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:02.936840 (+1340857us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:03.216603 (+279763us) raft_consensus.cc:1685] finished
0709 13:14:03.220451 (+  3848us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:03.220606 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31979,"prepare.queue_time_us":308443,"prepare.run_cpu_time_us":3229,"prepare.run_wall_time_us":99758,"raft.queue_time_us":15465,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":42539,"spinlock_wait_cycles":433433856,"thread_start_us":413121,"threads_started":2,"wal-append.queue_time_us":373232}
I20260709 13:14:03.241230 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.211949  1557 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:03.242045 29388 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:03.252256 29394 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:03.246599  1391 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:03.207984   968 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.256094  1506 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.256749  1555 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:03.220456  1409 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.264648  1409 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.244784  1528 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.266700  1372 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.270977 29393 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:03.271844 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:03.276412 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.277069 29390 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:03.278374 30159 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:03.279177  1336 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.280766 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.228557  1379 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.282124 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:03.294652 29546 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 13: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:03.271844 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.286145  1379 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.295693 29542 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:03.270309 29509 leader_election.cc:400] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11.
I20260709 13:14:03.297667 29435 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:03.303917 29509 leader_election.cc:400] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
I20260709 13:14:03.304207 29509 leader_election.cc:403] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:03.304793 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:03.274344 29397 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:03.254293 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.307554 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.308360 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:03.314031 29395 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:03.314849 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:03.315037  1533 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.322857 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.326063 29397 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:03.320454 29512 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:03.314422 30152 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:03.359367 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.331686 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.301302  1192 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.383955 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.379985 29538 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:14:03.318251  1548 raft_consensus.cc:3055] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:03.351759 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 47975.3us
W20260709 13:14:03.405699 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.380957 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:03.407421 29509 leader_election.cc:400] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
W20260709 13:14:03.409744 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 89419.8us
I20260709 13:14:03.411715 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:03.356909  1581 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:14:03.410564 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:03.357177  1542 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.454s	user 0.012s	sys 0.000s
I20260709 13:14:03.316433  1512 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:03.408067 29509 leader_election.cc:403] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:14:03.422191 29463 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:03.424433 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.426980 29464 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:03.356350  1485 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:14:03.302397   968 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.404254  1374 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:14:03.431922 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 387242us
I20260709 13:14:03.435316 29438 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:03.411219  1548 raft_consensus.cc:740] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:03.436160 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.428526  1431 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.419976  1472 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:03.429260  1512 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:03.457057 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 354055us
I20260709 13:14:03.409403  1192 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.431139  1533 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:03.360886  1560 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:03.432971  1528 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.480201 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:03.529413 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49336us
I20260709 13:14:03.460407  1512 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:03.451970  1472 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:03.458529   874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.576s	user 0.009s	sys 0.022s
I20260709 13:14:03.434504  1522 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:14:03.452859  1514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.041s	sys 0.089s
I20260709 13:14:03.358254  1202 consensus_queue.cc:1048] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.161s
I20260709 13:14:03.566083 29363 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:03.572444 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:03.573828 29395 raft_consensus.cc:2368] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12.
I20260709 13:14:03.518139  1409 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:03.521071  1533 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:03.532076   874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.675s	user 0.009s	sys 0.022s
I20260709 13:14:03.577618 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.438927  1374 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:03.563910  1514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.042s	sys 0.089s
I20260709 13:14:03.525943  1435 consensus_queue.cc:1059] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:14:03.532886  1472 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:03.594422 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:03.578703  1223 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:14:03.598564 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 164255us
I20260709 13:14:03.564644  1504 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:03.595502 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.602340 29391 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:14:03.596297 29395 raft_consensus.cc:2393] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:03.579371  1479 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:03.605752 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 179422us
I20260709 13:14:03.593348  1533 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.618148 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.619911 29509 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:03.625721 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:03.628223 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.630074 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:03.639379 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 181713us
I20260709 13:14:03.646291 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:03.646611 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.615835  1530 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.648116 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.638135 29435 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:03.622635  1479 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:03.626420  1567 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.660866 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:03.661578 29397 raft_consensus.cc:2376] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12. Re-sending same reply.
I20260709 13:14:03.663478 29435 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:03.624377  1409 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:14:03.670138 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.698174 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.699115 29394 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:03.701972 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:03.702719 30159 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.704623 30152 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:14:03.741392 30123 leader_election.cc:336] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.505s (SENT)
I20260709 13:14:03.741215 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:03.756408 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 136562us
I20260709 13:14:03.757803 29509 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:03.762611 30152 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:03.739480  1514 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:03.765864  1514 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.766265  1514 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:03.779848 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.780191 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.781424 29397 raft_consensus.cc:2410] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 13:14:03.785877 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 122523us
W20260709 13:14:03.788971 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 132137us
I20260709 13:14:03.790706 29438 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:03.797259 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:03.824802 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:03.797004  1555 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.000s
W20260709 13:14:03.797235  1486 consensus_meta.cc:287] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.200s	user 0.018s	sys 0.000s
I20260709 13:14:03.787782  1195 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:14:03.789824  1594 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:03.790022  1593 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:14:03.784651  1530 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:14:03.778879  1479 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.841351 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.842484  1594 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.847959  1594 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:03.850324  1589 log.cc:927] Time spent T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 13:14:03.853062  1509 raft_consensus.cc:3055] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:03.853535  1509 raft_consensus.cc:740] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:03.825623  1560 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:03.854576  1509 consensus_queue.cc:260] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.855774  1509 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.858635  1594 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:03.860180 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39036 (request call id 640) took 2860 ms. Trace:
I20260709 13:14:03.861171  1594 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:03.862008  1596 log.cc:927] Time spent T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:14:03.835413  1481 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:03.838227  1486 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:03.874825 30123 leader_election.cc:336] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Timed out: RequestConsensusVote RPC to 127.27.150.129:42027 timed out after 1.640s (SENT)
W20260709 13:14:03.875248 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53318us
I20260709 13:14:03.883163  1567 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.884047  1567 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.885695  1486 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.886484  1486 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.886999  1486 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.889230  1486 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.860637 29465 rpcz_store.cc:276] 0709 13:14:00.999731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.001799 (+  2068us) service_pool.cc:224] Handling call
0709 13:14:02.265258 (+1263459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.157791 (+892533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.651347 (+493556us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001e6254. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:03.859871 (+208524us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001e6250. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:03.860078 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4860968960}
I20260709 13:14:03.885397  1431 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:03.892233 29538 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:03.893702 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:03.894320 29393 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.883369  1253 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:03.899922 30156 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:03.904621 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 146967us
I20260709 13:14:03.907070 29546 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:03.908829 29545 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:03.911967 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:03.827144  1374 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:03.915431 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:03.918955 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:03.924034 30159 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:03.930334 29393 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:03.932600 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:03.936482 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.937315 29538 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:03.938483 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.939203 29542 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:03.845973  1555 raft_consensus.cc:2764] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:14:03.938512 29360 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:03.801698  1192 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:03.945164 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.945495 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.950062 29545 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
W20260709 13:14:03.945619 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 465450us
I20260709 13:14:03.946694 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.948909 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.951227 29537 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
W20260709 13:14:03.928464  1357 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.005s
I20260709 13:14:03.960167 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.927464  1431 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:03.936995  1223 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:14:03.964395 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:03.965911 29542 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.963948 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:03.968405 29545 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:03.943854  1567 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:03.937562  1253 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:03.936666  1560 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:03.985229 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:03.977563 29363 connection.cc:256] RPC call timeout handler was delayed by -1.1661422969998512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
I20260709 13:14:03.974649 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:03.959862  1195 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:03.992966 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.997922 29394 raft_consensus.cc:1240] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:14:04.003090 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:04.003886 29463 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:14:03.972168  1431 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.005551  1431 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:04.007189 29543 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:04.008355 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.009522 29538 raft_consensus.cc:2393] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:04.011152  1253 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:03.998636 29542 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:04.045288 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:03.944291  1533 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:04.092054 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 115188us
I20260709 13:14:03.990628  1530 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:03.964444  1357 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:04.100564 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 119855us
W20260709 13:14:04.091828  1601 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.073s	user 0.003s	sys 0.001s
I20260709 13:14:04.102236 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:04.103440 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 116390us
W20260709 13:14:04.106081 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 131521us
I20260709 13:14:04.043159  1195 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:14:04.097561  1595 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.288s	user 0.000s	sys 0.005s
I20260709 13:14:04.085646  1481 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:14:04.100155  1607 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.096s	user 0.004s	sys 0.000s
I20260709 13:14:04.119801 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.128258  1481 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.120958 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:04.121284 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.123361 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.139551 29542 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:04.143113 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.143883 29542 raft_consensus.cc:2368] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10.
I20260709 13:14:04.181367 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:04.182621  1552 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:04.187084 29539 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:04.105566  1530 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.123981  1599 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.198722 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.217037 29542 raft_consensus.cc:2410] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:14:04.217212 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:04.196329 29537 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:14:04.200510 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 72848us
I20260709 13:14:04.142105  1528 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:04.142979   874 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:04.125872  1479 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:14:04.221947 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:04.225178  1374 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:04.206698  1194 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.986s	user 0.009s	sys 0.005s
W20260709 13:14:04.218086  1391 consensus_meta.cc:287] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.963s	user 0.013s	sys 0.002s
W20260709 13:14:04.243973 29422 heartbeater.cc:646] Failed to heartbeat to 127.27.150.190:35447 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.27.150.190:35447 timed out after 15.000s (SENT)
I20260709 13:14:04.244608 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.253599 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:04.246061  1530 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.248871 29435 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:04.249836 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.269052 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.269580 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.221007  1528 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:04.196321  1514 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:04.249451  1612 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:14:04.140928  1560 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.226635  1404 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.227061   874 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.290028  1584 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:04.283143  1605 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:04.239549  1593 consensus_queue.cc:1059] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:14:04.291956  1528 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:04.268355  1195 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.336000  1357 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:04.350652 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 74016.6us
I20260709 13:14:04.361102 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:04.361461  1608 log.cc:927] Time spent T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:14:04.366364 30159 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:04.368659 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.371289 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2384) took 1254 ms. Trace:
I20260709 13:14:04.300860 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.376879 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.413735   874 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:04.305423  1623 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:04.443928 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:04.317266  1611 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:14:04.316871 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.293592  1514 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:04.324368 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.399040 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:04.313205 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.447083 29542 raft_consensus.cc:2376] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10. Re-sending same reply.
I20260709 13:14:04.278138  1391 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:04.276660 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 53570.9us
I20260709 13:14:04.454814 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.454923 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:04.456060 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:04.412473 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 316120us
I20260709 13:14:04.456813 29544 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 9: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:04.433988 30152 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
W20260709 13:14:04.381450  1587 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.427s	user 0.003s	sys 0.000s
I20260709 13:14:04.438710 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:04.437883 29464 rpcz_store.cc:276] 0709 13:14:03.116765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.118893 (+  2128us) service_pool.cc:224] Handling call
0709 13:14:03.426792 (+307899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.428481 (+  1689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.370871 (+942390us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54003b5950. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:04.371074 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707210112}
I20260709 13:14:04.311766 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.268445  1194 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.436627  1584 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:04.458768 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:04.457580 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.468811 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.470978 29540 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:04.473012 29465 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:04.462824  1485 consensus_meta.cc:287] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.028s	user 0.015s	sys 0.000s
I20260709 13:14:04.484529 29468 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:04.485440 29509 leader_election.cc:400] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12.
I20260709 13:14:04.485813 29363 leader_election.cc:400] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10.
I20260709 13:14:04.486918 29363 leader_election.cc:403] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:14:04.485834 29509 leader_election.cc:403] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:04.487516 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.488343 29544 raft_consensus.cc:2376] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9. Re-sending same reply.
I20260709 13:14:04.489574 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.492053 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.484917 29543 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:04.493633 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.494954 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.503840 29544 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:04.505295 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:04.507253 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:04.469167  1593 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.468387  1592 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.514333 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.516882  1552 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10.
I20260709 13:14:04.508445  1609 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.523407   776 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:04.524050  1609 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.526391  1609 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:04.523453  1515 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.532689  1610 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12.
I20260709 13:14:04.538659 29465 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:04.540292  1194 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.497694  1374 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:14:04.512120  1431 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.506s	user 0.004s	sys 0.009s
W20260709 13:14:04.545581 30126 connection.cc:256] RPC call timeout handler was delayed by -1.0248981250001634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:14:04.546339  1619 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:14:04.497993  1479 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:14:04.544559  1431 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.496721  1485 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 5. Current term is 6.
W20260709 13:14:04.559839 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74556.9us
I20260709 13:14:04.563584 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.565196 29509 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.568732 29509 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.531517  1391 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:04.561458  1629 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.093s	user 0.000s	sys 0.004s
W20260709 13:14:04.568512  1512 consensus_meta.cc:287] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.991s	user 0.016s	sys 0.000s
I20260709 13:14:04.575191 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:04.568768  1509 consensus_meta.cc:287] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.010s
I20260709 13:14:04.521559  1593 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.552629  1592 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.580497 29509 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.583496 29470 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
W20260709 13:14:04.572892 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 115846us
I20260709 13:14:04.566506  1609 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.576694  1610 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:04.589143  1431 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.586326  1555 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.562534  1584 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.594843 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.576498  1624 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:04.596469  1609 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:04.596547  1624 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:04.596202 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.578384  1202 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.602744  1548 consensus_queue.cc:260] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.603950  1548 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:04.597206  1624 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:04.616882  1202 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:14:04.619864 29290 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 297) took 38489 ms (client timeout 15000 ms). Trace:
I20260709 13:14:04.624979  1592 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:04.621909 30157 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:04.628800  1533 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.631084  1605 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:04.630950   874 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.631954  1605 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:04.633061  1605 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.614131 29538 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
W20260709 13:14:04.621815 29290 rpcz_store.cc:269] 0709 13:13:26.134971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.143704 (+  8733us) service_pool.cc:224] Handling call
0709 13:14:04.619593 (+38475889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:57.383018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:57.596196 (+213178us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:57.600250 (+  4054us) write_op.cc:435] Acquired schema lock
0709 13:13:57.605714 (+  5464us) tablet.cc:662] Decoding operations
0709 13:13:57.829583 (+223869us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:57.847115 (+ 17532us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:57.848935 (+  1820us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:13:58.163416 (+314481us) tablet.cc:701] Row locks acquired
0709 13:13:58.163463 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:13:58.163644 (+   181us) write_op.cc:270] Start()
0709 13:13:58.163804 (+   160us) write_op.cc:276] Timestamp: P: 1783602838163591 usec, L: 0
0709 13:13:58.163829 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:13:58.164676 (+   847us) log.cc:844] Serialized 5232 byte log entry
0709 13:13:59.102898 (+938222us) op_driver.cc:464] REPLICATION: finished
0709 13:13:59.492983 (+390085us) write_op.cc:301] APPLY: starting
0709 13:13:59.493145 (+   162us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:59.826024 (+332879us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:59.826186 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:00.162549 (+336363us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:00.163100 (+   551us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:14:00.163172 (+    72us) write_op.cc:312] APPLY: finished
0709 13:14:00.163943 (+   771us) log.cc:844] Serialized 121 byte log entry
0709 13:14:00.164291 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:00.164650 (+   359us) write_op.cc:454] Released schema lock
0709 13:14:00.164741 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:00.327388 (+162647us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:00.352464 (+ 25076us) write_op.cc:454] Released schema lock
0709 13:14:01.481183 (+1128719us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b180034ec40. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b4522 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
Metrics: {"mutex_wait_us":1282546,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":389623,"apply.run_cpu_time_us":29647,"apply.run_wall_time_us":780771,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58337,"num_ops":13,"prepare.queue_time_us":578745,"prepare.run_cpu_time_us":39578,"prepare.run_wall_time_us":1345860,"raft.queue_time_us":219594,"raft.run_cpu_time_us":36912,"raft.run_wall_time_us":279410,"replication_time_us":931180,"spinlock_wait_cycles":4982528,"thread_start_us":1407114,"threads_started":4,"wal-append.queue_time_us":1871411,"wal-append.run_cpu_time_us":22505,"wal-append.run_wall_time_us":2297942}]]}
W20260709 13:14:04.646103 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 127193us
W20260709 13:14:04.631974  1472 consensus_meta.cc:287] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 1.025s	user 0.011s	sys 0.003s
I20260709 13:14:04.634320  1605 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:04.579370  1512 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.633839   874 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:04.653368 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.658311 29438 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.662917 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.664512 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:04.665414 30159 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:04.665841 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.666221 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:04.666611 29541 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:14:04.667018 29463 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:04.667603  1626 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:04.668085  1626 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.668463  1626 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:04.669787 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.670468 29539 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:14:04.671020 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:04.670548  1195 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.674043  1202 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.650868  1532 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:14:04.674731  1202 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.681993 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.683671 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:04.687206 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.691519 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.696730 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.705713 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:04.706586 29544 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:04.706719 29540 raft_consensus.cc:2376] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10. Re-sending same reply.
I20260709 13:14:04.658612  1533 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:14:04.712858 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:04.708717 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 150242us
I20260709 13:14:04.712237 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.659250  1472 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.740080 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:04.745548 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 82202.3us
I20260709 13:14:04.685002  1479 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:04.746420 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.704955  1195 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.707798  1585 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:04.749699 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.733745   874 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:04.733455  1485 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:14:04.751885 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.755546 30159 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 14.
I20260709 13:14:04.739936  1610 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.710922  1609 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:14:04.773381 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:04.776091 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.774717  1557 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:04.783715 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:04.788098 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.790271  1531 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:04.791327  1602 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.800976  1583 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.772637   874 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:04.785945  1610 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.807693 30153 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:14:04.808117 30153 pending_rounds.cc:85] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 10
I20260709 13:14:04.808373 30153 pending_rounds.cc:107] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:14:04.808614 30153 raft_consensus.cc:2889] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:04.809900  1202 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.807575   874 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.811451  1609 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:04.811908  1609 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:04.812786  1609 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.813807  1253 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:04.814375  1253 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:04.814605  1431 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:04.815207  1431 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.819937 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:04.814178  1609 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:04.821647 29541 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:04.752408  1506 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:04.685112  1532 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:04.826606 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.826920 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:14:04.842566 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54559.6us
I20260709 13:14:04.843025 29540 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.843767 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.829542 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.830605  1223 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:04.831818  1472 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.832856  1512 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.832794 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:04.860463 29543 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:04.834753  1597 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 1.044s	user 0.005s	sys 0.000s
I20260709 13:14:04.869501 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.773883  1194 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:04.839949  1626 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.853693  1583 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:04.878330   776 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:04.866389  1528 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.869514 29539 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:04.755584  1641 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.876336 29464 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:14:04.881175 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.873293  1194 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:04.877163  1195 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:04.877347  1626 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:04.885759 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 145764us
I20260709 13:14:04.889468 30126 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:04.815456  1253 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.888510 29512 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:04.907142 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:04.869551  1555 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:04.910498 30126 leader_election.cc:400] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11.
I20260709 13:14:04.915324 30126 leader_election.cc:403] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:04.918313 29540 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:04.918680 29468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59308 (request call id 2382) took 1892 ms. Trace:
I20260709 13:14:04.919066 29468 rpcz_store.cc:276] 0709 13:14:03.026314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.040002 (+ 13688us) service_pool.cc:224] Handling call
0709 13:14:03.219373 (+179371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.498671 (+1279298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.918420 (+419749us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400415354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:04.918617 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909056768}
I20260709 13:14:04.919699  1624 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:04.922427 29543 raft_consensus.cc:2468] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:04.922909 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:04.923768 30153 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:04.926524 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45425.4us
I20260709 13:14:04.927788 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:04.928201  1648 log.cc:927] Time spent T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:04.926668  1604 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:04.887535  1194 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.888610  1472 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:04.922183  1624 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:04.911890  1548 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:04.872989  1532 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.878007  1531 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:14:04.926429  1652 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:04.915812  1594 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:04.984683 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:04.935096  1583 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:04.989019 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:05.005659 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.992643 29539 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:04.991966 29438 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:14:04.999687 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 111260us
I20260709 13:14:04.939787  1195 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:05.010080  1223 tablet_bootstrap.cc:492] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:04.933621  1555 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:04.993033  1431 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:04.949980  1472 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:05.005645  1624 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:05.010586  1557 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 10. Current term is 11.
I20260709 13:14:04.939231  1604 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.058897  1639 raft_consensus.cc:2804] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:05.066569  1649 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:14:05.067730  1653 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:14:05.077852 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:05.079468 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:05.102711 30154 raft_consensus.cc:2368] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:05.054185 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:05.084290 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.103803 29537 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:05.104079 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.100621 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:05.103904 29393 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.108016 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.109942 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.113314 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.118088 29394 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
W20260709 13:14:05.098968 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 171285us
I20260709 13:14:05.119788 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:05.120622   874 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:05.121917 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.123438 29393 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:05.127671 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:14:05.130159 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 219831us
I20260709 13:14:05.131153 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.015736  1594 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.130808 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:05.152501 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:05.149199 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:05.160588 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.161826 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.161923   776 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:05.164781 30126 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.170281 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.155625  1223 ts_tablet_manager.cc:1403] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 4.299s	user 0.094s	sys 0.053s
I20260709 13:14:05.146878 29537 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:05.184669 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.187692 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.186724 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.188335 29438 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:05.130812  1409 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:05.190290 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.191666 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:05.135857  1639 raft_consensus.cc:697] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:05.164502  1560 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.216058  1593 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.195523 29396 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:05.196717 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.196762 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.166980  1652 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:05.221781 29537 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:05.163623  1592 consensus_queue.cc:1059] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:14:05.200784 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:05.201749  1669 log.cc:927] Time spent T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:14:05.201467  1661 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:14:05.202668  1391 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:05.207460 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.210645  1528 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.148914  1557 consensus_queue.cc:1059] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:14:05.211709  1655 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:14:05.212189  1654 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:14:05.213281  1666 raft_consensus.cc:2764] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:14:05.213414  1605 consensus_meta.cc:287] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.003s
I20260709 13:14:05.214367 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:05.216621  1560 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.217000  1409 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.218015  1639 consensus_queue.cc:237] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:05.164222   874 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:05.200665  1532 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:05.223907 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59226us
I20260709 13:14:05.335085 30126 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.225934 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.224020 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.231582 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59298 (request call id 2073) took 1299 ms. Trace:
W20260709 13:14:05.245241 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 316612us
I20260709 13:14:05.338449 29465 rpcz_store.cc:276] 0709 13:14:03.932045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.932213 (+   168us) service_pool.cc:224] Handling call
0709 13:14:05.231369 (+1299156us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54002a49d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:05.231511 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240699648}
W20260709 13:14:05.255391 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.254902 29438 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:05.259383 29539 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:05.171108  1531 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
W20260709 13:14:05.271149 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 256948us
I20260709 13:14:05.288861 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:05.289520 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:05.290684 30153 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
W20260709 13:14:05.275318  1656 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.218s	user 0.000s	sys 0.003s
I20260709 13:14:05.293102  1472 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:05.309365 29470 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:05.310931 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:05.314237 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:05.314291 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:05.355423 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:05.355571 29543 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:05.355880 29537 raft_consensus.cc:2376] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6. Re-sending same reply.
I20260709 13:14:05.356967 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:05.317217 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:05.317355 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 116662us
I20260709 13:14:05.279459  1555 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.319973 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:05.279946  1594 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.303361  1604 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.333127 30156 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 14: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:05.328006 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:05.350073 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 95311.1us
I20260709 13:14:05.351469 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:05.352275 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.336676 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:05.368132 30126 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:05.362088 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44992.2us
I20260709 13:14:05.371174 29509 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.324801  1482 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:05.373136 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.375295 29468 raft_consensus.cc:2393] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 14: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:14:05.381238 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 53347us
I20260709 13:14:05.377888 30126 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.376168 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.382298 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:05.383391   776 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:05.376015 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.387970 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:05.354557  1652 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:05.333019  1391 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:05.390391 30126 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:05.391032 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 159316us
I20260709 13:14:05.378648 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:05.398595 29463 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:05.401480 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.404441 29539 raft_consensus.cc:1240] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:14:05.365774  1532 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:05.406618 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:05.375666  1357 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.376828  1472 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.385828  1666 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:05.419559 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.389658   874 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.389961  1557 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:05.419895 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:05.385416  1604 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.428845 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:05.401034  1552 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:05.435423 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:05.407550  1609 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:05.408274  1592 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:05.451001 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.403525  1652 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:14:05.484719 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 64913.8us
I20260709 13:14:05.485155 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.486756 29435 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:05.487825  1652 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:05.488083 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:05.517493  1636 raft_consensus.cc:2804] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:05.520256 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:05.521364  1506 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:05.521802 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:05.522145  1506 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:05.445883  1624 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:05.429909  1532 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:05.524276  1532 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.525215 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:05.525995 29464 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:05.527957  1194 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.578s	user 0.001s	sys 0.010s
I20260709 13:14:05.488905  1515 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:05.529004  1194 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:05.489264  1435 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:05.530084  1435 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.530571  1435 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:05.531399  1194 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:05.403327  1195 consensus_queue.cc:1059] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:14:05.492404 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.535030  1195 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:05.535424  1195 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:05.535696 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:05.536329  1195 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:05.412623  1522 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:14:05.537683  1195 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:05.488698  1661 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.538609  1661 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:05.539685  1636 raft_consensus.cc:697] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:05.540839  1636 consensus_queue.cc:237] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.541416  1661 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:05.397501  1650 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:14:05.500514  1409 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.501897  1560 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.424094  1676 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:05.513363 29468 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:05.429991  1666 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:05.445915  1557 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:05.598812 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.495024  1555 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:05.547505 29469 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:05.601477 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.495525  1391 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:05.605095 29388 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:05.576323 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.581360 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.584844 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.585110 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.586565 29466 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:05.591392 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.595201 29541 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:05.455863  1552 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:05.613384  1552 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.613909  1664 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.451833  1548 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:05.553694 29512 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.480830  1253 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:05.619913 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:05.653293 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.592657  1530 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:05.661994 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 43962.9us
I20260709 13:14:05.606882  1557 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:05.667661 30152 raft_consensus.cc:3060] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.646852 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:05.599773  1666 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:05.663590 29463 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
W20260709 13:14:05.664325 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 110780us
I20260709 13:14:05.612298 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:05.435559  1357 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:05.607869  1472 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:05.676239 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 78332.8us
I20260709 13:14:05.677196 29464 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:05.680112 29512 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:05.481087  1604 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:05.688856 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:05.677755  1659 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:05.727278 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 47240.7us
I20260709 13:14:05.605911  1585 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:14:05.728669 29512 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.739081 29435 leader_election.cc:400] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:05.732590 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.740541 29435 leader_election.cc:403] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:14:05.740543 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48775.2us
I20260709 13:14:05.778301 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:05.788486 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:05.791021 30152 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
W20260709 13:14:05.793169 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 75723.6us
W20260709 13:14:05.679090  1674 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:14:05.794467 29363 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:05.738273  1609 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:05.796648 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 57732.7us
I20260709 13:14:05.810614 30158 raft_consensus.cc:1240] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:05.801690 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 69205.6us
I20260709 13:14:05.735631  1600 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:05.804908  1684 log.cc:927] Time spent T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:05.805234  1428 consensus_queue.cc:1059] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:05.829484 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:05.678977  1253 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:05.803954  1530 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:14:05.729274  1662 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:05.834002 29464 raft_consensus.cc:1240] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:05.681694  1668 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:05.722697  1472 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.839037 29466 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:05.814685  1659 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:05.815546  1605 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:05.815922  1664 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.835413  1504 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:05.827924  1515 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:05.838929  1585 consensus_queue.cc:1059] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:14:05.867376  1515 raft_consensus.cc:697] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
W20260709 13:14:05.902711 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 74339.3us
I20260709 13:14:05.913522  1533 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:05.917982 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.918674 29393 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:05.876430  1253 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.925369 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:05.932464 29539 raft_consensus.cc:2410] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:05.936174 29512 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.936342 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.936991 29468 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:05.921655 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:05.943135  1695 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:05.944025  1600 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:05.944437  1600 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.944788  1600 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.945547  1652 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:05.949906  1552 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:05.903609  1374 raft_consensus.cc:3055] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:05.960620 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:05.926215  1610 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.968657 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:05.971534 30160 raft_consensus.cc:1240] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:05.952564  1682 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
W20260709 13:14:05.978950  1689 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:14:05.979218  1660 raft_consensus.cc:3055] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:05.979803  1660 raft_consensus.cc:740] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:14:05.981315  1688 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:14:05.983964  1652 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:05.969704 29388 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:05.931298  1357 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:05.926705  1604 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:05.992856 29512 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:05.961774  1374 raft_consensus.cc:740] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:05.995908 29463 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:14:05.996374 29463 pending_rounds.cc:85] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 10
I20260709 13:14:05.996636 29463 pending_rounds.cc:107] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:14:05.996874 29463 raft_consensus.cc:2889] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:05.951916  1659 consensus_queue.cc:1059] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:14:05.954052  1664 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:14:06.003677  1374 consensus_queue.cc:260] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.005055  1374 raft_consensus.cc:3060] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:06.006904  1514 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.007467  1514 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.007503  1435 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.009867  1514 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:05.998317  1485 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:06.016438   874 consensus_meta.cc:287] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.003s
I20260709 13:14:06.016858   874 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:06.017583 29390 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:06.023273  1673 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:06.023694  1673 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:06.024600  1673 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.003005 29435 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:06.029142  1491 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:06.029562  1491 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.029944  1491 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.999253  1515 consensus_queue.cc:237] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.033041 29541 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:06.035785  1472 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:06.036533 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:06.038223 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:06.039106 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:06.039762 29393 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:06.040762 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:06.026074  1673 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:06.045876 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:06.041379 29392 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:06.048779 29388 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:06.011008  1485 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:06.042724 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:06.009938  1435 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:06.057855 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:06.055564  1690 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:14:06.059891  1606 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:06.103461 29463 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:06.107944 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:06.086221  1665 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:06.113844 29512 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:06.109479 29546 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:06.100092  1548 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:06.090744  1202 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:06.062525  1584 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:14:06.106004  1552 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.101358  1606 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:06.153303 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 762949us
I20260709 13:14:06.159119 29463 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:06.135258  1662 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:06.160607 30126 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:06.103929 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 658876us
I20260709 13:14:06.171099  1600 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:06.174810  1705 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:06.179085 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:06.183105  1666 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.183938  1223 raft_consensus.cc:359] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:06.184968  1223 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:06.188264 29363 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:06.189209  1195 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:06.189781  1195 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:06.185986  1666 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.160254  1606 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:06.161809  1667 raft_consensus.cc:3055] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:06.203011  1073 consensus_queue.cc:1059] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:14:06.210633 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:06.211339 29393 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:06.214705 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 44955.3us
I20260709 13:14:06.215539 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:06.185768  1223 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:06.199301  1662 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.226583  1662 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.228365  1195 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:06.234040 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.236408 30153 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:06.236666 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:06.237625 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:06.238479 30158 raft_consensus.cc:2393] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:06.241683  1668 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:06.242674  1703 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:06.243968  1703 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:06.244347  1703 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:06.245270  1703 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.206722  1667 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:06.254832  1667 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.259271  1223 ts_tablet_manager.cc:1434] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 1.069s	user 0.012s	sys 0.000s
W20260709 13:14:06.337766  1223 ts_tablet_manager.cc:1467] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Tablet startup took 1150ms
I20260709 13:14:06.259775  1703 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:06.260954  1557 consensus_meta.cc:287] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.002s
I20260709 13:14:06.261026  1662 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:06.262156  1617 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:06.262960 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 47516.9us
I20260709 13:14:06.264106  1606 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.268004  1491 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:06.273576  1672 log.cc:927] Time spent T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.667s	user 0.003s	sys 0.000s
I20260709 13:14:06.293041  1600 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:06.296051 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.296379 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:06.297713 29463 raft_consensus.cc:1240] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:06.298800 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:06.369372 29469 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:06.300256  1506 raft_consensus.cc:3055] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:06.311484 29392 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:06.311869  1660 consensus_queue.cc:260] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:06.322502  1691 log.cc:927] Time spent T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:14:06.324563  1531 consensus_queue.cc:1059] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:06.326658 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 84868.5us
I20260709 13:14:06.331732 29393 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:06.335424 30158 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:06.336648  1673 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:06.349244  1557 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.357393 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:06.389679 30155 raft_consensus.cc:1240] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:06.377609 29465 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:06.374653 29435 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:06.379181 29466 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:06.373340  1506 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:06.365254  1667 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.385650  1531 raft_consensus.cc:3055] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:06.416756  1661 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:14:06.397383  1617 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:06.385010  1491 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.412580  1660 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:06.473822 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 99293.5us
W20260709 13:14:06.474879 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 117611us
I20260709 13:14:06.476001 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:06.447045  1531 raft_consensus.cc:740] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:06.393296  1673 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.480721 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:06.481796 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:14:06.492444  1709 log.cc:927] Time spent T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:14:06.492825 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2976) took 1637 ms. Trace:
I20260709 13:14:06.491793  1531 consensus_queue.cc:260] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.493996 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 1000) took 1105 ms. Trace:
I20260709 13:14:06.493278 29544 rpcz_store.cc:276] 0709 13:14:04.855192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.916465 (+ 61273us) service_pool.cc:224] Handling call
0709 13:14:04.916848 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.986461 (+ 69613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.986499 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.042737 (+ 56238us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.328734 (+285997us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:05.380385 (+ 51651us) log.cc:844] Serialized 14 byte log entry
0709 13:14:05.386356 (+  5971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.386548 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.546010 (+159462us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b180048f700. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61ec87558f 00007f61e58b4571 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd
0709 13:14:06.272654 (+726644us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:06.492527 (+219873us) raft_consensus.cc:1685] finished
0709 13:14:06.492561 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.492740 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70901,"prepare.queue_time_us":51438,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4247,"raft.queue_time_us":125335,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":62261,"spinlock_wait_cycles":22505088,"thread_start_us":295731,"threads_started":2,"wal-append.queue_time_us":342586}
I20260709 13:14:06.501914 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:06.503777   874 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.480933  1560 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:06.495265 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:06.480324  1617 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:06.495813 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:06.508982 30151 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:06.480669  1676 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.480202  1472 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.518249 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:06.512331 29361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.519272 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:06.519942 29538 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:06.521413 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:06.504496   874 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.515772  1659 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:06.498593 30157 rpcz_store.cc:276] 0709 13:14:05.388788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.388997 (+   209us) service_pool.cc:224] Handling call
0709 13:14:05.389408 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.100410 (+711002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.100454 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.101000 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.165568 (+ 64568us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:06.165674 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.165812 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.175120 (+  9308us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b48001c0a58. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ed8caaa1 00007f61ed8c1b37 00007f61ed8c19ca 00007f61ed9b926f 00007f61ed9b8f37 00007f61ed9cd55c 00007f61ed9cd508 00007f61ed9cd488 00007f61ed9cd443 00007f61ed9cc6ec 00007f61ec8f6a96
0709 13:14:06.493527 (+318407us) raft_consensus.cc:1685] finished
0709 13:14:06.493552 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.493926 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":635391,"raft.queue_time_us":683773,"raft.run_cpu_time_us":1052,"raft.run_wall_time_us":88918,"spinlock_wait_cycles":8121472,"thread_start_us":111692,"threads_started":2,"wal-append.queue_time_us":263777}
I20260709 13:14:06.487566  1557 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.542289 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 2978) took 1668 ms. Trace:
I20260709 13:14:06.550529 29396 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:14:06.580579 29396 pending_rounds.cc:85] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 6
I20260709 13:14:06.580847 29396 pending_rounds.cc:107] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:14:06.581071 29396 raft_consensus.cc:2889] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:06.338215  1223 ts_tablet_manager.cc:1469] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Trace:
0709 13:13:52.179740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.196745 (+ 17005us) service_pool.cc:224] Handling call
0709 13:13:52.617997 (+421252us) ts_tablet_manager.cc:934] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
0709 13:13:58.077871 (+5459874us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:13:58.324612 (+246741us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:58.324741 (+   129us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:13:58.558124 (+233383us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:13:58.583130 (+ 25006us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:58.583672 (+   542us) ts_tablet_manager.cc:989] Replica registered.
0709 13:13:58.583794 (+   122us) inbound_call.cc:177] Queueing success response
0709 13:14:00.856293 (+2272499us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:14:05.192964 (+4336671us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:14:05.483813 (+290849us) tablet_replica.cc:261] Starting instrumentation
0709 13:14:05.484654 (+   841us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":56114,"mutex_wait_us":586660,"raft.queue_time_us":9293,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":158,"tablet-copy.queue_time_us":259208,"tablet-download-pool.queue_time_us":672,"tablet-download-pool.run_cpu_time_us":2067,"tablet-download-pool.run_wall_time_us":1408217,"thread_start_us":822652,"threads_started":2}
I20260709 13:14:06.552865 29388 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:06.553689 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:06.557698  1531 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:06.553717 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:06.511377  1705 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:06.578837 29540 rpcz_store.cc:276] 0709 13:14:04.873440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.925343 (+ 51903us) service_pool.cc:224] Handling call
0709 13:14:04.926197 (+   854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.196849 (+270652us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:05.347294 (+150445us) log.cc:844] Serialized 14 byte log entry
0709 13:14:05.609139 (+261845us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.663589 (+ 54450us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.663766 (+   177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:05.664057 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:14:05.680099 (+ 16042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.680186 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.324145 (+643959us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b48001c1658. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ed8caaa1 00007f61ed8c1b37 00007f61ed8c19ca 00007f61ed9b926f 00007f61ed9b8f37 00007f61ed9cd55c 00007f61ed9cd508 00007f61ed9cd488 00007f61ed9cd443 00007f61ed9cc6ec 00007f61ec8f6a96
0709 13:14:06.439040 (+114895us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b180048f7c0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1
0709 13:14:06.539247 (+100207us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b180048f7c0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:14:06.541996 (+  2749us) raft_consensus.cc:1685] finished
0709 13:14:06.542021 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.542208 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157214,"prepare.queue_time_us":12141,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":142678,"raft.run_cpu_time_us":3421,"raft.run_wall_time_us":755498,"spinlock_wait_cycles":71115648,"thread_start_us":575556,"threads_started":3,"wal-append.queue_time_us":318198}
I20260709 13:14:06.558528  1610 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:06.494556  1707 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:06.557968  1673 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.604681 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:06.559681  1472 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.562108  1606 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:06.586700 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:06.623553 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48432 (request call id 2995) took 1006 ms. Trace:
I20260709 13:14:06.671540 29389 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:06.589372 30126 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:06.590205 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:06.594122   874 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.598336 29540 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:06.599951 29391 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:06.603590 29435 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:06.608995 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:06.524654  1560 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:06.634013 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:06.496148  1661 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:14:06.685459 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:06.632787 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:06.675324 29538 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:06.677613 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:06.671793 29545 rpcz_store.cc:276] 0709 13:14:05.616955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.619526 (+  2571us) service_pool.cc:224] Handling call
0709 13:14:06.610369 (+990843us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002bc354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:06.623424 (+ 13055us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147810048}
I20260709 13:14:06.701283 30151 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:06.707226  1706 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.731583  1706 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.684834  1704 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:06.735227  1704 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.684832  1664 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.755400  1664 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.684794  1530 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.759019  1530 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.761443  1530 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.677102  1585 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.763021  1585 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.765985  1585 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.676085  1202 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.774315  1202 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:06.780681 29511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.670688  1073 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.783157  1073 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.711108  1593 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:14:06.792502  1253 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.793195  1253 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:06.795102 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.593041  1659 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:06.714382 30151 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:14:06.727197 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 122990us
W20260709 13:14:06.726970 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 137702us
I20260709 13:14:06.600344  1705 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:06.734216  1706 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:06.738211  1704 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:06.717947  1716 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:14:06.569252  1676 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:06.717171  1624 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.864492 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:06.786269  1073 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:06.808367  1714 log.cc:927] Time spent T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:14:06.898283 29545 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:06.726967  1652 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:06.921664 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:06.849216  1705 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:06.862413  1701 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.641s	user 0.004s	sys 0.003s
I20260709 13:14:06.915566 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:06.915791 29540 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:06.727164  1606 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:06.725596  1707 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:06.865439  1679 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.924471 29291 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 7, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:06.929570 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:06.970988 30153 raft_consensus.cc:2368] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11.
I20260709 13:14:06.881899  1195 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:06.982704 29470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.084s	sys 0.171s
I20260709 13:14:06.934774  1560 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:06.904472  1600 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:06.945477 29397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2757) took 1025 ms. Trace:
I20260709 13:14:06.952422 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:06.845194 30126 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:07.009617 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 164586us
I20260709 13:14:06.962692 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:06.966892 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:06.971880 29543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.082s	sys 0.151s
I20260709 13:14:06.971612 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:07.010615 29543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.083s	sys 0.151s
I20260709 13:14:06.973091   874 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:06.983242 29470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.084s	sys 0.171s
I20260709 13:14:06.990187 29389 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:07.011200   874 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:07.002003 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72526.7us
I20260709 13:14:06.951573  1253 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.008754 29397 rpcz_store.cc:276] 0709 13:14:05.920104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.921564 (+  1460us) service_pool.cc:224] Handling call
0709 13:14:05.921865 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.279098 (+357233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.279132 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.279679 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.656438 (+376759us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:06.656508 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.789706 (+133198us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001720d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:06.789762 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.944988 (+155226us) raft_consensus.cc:1685] finished
0709 13:14:06.945024 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.945374 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":724,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"spinlock_wait_cycles":820476672,"thread_start_us":376112,"threads_started":1,"wal-append.queue_time_us":662757}
I20260709 13:14:07.024119 30153 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:07.046483   874 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:06.923066  1624 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:07.090516 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51948.6us
I20260709 13:14:07.015693  1666 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:07.096036  1624 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.096239  1593 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:07.095866  1707 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.099731  1676 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.021797   968 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:07.037751  1652 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:14:07.104166  1652 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:07.104573  1652 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:07.105496  1652 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:07.106959  1682 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:14:07.035320  1391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.425s	user 0.029s	sys 0.019s
I20260709 13:14:07.112815 29464 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:07.113642 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:07.113158 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.015309  1357 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:07.122248 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:07.125272 30153 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:07.096050 29291 catalog_manager.cc:5697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.111433 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-133108182cae493ab908290bfa9179d1 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:14:07.020740  1530 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:14:07.116075  1660 consensus_meta.cc:287] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.007s
I20260709 13:14:07.008041  1195 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:07.124341  1391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.031s	sys 0.019s
I20260709 13:14:07.093464  1472 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.007506  1679 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.025382  1600 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:07.035169  1606 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:14:07.138347 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-133108182cae493ab908290bfa9179d1 on tablet 133108182cae493ab908290bfa9179d1 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:07.159426  1357 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:07.157949 29544 raft_consensus.cc:2410] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:14:07.164036 30157 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:07.183185 29395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 2186) took 1996 ms. Trace:
I20260709 13:14:07.200948 30153 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
W20260709 13:14:07.186614 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.147382  1530 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.179422 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:07.175312 30159 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:07.240209 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 60923us
I20260709 13:14:07.176357 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:07.177043 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
W20260709 13:14:07.242539 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 66272.4us
W20260709 13:14:07.195724 29392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.026s	sys 0.037s
W20260709 13:14:07.245383 29392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.026s	sys 0.037s
I20260709 13:14:07.200855 29395 rpcz_store.cc:276] 0709 13:14:05.186937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.187079 (+   142us) service_pool.cc:224] Handling call
0709 13:14:05.187430 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:05.364973 (+177543us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:05.391454 (+ 26481us) log.cc:844] Serialized 14 byte log entry
0709 13:14:05.591775 (+200321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:05.591844 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:05.591900 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.677424 (+1085524us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b180046f360. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419
0709 13:14:07.182923 (+505499us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54003a16d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:07.182978 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.183108 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109326,"prepare.queue_time_us":34411,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":53,"raft.queue_time_us":109596,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14561,"spinlock_wait_cycles":416581248,"thread_start_us":90416,"threads_started":1,"wal-append.queue_time_us":153188,"wal-append.run_cpu_time_us":1308,"wal-append.run_wall_time_us":1001337}
I20260709 13:14:07.155794  1194 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:07.184314 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:07.275779 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 1004) took 1040 ms. Trace:
W20260709 13:14:07.183231  1718 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:14:07.034721  1659 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:07.223083 29546 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:14:07.193822  1667 consensus_meta.cc:287] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.745s	user 0.015s	sys 0.000s
I20260709 13:14:07.225224 29545 raft_consensus.cc:1275] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:07.225267 29541 raft_consensus.cc:1275] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:14:07.228816 29360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.003s	sys 0.014s
I20260709 13:14:07.172400  1652 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:07.231527 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:06.971741  1592 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.005s	sys 0.014s
W20260709 13:14:07.293125  1592 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.006s	sys 0.015s
I20260709 13:14:07.179754  1357 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:07.276472 30155 rpcz_store.cc:276] 0709 13:14:06.235283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.237096 (+  1813us) service_pool.cc:224] Handling call
0709 13:14:06.237419 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.390924 (+153505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.275377 (+884453us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54006428d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:07.275685 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349641472}
W20260709 13:14:07.292160 29360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.003s	sys 0.015s
I20260709 13:14:07.296556 29291 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 3 to 7, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:07.284721  1703 consensus_meta.cc:287] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.012s
I20260709 13:14:07.301131 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.278836  1660 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:07.286814  1665 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:07.326381  1195 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:07.320603  1600 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.329473 29291 catalog_manager.cc:5697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.297295  1194 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
W20260709 13:14:07.334933 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.338056 29291 catalog_manager.cc:5697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.344103 30151 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:07.339942  1667 consensus_queue.cc:1059] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:14:07.331667  1585 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:07.351675  1585 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.355162  1195 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:07.355723  1705 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.357019 30156 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:07.360334  1705 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.355856  1195 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.375779  1195 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.372123 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.327369  1660 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.392632  1660 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:07.370204  1665 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:07.394992  1665 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.396073  1506 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.397261  1506 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:07.377108 30123 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:07.378890 29539 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:07.399622  1530 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.392221 29466 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:07.371977 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.379472 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.380930 29291 catalog_manager.cc:5697] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.354282  1585 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.392063 29545 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:07.390589 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.397797  1194 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:07.578615 29543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.025s
W20260709 13:14:07.607483 29543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.017s	sys 0.026s
W20260709 13:14:07.576300 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:07.608094 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 177682us
W20260709 13:14:07.473704 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 96680.8us
W20260709 13:14:07.610275 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 465746us
I20260709 13:14:07.614923 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 2184) took 1410 ms. Trace:
I20260709 13:14:07.508275 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:07.459739 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 118538us
I20260709 13:14:07.617449 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.626732 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:07.627326 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.628667 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.619340 29543 rpcz_store.cc:276] 0709 13:14:06.198610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.318300 (+119690us) service_pool.cc:224] Handling call
0709 13:14:06.318715 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.318966 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:07.011109 (+692143us) log.cc:844] Serialized 14 byte log entry
0709 13:14:07.607936 (+596827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:07.608022 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:07.608086 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.608161 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.608331 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24536,"prepare.queue_time_us":213850,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":85748,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":1243789,"threads_started":2}
I20260709 13:14:07.412021  1664 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:07.609872  1491 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.006s	sys 0.024s
I20260709 13:14:07.630544 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:07.629325 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.631664 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.632058 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:07.646773  1357 consensus_queue.cc:1059] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:07.647750  1605 consensus_queue.cc:1059] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:07.648247  1357 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:07.648752  1357 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:07.649427  1509 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:07.412218  1667 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:07.522526  1706 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:07.653496 29463 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:07.411638  1660 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.655761 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:07.657215 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:07.659873 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:07.662863 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:07.615954  1374 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.661285 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:07.456085  1195 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:07.620321  1600 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:07.668216 29291 catalog_manager.cc:5697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 5 to 8, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.628053  1472 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:07.668742 30152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.020s	sys 0.027s
I20260709 13:14:07.673172 29463 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:07.678493 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:07.678648 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:07.678951 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:07.679522 30152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.020s	sys 0.028s
I20260709 13:14:07.649871  1509 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:07.702183 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:07.649878  1357 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:07.654467  1585 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:07.721596 29438 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:07.686923 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:07.668438  1583 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:07.680822  1195 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:07.725065  1583 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:07.725821  1202 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.727407  1195 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:07.727445  1583 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:07.728524 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 710) took 1017 ms. Trace:
I20260709 13:14:07.728816  1585 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.728971 30154 rpcz_store.cc:276] 0709 13:14:06.711499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.711895 (+   396us) service_pool.cc:224] Handling call
0709 13:14:06.712298 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.800392 (+ 88094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.800442 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.800512 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:06.800571 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.728243 (+927672us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b5400690354. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:07.728302 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.728452 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201837312}
I20260709 13:14:07.686887  1664 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:07.731077  1664 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:07.732542  1705 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.733145  1705 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.734169  1660 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.738698 30157 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:07.676127  1374 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.740155 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:07.742017  1585 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.743573 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:07.708586  1472 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:07.720134 29511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.029s	sys 0.079s
I20260709 13:14:07.745187  1679 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:07.745193 29511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.029s	sys 0.080s
I20260709 13:14:07.668222  1667 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:07.747781  1202 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:07.748255  1667 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:07.748343  1202 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.748970 29394 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:14:07.750547  1202 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.752766  1660 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.753275  1660 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.755005  1073 raft_consensus.cc:3055] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:07.755474  1073 raft_consensus.cc:740] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:07.756171  1660 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.756831  1374 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:07.707810  1531 consensus_meta.cc:287] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.101s	user 0.013s	sys 0.002s
I20260709 13:14:07.758219  1472 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.778192  1472 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:07.794015 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.794970 30156 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
W20260709 13:14:07.780470 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 58976.1us
I20260709 13:14:07.791693  1472 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.799355  1530 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:07.791752  1605 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:07.802865 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:07.803908  1472 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:07.805061  1336 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:07.805939  1521 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:07.806803  1391 consensus_queue.cc:1048] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:07.811619 29360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.818876  1509 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.820642  1509 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:07.877734 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51828 (request call id 697) took 1360 ms. Trace:
I20260709 13:14:07.868631 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.878512 29544 rpcz_store.cc:276] 0709 13:14:06.517819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.517971 (+   152us) service_pool.cc:224] Handling call
0709 13:14:07.837923 (+1319952us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54000f3cd4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:07.877632 (+ 39709us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322157952}
I20260709 13:14:07.878937 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.879209 30156 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:07.847028 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.880710 30153 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:07.829099 29291 catalog_manager.cc:5697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.879612 30151 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:07.685220  1600 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:07.826429  1728 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
I20260709 13:14:07.846057 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:07.886346 30155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.013s
W20260709 13:14:07.886380 29512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.130:39713 timed out after 1.591s (SENT) [suppressed 35 similar messages]
I20260709 13:14:07.894659 29545 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:07.896381 30155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.006s	sys 0.013s
W20260709 13:14:07.899497 29541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.009s
W20260709 13:14:07.903993 29541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.011s	sys 0.009s
I20260709 13:14:07.794744  1661 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:07.779466  1531 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:07.887101 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:07.891501 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:07.889694 29546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.011s	sys 0.007s
I20260709 13:14:07.832932  1357 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:07.937070 29546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.011s	sys 0.011s
W20260709 13:14:07.937776 30159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.055s
W20260709 13:14:07.940953 30159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.055s
W20260709 13:14:07.933809 29540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.006s	sys 0.014s
I20260709 13:14:07.833063  1530 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:07.939941 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 48571.4us
I20260709 13:14:07.947664 30151 raft_consensus.cc:2393] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 8: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:14:07.943276 29540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.007s	sys 0.014s
I20260709 13:14:07.756371  1073 consensus_queue.cc:260] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:07.837567  1472 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:14:07.942518  1592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.004s	sys 0.017s
I20260709 13:14:07.907352  1253 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:08.013799 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.016s	sys 0.045s
W20260709 13:14:08.014365 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.016s	sys 0.045s
W20260709 13:14:08.015110 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.948468 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:07.943995  1515 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:07.907173  1694 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:14:08.034714  1626 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.035490  1626 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:07.995003  1592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.004s	sys 0.018s
W20260709 13:14:08.047324 30158 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.019s	sys 0.033s
W20260709 13:14:08.049563 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 101207us
W20260709 13:14:08.049899 30158 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.019s	sys 0.033s
I20260709 13:14:07.988148  1704 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:08.053468 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:08.032393  1600 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:07.943435  1531 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.019748  1705 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:08.067654 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:07.947300  1661 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.092453   874 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.093194   874 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.018218  1253 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.086740  1585 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:08.107594   776 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:08.108181 30126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.028s	sys 0.036s
I20260709 13:14:08.107590 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:08.114823 30126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.028s	sys 0.036s
I20260709 13:14:07.959721  1530 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.117154   874 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:08.117950   874 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:08.117834 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:08.115245 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 819076us
I20260709 13:14:08.126940 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:08.063720  1515 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:08.155287  1374 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:08.157008  1253 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:08.170085  1664 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:08.166585 29466 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 9: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:08.175940 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:08.177894  1515 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:08.014765  1472 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.179539  1530 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:08.180800  1472 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:08.069953  1704 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.184257  1704 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:08.104357  1726 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.186376  1726 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.187909 30152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 706) took 1703 ms. Trace:
I20260709 13:14:08.188899  1726 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:08.191723  1073 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.195164 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:08.196053 30155 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:14:08.197146  1661 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:08.198088 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.200163  1515 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.168817  1531 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:08.204788 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.205099 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:08.205535 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.188437 30152 rpcz_store.cc:276] 0709 13:14:06.484974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.485148 (+   174us) service_pool.cc:224] Handling call
0709 13:14:06.485615 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.488704 (+  3089us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:06.880300 (+391596us) log.cc:844] Serialized 14 byte log entry
0709 13:14:07.680178 (+799878us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:07.680857 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 13:14:07.681055 (+   198us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:07.681101 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.681197 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:08.187562 (+506365us) raft_consensus.cc:1685] finished
0709 13:14:08.187598 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.187821 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":608379,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":7247,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":33397,"thread_start_us":1115678,"threads_started":2,"wal-append.queue_time_us":1197904}
I20260709 13:14:08.210074 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:08.096122  1560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.035s	sys 0.044s
I20260709 13:14:08.133891 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:08.218250 29360 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:08.238194  1726 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:08.240752 30123 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:08.219673   776 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:08.215718  1560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.035s	sys 0.045s
I20260709 13:14:08.206650  1705 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:08.257431 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 123685us
I20260709 13:14:08.258515  1652 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:08.238783  1661 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:14:08.252179   776 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.261129 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:08.254604  1506 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.855s	user 0.018s	sys 0.000s
W20260709 13:14:08.263972  1593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.034s	sys 0.038s
I20260709 13:14:08.239147  1726 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:08.235975  1504 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.280404 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:08.274686  1593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.035s	sys 0.039s
W20260709 13:14:08.295588  1491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.013s
I20260709 13:14:08.315359   776 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:08.324803 29389 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
W20260709 13:14:08.326229  1665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.009s
W20260709 13:14:08.326810  1665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.010s	sys 0.009s
W20260709 13:14:08.299101  1662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.017s
I20260709 13:14:08.281451  1726 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.236285  1515 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:08.330539 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.002s	sys 0.016s
W20260709 13:14:08.383878 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.002s	sys 0.016s
W20260709 13:14:08.384224 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 673065us
W20260709 13:14:08.331017 29436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.000s	sys 0.028s
I20260709 13:14:08.339236 29546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3025) took 1097 ms. Trace:
W20260709 13:14:08.389813 29436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.000s	sys 0.028s
I20260709 13:14:08.389977 29546 rpcz_store.cc:276] 0709 13:14:07.242252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.290011 (+ 47759us) service_pool.cc:224] Handling call
0709 13:14:07.290390 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.297248 (+  6858us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:07.322606 (+ 25358us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.337998 (+1015392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:08.338806 (+   808us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:08.338875 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.338980 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.339151 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88963,"prepare.queue_time_us":29639,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":100800,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":7094,"thread_start_us":1002540,"threads_started":2,"wal-append.queue_time_us":935510}
W20260709 13:14:08.316183  1491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.007s	sys 0.013s
I20260709 13:14:08.269433  1705 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.394982 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.421839 29391 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:08.328050  1667 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.423197 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:08.348706   968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.014s	sys 0.044s
W20260709 13:14:08.383263 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 444025us
W20260709 13:14:08.348243  1707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.017s	sys 0.040s
W20260709 13:14:08.405344 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 68100.5us
I20260709 13:14:08.408048 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.419234 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.435714 29546 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:08.404614 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:08.292799  1504 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.439076 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.446079 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.448118 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.449316 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.450079 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.452065 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.465973 29395 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:08.463887   776 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:08.464013 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 59535.5us
I20260709 13:14:08.466018 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.468454 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:08.466073 29463 raft_consensus.cc:2393] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:08.465312 29466 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 8.
I20260709 13:14:08.340122  1741 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:08.484576 29512 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.015s	sys 0.011s
W20260709 13:14:08.428898   968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.014s	sys 0.044s
W20260709 13:14:08.380779  1662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.018s
W20260709 13:14:08.470350  1707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.019s	sys 0.042s
I20260709 13:14:08.382714  1726 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.476415  1704 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.434278 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:08.491557   874 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:08.494961 29541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.001s	sys 0.018s
W20260709 13:14:08.495325 29544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.019s	sys 0.021s
W20260709 13:14:08.545356 29541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.018s
W20260709 13:14:08.545545 29544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.019s	sys 0.021s
I20260709 13:14:08.546309 29541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3026) took 1260 ms. Trace:
W20260709 13:14:08.543835 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 109687us
W20260709 13:14:08.547945 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 48052us
W20260709 13:14:08.487054 29512 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.015s	sys 0.012s
W20260709 13:14:08.548648 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 662266us
I20260709 13:14:08.551260 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.552387 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.558966 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.546763 29541 rpcz_store.cc:276] 0709 13:14:07.285664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.291920 (+  6256us) service_pool.cc:224] Handling call
0709 13:14:07.316787 (+ 24867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.317095 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:07.906087 (+588992us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.545894 (+639807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:08.545959 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:08.546025 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.546102 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.546240 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5837,"prepare.queue_time_us":16226,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":1993,"thread_start_us":1222088,"threads_started":2}
I20260709 13:14:08.464545  1667 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:08.570508 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 285596us
I20260709 13:14:08.572431 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:08.486805 29435 connection.cc:256] RPC call timeout handler was delayed by -1.1476927209998848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:14:08.581131 29435 connection.cc:256] RPC call timeout handler was delayed by -1.0756927209999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
I20260709 13:14:08.552516  1253 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:08.588083 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.490141  1626 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:08.596793 30151 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Advancing to term 10
I20260709 13:14:08.597937 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.605571 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.613618 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.614245 29546 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:08.615229 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.608171 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.616907 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.617841 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.610091 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.619191 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.620123 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.621621 29546 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:08.622893 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:08.632885 29537 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:08.623245 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.634048 29464 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
W20260709 13:14:08.634714 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 86137.3us
I20260709 13:14:08.618332 29542 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 7.
I20260709 13:14:08.558785  1660 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.627243   776 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.631945 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.640679 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.641680 29395 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:08.628862  1530 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.642915 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.579912  1754 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:08.554481  1704 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.645879  1530 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.646598 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.650820 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.599360  1758 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.638172   776 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:08.654019 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.654852 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:08.611558  1668 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.640007  1729 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
W20260709 13:14:08.653644  1509 consensus_meta.cc:287] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.001s
I20260709 13:14:08.606220  1604 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.624119  1664 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.606021  1739 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:08.669037 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.674567 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.632473  1662 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.666961 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.713938 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.714811 29467 raft_consensus.cc:2393] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:08.679715 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:08.641216  1666 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.683055 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.684283 30123 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:08.701491 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.722399 29389 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:08.681556 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.718415 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:08.724472 29469 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:08.726166 29512 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:08.729974 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 50352.1us
I20260709 13:14:08.730841 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:08.731371 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:08.739929 30160 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 708) took 2226 ms (client timeout 2197 ms). Trace:
I20260709 13:14:08.740935 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:08.740432 30160 rpcz_store.cc:269] 0709 13:14:06.494507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.494989 (+   482us) service_pool.cc:224] Handling call
0709 13:14:08.714113 (+2219124us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54004687d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a52fa 00007f61ed966b17 00007f61e6ee16d4 00007f61e6ee1662 00007f61e6ee1591 00007f61e6ee150c 00007f61e6ee07c2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:08.721012 (+  6899us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4647326464}
I20260709 13:14:08.745823 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.756000 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:08.652463  1660 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.705462  1745 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.665334  1754 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.683399  1732 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:08.774288 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:08.770375 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 86197.2us
I20260709 13:14:08.775635 29470 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:14:08.780994 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 136864us
I20260709 13:14:08.756000  1560 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:08.678196  1668 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.678006  1758 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.716682  1664 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.704932  1604 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.783061  1707 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:08.729327  1662 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.790870  1481 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:08.789352  1515 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:08.743081  1666 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:08.790570  1705 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:08.925987  1749 log.cc:927] Time spent T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:14:08.905071  1504 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:08.895216  1626 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:14:08.792575  1732 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:08.957178  1780 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:08.900025  1745 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:08.966954  1757 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
W20260709 13:14:08.964581  1775 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:14:08.988931  1754 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:08.958346  1741 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:08.961314  1745 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:09.048593  1760 log.cc:927] Time spent T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:14:09.051036  1726 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:09.055218  1787 log.cc:927] Time spent T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:14:09.054201  1726 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:08.776988 29389 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:14:09.114049 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 400284us
I20260709 13:14:08.787878 29435 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:09.115440 29390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2780) took 2139 ms. Trace:
I20260709 13:14:09.120708 29397 raft_consensus.cc:2368] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:14:09.121040 29464 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:09.116084 29390 rpcz_store.cc:276] 0709 13:14:06.975564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.975682 (+   118us) service_pool.cc:224] Handling call
0709 13:14:06.976011 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.976380 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.976407 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.976901 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:14:07.384712 (+407811us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:07.384762 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.384835 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.114705 (+1729870us) raft_consensus.cc:1685] finished
0709 13:14:09.114780 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.115153 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12301,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":13774,"thread_start_us":407406,"threads_started":1,"wal-append.queue_time_us":1225778}
I20260709 13:14:09.143603 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:09.145939 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:09.164018 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:09.242784 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3032) took 1332 ms. Trace:
I20260709 13:14:09.243052  1530 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.244764  1515 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.249024  1253 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.249918  1253 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.963843  1592 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:09.251509 30159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49116 (request call id 1013) took 1939 ms. Trace:
I20260709 13:14:09.251596  1592 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.252156 30159 rpcz_store.cc:276] 0709 13:14:07.311833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.312009 (+   176us) service_pool.cc:224] Handling call
0709 13:14:07.312490 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.941410 (+628920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.941443 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:07.942059 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.387398 (+445339us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:08.580771 (+193373us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.601871 (+ 21100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.602278 (+   407us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.250616 (+648338us) raft_consensus.cc:1685] finished
0709 13:14:09.250674 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.251102 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18601,"prepare.queue_time_us":546199,"prepare.run_cpu_time_us":970,"prepare.run_wall_time_us":12081,"raft.queue_time_us":81970,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":36218,"thread_start_us":1120303,"threads_started":3,"wal-append.queue_time_us":952704}
I20260709 13:14:09.255280 29544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3033) took 1344 ms. Trace:
I20260709 13:14:09.268726 29544 rpcz_store.cc:276] 0709 13:14:07.910843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.910999 (+   156us) service_pool.cc:224] Handling call
0709 13:14:07.911539 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.911945 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.911974 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:07.912496 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.546023 (+633527us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:08.546071 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.546156 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.254529 (+708373us) raft_consensus.cc:1685] finished
0709 13:14:09.254594 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.254971 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3071,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8391,"thread_start_us":557443,"threads_started":1,"wal-append.queue_time_us":974043}
I20260709 13:14:09.263052  1788 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:09.263265  1783 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:09.264086  1785 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:08.965860  1667 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.264395  1786 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:09.274950   776 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.039746  1707 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:09.243582 29545 rpcz_store.cc:276] 0709 13:14:07.910430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.940977 (+ 30547us) service_pool.cc:224] Handling call
0709 13:14:07.941335 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.941612 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.941644 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:07.953661 (+ 12017us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.420137 (+466476us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:08.420190 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.420283 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.241731 (+821448us) raft_consensus.cc:1685] finished
0709 13:14:09.241819 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.242335 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":375749,"threads_started":1,"wal-append.queue_time_us":945636}
I20260709 13:14:09.278700 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 711) took 1920 ms. Trace:
I20260709 13:14:09.276933 30123 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:08.964257  1704 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.246065  1515 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.293104  1707 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.277186  1666 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.232851  1604 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.284739  1783 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.283033  1788 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:09.307037  1626 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:09.296351  1530 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.301643  1783 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.303330  1788 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.318675  1592 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:09.319198 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 531247us
I20260709 13:14:09.324383  1745 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.325749  1745 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.331187  1745 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.316872  1785 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.330744  1530 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:09.338954  1758 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.334784 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:09.288703 30158 rpcz_store.cc:276] 0709 13:14:07.358627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.358798 (+   171us) service_pool.cc:224] Handling call
0709 13:14:07.359203 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:08.055166 (+695963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.055218 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:08.112475 (+ 57257us) log.cc:844] Serialized 52 byte log entry
0709 13:14:08.576460 (+463985us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:08.745485 (+169025us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.747131 (+  1646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.747242 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.277981 (+530739us) raft_consensus.cc:1685] finished
0709 13:14:09.278045 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.278462 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13255,"prepare.queue_time_us":385103,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":145415,"raft.run_cpu_time_us":529,"raft.run_wall_time_us":65253,"thread_start_us":1121115,"threads_started":3,"wal-append.queue_time_us":702586}
I20260709 13:14:09.353789 29435 leader_election.cc:400] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11.
I20260709 13:14:09.354269 29435 leader_election.cc:403] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:09.355468  1750 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.820s	user 0.010s	sys 0.004s
I20260709 13:14:09.356949  1764 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11.
W20260709 13:14:09.357374 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.358593 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:09.352082 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 79787.5us
W20260709 13:14:09.361505  1357 consensus_meta.cc:287] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 1.349s	user 0.010s	sys 0.010s
I20260709 13:14:09.348410  1785 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.366530  1732 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.366037  1522 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:14:09.368265  1762 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.722s	user 0.007s	sys 0.007s
W20260709 13:14:09.362087  1747 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.758s	user 0.013s	sys 0.029s
W20260709 13:14:09.376309 29509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.007s	sys 0.021s
I20260709 13:14:09.364626  1515 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.383147 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:09.387429 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:09.388528 30160 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.378515 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:09.400614  1530 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:09.395447 29512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.008s	sys 0.005s
W20260709 13:14:09.403620 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 612817us
I20260709 13:14:09.416374 29509 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:09.416546 29388 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:14:09.418107 29512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.008s	sys 0.006s
I20260709 13:14:09.423200 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.423712 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.425325 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.428146 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.429648 29469 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:09.431030 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.431874 29468 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:09.435468  1732 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:09.417740 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:09.435814 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.420459  1745 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:09.443189 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:09.446372  1668 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.447090  1660 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:09.448403  1743 log.cc:927] Time spent T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 1.020s	user 0.006s	sys 0.006s
W20260709 13:14:09.448966  1753 log.cc:927] Time spent T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.877s	user 0.007s	sys 0.005s
I20260709 13:14:09.442245 30155 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:09.461681  1764 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:09.469034  1771 log.cc:927] Time spent T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.821s	user 0.007s	sys 0.007s
I20260709 13:14:09.469538 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:09.472848 29540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3024) took 2242 ms. Trace:
I20260709 13:14:09.473484 29540 rpcz_store.cc:276] 0709 13:14:07.230485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.276130 (+ 45645us) service_pool.cc:224] Handling call
0709 13:14:07.276712 (+   582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.277317 (+   605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.277364 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:07.296552 (+ 19188us) log.cc:844] Serialized 26 byte log entry
0709 13:14:07.949174 (+652622us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:07.949232 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.949361 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.447158 (+1497797us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:09.465481 (+ 18323us) raft_consensus.cc:1685] finished
0709 13:14:09.465516 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.472571 (+  7055us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1208,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":13333,"spinlock_wait_cycles":537320832,"thread_start_us":624591,"threads_started":1,"wal-append.queue_time_us":955570}
I20260709 13:14:09.479606 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:09.451731  1745 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.487774  1780 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.488503   874 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:09.489014   874 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.488631  1780 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.489365   874 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.491801 29539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3034) took 1580 ms. Trace:
I20260709 13:14:09.481475 30157 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:09.488016 29471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 2119) took 1033 ms. Trace:
I20260709 13:14:09.496657 29363 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:09.483469  1745 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:09.500049  1763 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.846s	user 0.003s	sys 0.012s
I20260709 13:14:09.492236 29539 rpcz_store.cc:276] 0709 13:14:07.911182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.912626 (+  1444us) service_pool.cc:224] Handling call
0709 13:14:07.913000 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.913391 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:07.952796 (+ 39405us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.201948 (+249152us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b180047f560. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1
0709 13:14:08.402601 (+200653us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.406183 (+  3582us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:08.408246 (+  2063us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.408454 (+   208us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:08.408500 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.408580 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:08.547017 (+138437us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b180047f560. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:14:08.648714 (+101697us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b180047f560. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58b43f3 00007f61e58b67c1 00007f61e58b6779 00007f61e58b6709 00007f61e58b66d1 00007f61e58b59cd 000000000038f354 000000000038f199 00007f61e589783a
0709 13:14:09.366571 (+717857us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:09.491284 (+124713us) raft_consensus.cc:1685] finished
0709 13:14:09.491312 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.491541 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246590,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":11062,"raft.queue_time_us":50075,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":37118,"spinlock_wait_cycles":204619520,"thread_start_us":355719,"threads_started":1,"wal-append.queue_time_us":594146}
I20260709 13:14:09.506235  1662 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.506878  1780 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.507198  1660 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:14:09.506887 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 780726us
I20260709 13:14:09.508195  1660 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.508880 29543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3035) took 1597 ms. Trace:
I20260709 13:14:09.493927 29471 rpcz_store.cc:276] 0709 13:14:08.454755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.454986 (+   231us) service_pool.cc:224] Handling call
0709 13:14:08.455442 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:08.455942 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.455987 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:08.456832 (+   845us) log.cc:844] Serialized 52 byte log entry
0709 13:14:08.534696 (+ 77864us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:08.534744 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.580446 (+ 45702us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.463683 (+883237us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:09.476074 (+ 12391us) raft_consensus.cc:1685] finished
0709 13:14:09.476102 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.487768 (+ 11666us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":653,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":55088000,"thread_start_us":77356,"threads_started":1,"wal-append.queue_time_us":144860}
I20260709 13:14:09.510392 29543 rpcz_store.cc:276] 0709 13:14:07.911561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.913609 (+  2048us) service_pool.cc:224] Handling call
0709 13:14:07.913915 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.914251 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.914278 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:07.942978 (+ 28700us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.475325 (+532347us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:08.475379 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.475446 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.464520 (+989074us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:09.508227 (+ 43707us) raft_consensus.cc:1685] finished
0709 13:14:09.508258 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.508613 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317,"raft.queue_time_us":45379,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6009,"spinlock_wait_cycles":57713920,"thread_start_us":429941,"threads_started":1,"wal-append.queue_time_us":658402}
W20260709 13:14:09.509769 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93722.7us
I20260709 13:14:09.531391  1664 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.526028  1515 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:09.532845  1515 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.533339  1515 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:09.533560 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.535851 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:09.538053  1748 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.957s	user 0.003s	sys 0.010s
I20260709 13:14:09.538627  1668 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:09.541750  1668 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.539224  1780 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:09.548703  1668 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.540447 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:09.526839 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 148786us
I20260709 13:14:09.514506  1660 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.549151  1780 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.556140 30160 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:09.554797   874 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:09.557597  1780 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.558423  1664 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.558597 29512 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:09.558863  1790 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:09.559198  1664 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.559693   874 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.559623  1790 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.562074  1664 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:09.575906 30151 consensus_meta.cc:287] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.014s
I20260709 13:14:09.582304 30151 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:14:09.562146  1751 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 1.066s	user 0.021s	sys 0.022s
I20260709 13:14:09.583366 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2800) took 1187 ms. Trace:
I20260709 13:14:09.583930 29394 rpcz_store.cc:276] 0709 13:14:08.395656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.395776 (+   120us) service_pool.cc:224] Handling call
0709 13:14:08.396103 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.396315 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:08.586679 (+190364us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.582161 (+995482us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b1800449680. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e85494bc 00007f61e589748b 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b 00007f61e8540d23 00007f61e854123a
0709 13:14:09.582531 (+   370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:09.582630 (+    99us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:09.582747 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.582876 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.583136 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9780,"prepare.queue_time_us":231993,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":10620,"spinlock_wait_cycles":13046656,"thread_start_us":194227,"threads_started":2,"wal-append.queue_time_us":190368}
I20260709 13:14:09.566181  1798 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:09.563549 29466 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:09.566825  1665 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.574568 29509 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:09.587539  1665 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:09.569072  1797 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.174s	user 0.000s	sys 0.002s
I20260709 13:14:09.591651  1664 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:09.592923  1744 log.cc:927] Time spent T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 1.193s	user 0.021s	sys 0.025s
I20260709 13:14:09.593684  1521 consensus_queue.cc:1048] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:09.573958 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59298 (request call id 2122) took 1112 ms. Trace:
I20260709 13:14:09.596524 29463 rpcz_store.cc:276] 0709 13:14:08.584427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.601225 (+ 16798us) service_pool.cc:224] Handling call
0709 13:14:08.607159 (+  5934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.117534 (+510375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:09.117596 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:09.117672 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:09.117710 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.573391 (+455681us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002a49d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:09.573466 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.573669 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171708672}
I20260709 13:14:09.568588 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:09.599370 29360 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:09.601137  1530 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:09.601665  1530 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.602128  1530 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:09.576143  1783 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.609191  1783 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.608999  1788 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.609958  1783 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:09.586463  1798 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:09.577054  1755 log.cc:927] Time spent T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.969s	user 0.001s	sys 0.012s
I20260709 13:14:09.610688  1665 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.610977  1798 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:09.611755  1790 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.614194 29360 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:09.619800  1585 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:09.620357  1585 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:09.621703  1585 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.625330 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:09.626183 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 64957us
I20260709 13:14:09.590097 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:09.573648  1073 consensus_meta.cc:287] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 1.381s	user 0.013s	sys 0.010s
W20260709 13:14:09.650972 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 167703us
I20260709 13:14:09.658169 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.655543 29397 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:09.660372   874 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.660909   874 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.610407  1783 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.666759  1662 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:09.565598  1253 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.695711  1667 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.696624  1667 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.702101 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.682978  1783 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.659710  1780 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:14:09.706508 29466 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:09.709981 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:09.713088 29388 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:14:09.717751 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.719396 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:09.719974 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:09.720220 29464 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.721700 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:09.722417  1664 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.723157  1664 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.729739  1515 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:09.712175 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 110017us
I20260709 13:14:09.743036 30123 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:09.744144  1790 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:09.744678  1790 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.745003  1790 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:09.752179 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:09.754546 29466 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.766078 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:09.766779 29471 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:09.709131  1662 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:14:09.753590  1798 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.772966 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:09.778101  1739 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:09.778626  1739 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.779017  1739 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:09.779204  1798 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.779477  1606 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:09.781829  1253 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.779263  1664 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.764194  1788 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.750465  1745 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.750203  1530 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:09.802838 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 212811us
W20260709 13:14:09.817044  1806 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:09.794313  1667 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.795295  1515 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.832798 29466 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
W20260709 13:14:09.838207  1803 log.cc:927] Time spent T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:14:09.843777  1605 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.844599  1605 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:09.850929 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 82393.4us
I20260709 13:14:09.865058 29396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36874 (request call id 2794) took 1474 ms. Trace:
I20260709 13:14:09.865743 29396 rpcz_store.cc:276] 0709 13:14:08.390071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.392059 (+  1988us) service_pool.cc:224] Handling call
0709 13:14:08.466560 (+ 74501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:08.490720 (+ 24160us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:09.513968 (+1023248us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b1800224ec0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61ec3993c7 00007f61e89ab9a7 00007f61e89bb0bf 00007f61e89bb038
0709 13:14:09.663535 (+149567us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.771583 (+108048us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.786790 (+ 15207us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:09.818820 (+ 32030us) log.cc:844] Serialized 26 byte log entry
0709 13:14:09.818985 (+   165us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:09.819023 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.819147 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.864535 (+ 45388us) raft_consensus.cc:1685] finished
0709 13:14:09.864570 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.864789 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4613,"prepare.queue_time_us":205365,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":119,"raft.queue_time_us":33971,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":39156,"spinlock_wait_cycles":21545728,"thread_start_us":167737,"threads_started":2,"wal-append.queue_time_us":57127}
I20260709 13:14:09.835700 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:09.881940 29464 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:09.884918   874 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.899750 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:09.902645 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 153485us
I20260709 13:14:09.912189  1707 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:09.913160  1707 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.914707 30126 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:09.921739 29545 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:09.923274   874 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.941978   874 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.951812  1605 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.941385  1665 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:09.954419  1745 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:09.956743  1665 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:09.943315  1522 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.970587  1522 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:09.946007  1073 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.972106  1073 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.973343  1522 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:09.946604  1793 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.975816  1793 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.978055  1793 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.978919  1667 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.979617  1667 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.980616   874 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.981649  1667 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.983016  1531 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:09.983724  1531 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:09.986562  1764 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:09.995069 29471 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:10.000880 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:10.012596 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.019320  1764 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:10.019439 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.019891  1764 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:10.020340 29538 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:10.021005  1764 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.019412 29543 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:14:10.021822  1792 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.022806  1531 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:09.993593  1585 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.024760 29438 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:10.022528  1792 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.054675  1481 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:10.023109  1662 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:10.054711 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:10.058729 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 167871us
I20260709 13:14:10.054885 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:09.970168  1739 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.064042 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:10.068470 29471 raft_consensus.cc:2368] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11.
I20260709 13:14:09.993782  1515 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.075027 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:10.077558 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 83045.1us
I20260709 13:14:10.077805  1707 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.081357 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:10.081650  1811 log.cc:927] Time spent T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:14:10.082159 29397 pending_rounds.cc:85] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 5
I20260709 13:14:10.082603 29397 pending_rounds.cc:107] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:14:10.082914 29397 raft_consensus.cc:2889] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:10.083192 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:10.084936 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:10.063908  1481 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.087886 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:10.030867  1764 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.067400  1073 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.102599 30159 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:14:10.103689 30151 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:10.105218 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:10.102824 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:10.106066 30160 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:10.092253  1481 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.120807 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.091960  1357 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:10.120918 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.123097   874 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.124673 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.094241  1798 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:10.118005 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 200841us
I20260709 13:14:10.092166  1664 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:10.129922 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.106573  1253 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.120163 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.123685   874 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.109411  1530 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:10.087062  1585 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.094096  1515 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.126287  1357 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.124013  1793 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.160607 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:10.105213  1783 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.171890  1796 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.172777  1796 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.132628  1664 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:10.180609 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 95796.7us
I20260709 13:14:10.189551   874 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.168099  1357 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.198819 29396 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:10.198999 30153 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:10.178128  1798 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:10.200239  1253 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:10.182127  1664 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.216718  1515 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.221022 29509 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:10.221985  1668 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:10.223783  1585 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.223914  1796 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.187530  1745 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:10.224772  1745 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.226637  1798 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.227396  1745 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.237483  1707 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:10.258069 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.265441  1792 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:10.266669  1253 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.270007  1515 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.270716  1515 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.273885 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:10.274329  1515 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.274752 30152 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:10.275810  1783 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:10.276127 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:10.276329  1357 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.277520 29464 raft_consensus.cc:2368] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:14:10.280877 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:10.281739 30152 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 11: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:14:10.179950  1793 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:10.287401  1812 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.268s	user 0.004s	sys 0.000s
I20260709 13:14:10.288640  1793 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.289489 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.290822 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.291136 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.291548 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.293670 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.291141 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.304574 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.312415 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:10.318696 30151 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:14:10.295843  1790 consensus_meta.cc:287] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.012s
I20260709 13:14:10.229339  1798 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:10.323585 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.270252  1253 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:10.261978  1481 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.306116  1739 leader_election.cc:290] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.339787 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:10.364125 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65818.2us
I20260709 13:14:10.353133  1667 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:10.367043 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:10.371270 29396 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 11: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:10.328243  1790 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.374269 29435 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:10.377882 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:10.378717 29464 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:10.379317 29471 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:14:10.382893 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.384539 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:10.389310 29394 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:10.389994 30151 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:10.392401 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:10.393321  1780 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:10.395004 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:10.395766  1780 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:10.397190 29464 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:10.397522  1780 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:10.405741  1605 raft_consensus.cc:2764] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:14:10.398716 29509 leader_election.cc:400] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:14:10.370580  1798 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:10.406760  1798 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:10.407624  1798 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.408430  1790 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:10.409682 29509 leader_election.cc:403] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:10.399703  1357 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.400278  1667 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.419646  1796 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:10.424844 29363 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:10.430382 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:10.437331 29363 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:10.427181 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 266685us
I20260709 13:14:10.440963 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:10.425652  1780 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:14:10.457010 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58490.4us
I20260709 13:14:10.462332 29512 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:10.466320 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.441056  1585 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:10.440963  1073 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:10.438928  1788 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:10.469522 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:10.471004  1668 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.455287  1790 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:10.499856 29363 leader_election.cc:400] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:14:10.504050 29363 leader_election.cc:403] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:10.500349  1824 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:14:10.517711 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 55478us
I20260709 13:14:10.518712 29512 leader_election.cc:400] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11.
I20260709 13:14:10.551061 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.552732 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.553548 29537 raft_consensus.cc:2393] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 10: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:10.557730  1783 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.559544 29545 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:10.561120 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.562561  1481 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:10.505215  1790 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:14:10.563813 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 45281.3us
I20260709 13:14:10.564110  1790 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:10.566917 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.567183 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.567377 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.568094 29542 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:14:10.499902  1664 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.573993  1664 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:10.574455 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.578819 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.579411  1829 consensus_queue.cc:1059] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:10.580385  1829 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:10.580713  1829 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:10.584867 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.575529  1830 consensus_queue.cc:1059] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:14:10.587518  1830 raft_consensus.cc:3055] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:10.587909  1830 raft_consensus.cc:740] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:10.588829  1830 consensus_queue.cc:260] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.575590  1667 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.591913 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.596055 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.590184  1830 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.604368 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.610633 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.611238 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.518639  1788 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:10.505223  1073 raft_consensus.cc:697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:10.554132  1798 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.506901  1585 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:10.581768  1829 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:10.710935 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 352722us
W20260709 13:14:10.712216 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 335902us
W20260709 13:14:10.735764 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 131054us
I20260709 13:14:10.748756 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:10.768991 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:10.769694 29397 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.772722 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:10.773414 29395 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:10.767660  1788 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:10.786862 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.788774 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:10.790391 29435 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:10.753989  1668 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.792997  1668 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.794939  1073 consensus_queue.cc:237] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:10.796983  1668 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:10.804114 29543 raft_consensus.cc:1240] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:10.806223 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:10.807392 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 302394us
W20260709 13:14:10.799861  1764 consensus_meta.cc:287] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.692s	user 0.013s	sys 0.001s
I20260709 13:14:10.835914 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:10.850276  1780 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9.
I20260709 13:14:10.855389  1798 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:10.867462 29510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.827003  1829 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:10.878878  1764 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:10.879130 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 93995.4us
I20260709 13:14:10.882206  1605 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:10.884369 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:10.897532 29463 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:10.900609 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:10.922788 29545 raft_consensus.cc:3060] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.925753 29397 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:10.940104 29395 raft_consensus.cc:2468] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:10.922039  1667 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:10.935671  1790 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:10.949970  1790 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:10.798965  1585 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:10.960052 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 228928us
I20260709 13:14:10.971499 29545 raft_consensus.cc:2468] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:10.979004 29363 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:10.981067 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 231295us
I20260709 13:14:10.986740 29512 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:14:10.998306 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.997040 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:11.001909 29543 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:11.004352 29537 raft_consensus.cc:1240] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:11.025625 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:11.026793 29538 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:11.031455 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:11.031729 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:11.036262 29469 raft_consensus.cc:2368] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11.
I20260709 13:14:11.037446 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:11.004063  1792 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:11.053908 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.022467  1780 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:11.058611 30124 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.066653 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:11.061180 29397 raft_consensus.cc:1240] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:11.072474 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:11.074260 29471 raft_consensus.cc:1240] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:11.075678 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:11.076185 30156 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:11.079797 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:11.096566 29466 raft_consensus.cc:1240] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:14:11.090308 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:11.063747  1783 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:14:11.102020 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:11.108522 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:11.036829  1606 consensus_queue.cc:1059] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:14:11.088689  1780 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:11.126663  1780 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.163115 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:11.163115 29395 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:11.133108 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:11.166225 30156 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:11.167495 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:11.168124 30156 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.134335 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:11.169144 29512 leader_election.cc:400] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11.
I20260709 13:14:11.135466 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:11.136549 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:11.149883 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:11.169516 29512 leader_election.cc:403] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:11.178191 29543 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:11.179250 30153 raft_consensus.cc:2368] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
W20260709 13:14:11.180193 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 145298us
I20260709 13:14:11.184662 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:11.187275 29538 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:11.187731 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:11.192827 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:14:11.188102 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 157929us
I20260709 13:14:11.201428 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:11.202759 30123 leader_election.cc:304] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:11.208878 30123 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:11.218873  1745 raft_consensus.cc:2804] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:11.238863  1827 raft_consensus.cc:2804] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:11.239496  1827 raft_consensus.cc:697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:11.245443 30156 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:11.211700  1831 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:11.248090 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 60252.5us
I20260709 13:14:11.204447  1841 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:11.245076  1830 consensus_meta.cc:287] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.000s
I20260709 13:14:11.252753 29397 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 13. Current term is 14. Ops: [10.9-13.10]
I20260709 13:14:11.255662  1662 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:11.261996  1662 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.264122  1830 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.264760  1830 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.267163  1830 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:11.267177  1847 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:14:11.262066  1857 consensus_queue.cc:1059] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:11.269289  1857 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:11.269635  1857 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:11.270576  1857 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.273514  1857 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:11.240468  1827 consensus_queue.cc:237] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.265965  1754 consensus_queue.cc:1059] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 13:14:11.310843 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 113285us
W20260709 13:14:11.319716 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 110953us
I20260709 13:14:11.264757  1662 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:11.307417  1668 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:11.339406 29465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:11.339839 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.340420 29465 raft_consensus.cc:606] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:11.340616 29397 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:11.339534 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.342293 29395 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:14:11.340822 29465 raft_consensus.cc:614] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:11.325429  1790 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:11.346099 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.348054  1668 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.363858 29395 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
W20260709 13:14:11.390753 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.535s (SENT)
I20260709 13:14:11.391697 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:11.392724 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 85669.4us
I20260709 13:14:11.393316 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:11.386058 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 55984.9us
I20260709 13:14:11.395337  1830 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:11.402736 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.405359 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.405622 29397 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:11.406273 29395 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
W20260709 13:14:11.407473 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 78933.2us
I20260709 13:14:11.411639 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:11.413276 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.416988 29395 raft_consensus.cc:1240] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:11.408084 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:11.427078  1668 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:11.430512  1696 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:11.433013 30152 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEARNER]: Advancing to term 11
I20260709 13:14:11.450223 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.450281  1521 raft_consensus.cc:3055] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:11.451944 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.452208  1521 raft_consensus.cc:740] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:11.452538 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.453615 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.453198  1521 consensus_queue.cc:260] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.453234 29396 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:11.458285 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:11.459085 29391 raft_consensus.cc:3060] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.461287 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.462072  1522 raft_consensus.cc:3055] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:11.458386 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.462628 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:11.465524 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 50546.1us
I20260709 13:14:11.462535  1841 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11.
I20260709 13:14:11.471952 29388 raft_consensus.cc:2368] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:11.472600 29438 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:11.472687 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.462571  1522 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:11.475708  1522 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:11.438784  1836 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:11.490108 29509 leader_election.cc:400] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:11.490998 30152 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:11.493583 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.499596  1626 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:11.503968 29389 raft_consensus.cc:1240] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:14:11.508200 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.509025 29396 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 12: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:11.490757 29509 leader_election.cc:403] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:11.512106 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:11.524557  1662 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609) with higher term. Message: Invalid argument: T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:11.514979  1836 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:11.536368  1836 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:11.522030 29464 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:11.539147  1522 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:11.540704 29391 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
W20260709 13:14:11.542146 29437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:11.523185 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 56426us
I20260709 13:14:11.529733  1745 raft_consensus.cc:697] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:11.530622  1521 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.532622  1832 consensus_queue.cc:1059] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:11.533682 29295 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.523582 29509 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:11.550763  1585 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:11.551376 30152 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:14:11.551774 30152 pending_rounds.cc:85] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 8
I20260709 13:14:11.551990 30152 pending_rounds.cc:107] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:14:11.552212 30152 raft_consensus.cc:2889] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:11.555899 29295 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 9, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 9 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.558383  1824 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:11.557786 29295 catalog_manager.cc:5697] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 14, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 14 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.542482  1835 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:11.569247 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:11.594379 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.584955  1662 raft_consensus.cc:2804] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:11.600812  1662 raft_consensus.cc:697] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:11.600903 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.601979  1662 consensus_queue.cc:237] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.592778 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.609158 29537 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:11.626693 29392 raft_consensus.cc:1240] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:11.644042 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.640991  1253 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:11.647253  1253 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:11.648717  1850 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:11.651644 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:11.644110 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.650213  1253 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:11.662030 29546 raft_consensus.cc:2410] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:14:11.605909  1835 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:11.666638  1835 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.643401  1605 raft_consensus.cc:3055] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:11.667968  1605 raft_consensus.cc:740] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:11.668881  1605 consensus_queue.cc:260] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.670003  1605 raft_consensus.cc:3060] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:11.628598  1783 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:11.677439  1783 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:11.679685  1783 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:11.691610 29438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:11.683132 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74748.7us
I20260709 13:14:11.694416 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.700107 29295 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:11.728188 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:11.738337 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:11.739902 29545 raft_consensus.cc:2410] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:14:11.722846  1790 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:11.745561 29471 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:11.746420 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:11.748934 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:11.708043  1509 consensus_queue.cc:1059] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:14:11.749315 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:11.755365 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.758652 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.759388 29545 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:14:11.760263 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.760594 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.761409 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.761705 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.762827 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.763283 29544 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:11.763911 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.764350 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.765153 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.760270 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.767376 29538 raft_consensus.cc:2368] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 7. Current term is 8.
I20260709 13:14:11.767686 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.767941 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.771556 30126 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:11.775404 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.777017 29540 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:11.791994 29295 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 12 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:11.797137 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.902758 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:11.729985  1745 consensus_queue.cc:237] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.782590  1696 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:11.906244  1664 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:11.910125  1664 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:11.912750  1664 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:11.912808  1661 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:14:11.913686  1696 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:11.914765  1696 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:11.916195  1696 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:11.927695 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 152825us
I20260709 13:14:11.953919 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.019838 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.021620 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.022553 29545 raft_consensus.cc:2393] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:12.027760 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.036336 29295 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 10, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:12.038595 29388 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:12.044678 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.045423 29537 raft_consensus.cc:2376] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9. Re-sending same reply.
I20260709 13:14:12.070065 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.074544 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.032510  1872 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:12.076004 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.081002 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.088500  1667 raft_consensus.cc:1064] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:14:12.089178  1667 raft_consensus.cc:1068] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:12.094837 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:12.095706 29545 raft_consensus.cc:2376] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11. Re-sending same reply.
I20260709 13:14:12.119946 29546 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:14:12.120630 29546 pending_rounds.cc:85] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 6
I20260709 13:14:12.120893 29546 pending_rounds.cc:107] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:14:12.121165 29546 raft_consensus.cc:2889] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:12.121547 29546 pending_rounds.cc:107] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:14:12.121826 29546 raft_consensus.cc:2889] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:12.135070 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.137949 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.138820 29546 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
W20260709 13:14:12.140304 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.157512 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:12.164952 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 80023.3us
W20260709 13:14:12.165948 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 168111us
I20260709 13:14:12.203233 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:12.204169 29537 raft_consensus.cc:2376] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9. Re-sending same reply.
W20260709 13:14:12.218393  1874 log.cc:927] Time spent T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.287s	user 0.003s	sys 0.000s
I20260709 13:14:12.223444 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.247162 29465 raft_consensus.cc:1275] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:14:12.247704 29465 pending_rounds.cc:85] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting all ops after (but not including) 9
I20260709 13:14:12.247934 29465 pending_rounds.cc:107] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:14:12.248160 29465 raft_consensus.cc:2889] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:12.264643  1883 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:14:12.281029  1881 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.332s	user 0.002s	sys 0.000s
W20260709 13:14:12.373945 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 388324us
W20260709 13:14:12.416162 30126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.502058  1850 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.502995  1850 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:12.509611  1737 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:12.515058  1737 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:12.524648 29295 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 9, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 9 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:12.526885 29295 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 9, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 9 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:12.528854 29295 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 3 to 9, term changed from 8 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130), VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131), VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:12.536940  1857 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:12.537675 29363 leader_election.cc:336] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.502s (SENT)
I20260709 13:14:12.556782 29295 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 7 to 8, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 8 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:12.568117 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.568898 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.571201 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.572525 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.573400 29541 raft_consensus.cc:2393] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:14:12.559437  1737 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:12.559784 29291 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 284) took 34846 ms (client timeout 15000 ms). Trace:
I20260709 13:14:12.567818 29295 catalog_manager.cc:5697] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:12.601620  1745 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:12.602602  1745 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:12.599757 29295 catalog_manager.cc:5697] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 10, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 10 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:12.576565 29291 rpcz_store.cc:269] 0709 13:13:37.704361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.087231 (+2382870us) service_pool.cc:224] Handling call
0709 13:14:12.550286 (+32463055us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:08.772861 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:08.933498 (+160637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:08.939005 (+  5507us) write_op.cc:435] Acquired schema lock
0709 13:14:08.948200 (+  9195us) tablet.cc:662] Decoding operations
0709 13:14:08.957310 (+  9110us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:08.957451 (+   141us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:08.957492 (+    41us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:14:08.967705 (+ 10213us) tablet.cc:701] Row locks acquired
0709 13:14:08.967748 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:14:08.968319 (+   571us) write_op.cc:270] Start()
0709 13:14:08.990664 (+ 22345us) write_op.cc:276] Timestamp: P: 1783602848967918 usec, L: 0
0709 13:14:08.990699 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:14:09.264840 (+274141us) log.cc:844] Serialized 3277 byte log entry
0709 13:14:09.579370 (+314530us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e899ce28 00007f61ec3d7581 00007f61ec3d6d58 00007f61ec3db9f1 00007f61ec3db9a9 00007f61ec3db939 00007f61ec3db901 00007f61ec3dab2d 000000000038f354 000000000038f199
0709 13:14:09.842681 (+263311us) op_driver.cc:464] REPLICATION: finished
0709 13:14:09.965013 (+122332us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e899e32a 00007f61e8923f14 00007f61e8923ec3 00007f61e8923e38 00007f61e8923df3 00007f61e89230dc 00007f61e894ce16 00007f61e8934cbb 00007f61e891f39d 00007f61e8922d75
0709 13:14:10.169558 (+204545us) write_op.cc:301] APPLY: starting
0709 13:14:10.169740 (+   182us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:10.198862 (+ 29122us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:10.198911 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:10.273789 (+ 74878us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:10.274183 (+   394us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:14:10.274248 (+    65us) write_op.cc:312] APPLY: finished
0709 13:14:10.330691 (+ 56443us) log.cc:844] Serialized 81 byte log entry
0709 13:14:10.358324 (+ 27633us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:10.399846 (+ 41522us) write_op.cc:454] Released schema lock
0709 13:14:10.399951 (+   105us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:10.400674 (+   723us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:10.400719 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":415782,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":276782,"apply.run_cpu_time_us":16100,"apply.run_wall_time_us":243287,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37487,"num_ops":8,"prepare.queue_time_us":506791,"prepare.run_cpu_time_us":28043,"prepare.run_wall_time_us":834800,"raft.queue_time_us":182396,"raft.run_cpu_time_us":33968,"raft.run_wall_time_us":172267,"replication_time_us":839823,"spinlock_wait_cycles":599510144,"thread_start_us":463418,"threads_started":4,"wal-append.queue_time_us":78069,"wal-append.run_cpu_time_us":39038,"wal-append.run_wall_time_us":2042021}]]}
I20260709 13:14:12.614919  1849 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:12.615794  1849 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:12.621228  1849 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:12.620364  1745 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:12.631232 29295 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:12.633512 29295 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:12.635291 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 400122us
W20260709 13:14:12.635388 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 137066us
I20260709 13:14:12.640550 29295 catalog_manager.cc:5697] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:12.647104 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.658510 29466 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:12.709275 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:12.711237 30151 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:14:12.711666 30151 pending_rounds.cc:85] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting all ops after (but not including) 7
I20260709 13:14:12.711907 30151 pending_rounds.cc:107] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:14:12.712163 30151 raft_consensus.cc:2889] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:12.712723  1868 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:12.713477 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:12.672137 29540 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:12.708273 29295 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 5 to 8, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 8 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:12.684059 30126 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.529s (SENT)
I20260709 13:14:12.650345 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:12.697626 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 46245us
I20260709 13:14:12.700073 29393 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:14:12.716791 30126 leader_election.cc:336] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.793s (SENT)
I20260709 13:14:12.663543 29539 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:12.640583  1509 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.723395 29464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:12.724097 29464 raft_consensus.cc:606] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:14:12.721172 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.721884 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:12.726276  1509 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:12.667829  1857 consensus_queue.cc:1048] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:14:12.727880  1745 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:12.728744  1509 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:12.730489 30159 raft_consensus.cc:1240] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:14:12.716162  1899 log.cc:927] Time spent T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.217s	user 0.019s	sys 0.056s
W20260709 13:14:12.644780  1872 consensus_meta.cc:287] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
I20260709 13:14:12.741317  1872 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:12.716521  1896 log.cc:927] Time spent T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.197s	user 0.002s	sys 0.008s
W20260709 13:14:12.716352  1885 log.cc:927] Time spent T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.211s	user 0.004s	sys 0.000s
W20260709 13:14:12.715931  1897 log.cc:927] Time spent T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.227s	user 0.036s	sys 0.031s
I20260709 13:14:12.746429  1886 raft_consensus.cc:1064] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:14:12.719766  1902 log.cc:927] Time spent T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.201s	user 0.008s	sys 0.052s
W20260709 13:14:12.746971  1886 raft_consensus.cc:1068] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Unable to promote non-voter c65265f20d7e42b6bfe314c5d109bdf7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:12.752877 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:12.738479  1891 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.231s	user 0.004s	sys 0.000s
I20260709 13:14:12.760612 29471 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:12.783039 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:12.764411 29542 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:12.783672 29463 raft_consensus.cc:606] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:12.785234 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.767058 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.786847 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:12.768723  1606 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:12.789466 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:12.770569 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.792215 30151 raft_consensus.cc:1240] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:12.792426 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:12.771205 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:12.774459 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:12.786080 29542 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:12.775991 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:12.779073  1850 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:12.783659 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:12.798694 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:12.799705 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49108 (request call id 1076) took 1209 ms. Trace:
I20260709 13:14:12.800113 30158 rpcz_store.cc:276] 0709 13:14:11.590025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.590297 (+   272us) service_pool.cc:224] Handling call
0709 13:14:11.590708 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.605232 (+ 14524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.605264 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.640296 (+ 35032us) log.cc:844] Serialized 26 byte log entry
0709 13:14:12.019335 (+379039us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:12.020237 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.020850 (+   613us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.799473 (+778623us) raft_consensus.cc:1685] finished
0709 13:14:12.799494 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.799632 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":35042,"thread_start_us":289356,"threads_started":1,"wal-append.queue_time_us":410511}
I20260709 13:14:12.814134  1832 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:12.816891 29464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:12.817571 29464 raft_consensus.cc:606] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:12.822603 29464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:12.823287 29464 raft_consensus.cc:606] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:12.823727 29464 raft_consensus.cc:614] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:12.829023 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 101609us
W20260709 13:14:12.829191 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 274679us
W20260709 13:14:12.830194 29363 leader_election.cc:336] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.601s (SENT)
I20260709 13:14:12.830580 29363 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:12.855899 30157 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:14:12.856887 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.856237 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:12.859935 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:12.856254 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:12.855386  1696 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.862502 30153 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:14:12.862612  1696 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:12.864543 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:12.864962  1696 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:12.866369 29509 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:12.867106 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:12.867290  1868 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:12.867790  1868 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:12.867981  1668 raft_consensus.cc:2764] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:14:12.868228  1868 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:12.875102 29389 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:12.877588 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:12.855342  1850 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:12.882880  1662 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:12.885912  1898 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:12.886188  1662 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:12.886710  1662 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:12.874795  1835 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:14:12.898818 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:12.913162 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:12.917421 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:12.918808 29464 raft_consensus.cc:2410] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:14:12.919781 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:12.929855 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:12.931779 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:12.925477 29363 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.783s (SENT) [suppressed 36 similar messages]
W20260709 13:14:12.933890 29363 leader_election.cc:336] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.806s (SENT)
I20260709 13:14:12.934293 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:12.930630 29389 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 7.
I20260709 13:14:12.936932 29435 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:12.939563 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:12.940248 29546 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 8.
I20260709 13:14:12.930608  1668 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:12.926133  1872 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:12.926316  1832 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:12.947106  1745 consensus_queue.cc:1059] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:12.945950  1832 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.947952  1745 consensus_queue.cc:1243] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer 7c2e8d3e55c649e2b3acedef25d81e16 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:12.948180  1832 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:12.955953 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:12.973701 29363 leader_election.cc:336] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.872s (SENT)
I20260709 13:14:12.970019 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:12.977452 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 50616.5us
I20260709 13:14:12.922927  1850 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:12.874423  1892 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:14:12.970723  1836 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:12.967748  1910 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:12.982580  1668 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:13.004828 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 77558.5us
W20260709 13:14:13.009115 30126 leader_election.cc:336] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 2.003s (SENT)
I20260709 13:14:13.010149 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.000721  1905 raft_consensus.cc:3055] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:13.003273  1836 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.006210  1668 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:13.017585  1836 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.014724  1905 raft_consensus.cc:740] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:13.036155  1605 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.016742  1841 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:13.041585  1745 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:14:13.049276  1905 consensus_queue.cc:260] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.036830  1668 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.052157  1905 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.051124  1841 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:13.057727  1841 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.056038  1605 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.091022  1913 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:13.091665  1914 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:13.157353 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 64298.9us
I20260709 13:14:13.171177  1737 raft_consensus.cc:993] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
W20260709 13:14:13.173879 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 199078us
W20260709 13:14:13.195863  1915 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.093s	user 0.007s	sys 0.003s
I20260709 13:14:13.203811  1521 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.204367  1521 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.204406  1605 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.163772  1888 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.206880  1888 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.197324  1913 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.209265  1888 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.212877  1849 raft_consensus.cc:1064] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:13.160422  1745 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:13.223079  1745 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.226063  1745 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:13.226850  1913 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:13.241714 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 232629us
W20260709 13:14:13.242980 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 273034us
I20260709 13:14:13.232074  1357 raft_consensus.cc:1081] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:13.247648 29509 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.249713 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.270188 30126 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.279733  1664 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.277047 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.254222  1521 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.288259  1919 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.288527  1661 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:13.288928  1919 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.280761  1913 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:13.297940 29362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.285450  1921 consensus_queue.cc:1059] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:14:13.297102 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:13.304512 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 57016.9us
I20260709 13:14:13.305599 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.305043  1073 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:13.282760  1668 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.287133  1824 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:13.307700 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.302992 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.308261  1668 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:13.287714  1888 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:13.305022  1664 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:13.318985  1918 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:14:13.316977  1754 raft_consensus.cc:993] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:13.325297  1868 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.348337  1754 raft_consensus.cc:1081] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:13.350327 29538 raft_consensus.cc:1240] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:13.341928  1664 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.355902 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:13.356663 30153 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:13.357069  1664 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.358587 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.359256 29388 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:13.361394 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.362108 29390 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
W20260709 13:14:13.364876  1923 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:13.366647 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:13.309386  1849 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.374050  1868 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.375893  1868 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.341653  1886 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:13.376631 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 73744.9us
I20260709 13:14:13.379011 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.380100  1585 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.380713 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.376673  1868 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.382266  1919 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:13.383926  1662 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.396778 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:13.397722 30158 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:13.294945  1841 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:13.424785 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 140920us
I20260709 13:14:13.429522 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:13.430213 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:13.430873 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:14:13.432096 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51480us
I20260709 13:14:13.433177 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.418426  1585 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.386296  1662 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:13.438462 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 130810us
I20260709 13:14:13.439442 29509 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.445132 29539 raft_consensus.cc:1240] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:13.314074  1888 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.428013  1919 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.452540  1919 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.453825  1888 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.430828  1836 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.434144  1832 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.451923  1841 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:13.431397  1886 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:13.448383 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.456221 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:13.460332  1832 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:13.461364 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:13.463111  1835 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:13.463555  1835 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.463941  1835 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.467314 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:13.469046 30158 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:13.457536  1788 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:13.475241 30126 leader_election.cc:336] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.907s (SENT)
I20260709 13:14:13.475950  1606 raft_consensus.cc:993] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:14:13.476486  1606 raft_consensus.cc:1081] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:14:13.456733  1927 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:13.478632  1927 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:13.479048  1927 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.483367  1664 raft_consensus.cc:3055] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:13.483891  1664 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:13.483925  1836 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:13.485025  1664 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.491436 29509 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.491827  1919 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:13.496327 30125 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.497674 29509 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.502877 29540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:13.503621 29540 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.504004 29540 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.505024 29544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:13.505594 29544 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.505946 29544 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.501545  1868 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.504417  1841 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:13.512876  1850 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:13.513870  1357 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:13.514312  1357 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.514717  1357 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.517091  1664 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.526445 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:13.530092 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:13.527021 29544 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.532907 29540 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.542007 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:13.543330 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 110269us
I20260709 13:14:13.544188  1868 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:13.545985  1585 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:13.546664  1585 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.548892  1585 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.552073 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:13.554260 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.551769  1835 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.557067 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.561383 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:13.563879 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:13.564510 29542 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.569497 29538 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:13.573292 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:13.574110 29546 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.584316 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.584918 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.585501 29546 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:13.587761 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:13.588012  1585 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.589603  1783 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:13.596252  1668 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:13.596904  1668 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.599341  1668 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.599608  1357 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.607112 29464 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 12: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:13.610970 29542 raft_consensus.cc:2468] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:13.602738 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:13.622836 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.623590 29393 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.611729 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.612164  1664 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:13.624467  1664 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.625053 29363 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.627130  1664 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:13.619673 29390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:14:13.629685 29390 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.627188  1934 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.623659  1892 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:13.626341 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.630527  1892 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.631158  1892 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.631604 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.617178  1357 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.633142  1849 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:13.632674  1934 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:13.628050  1935 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.630106 29390 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.635064 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.637399 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:13.637779  1935 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.638116 30157 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.638880 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.640030 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.640805 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.642542 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.644235 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.645540 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.646215 29395 raft_consensus.cc:1275] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:14:13.652248 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 154674us
I20260709 13:14:13.652667 29544 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:13.653208 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.653918 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:13.654450 29540 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:13.654595 29466 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:13.654937 29466 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.655974  1835 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:13.655743 29466 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.656152 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:13.656795 29466 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:13.657120  1922 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:14:13.658236  1668 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.666566 29509 leader_election.cc:400] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10.
I20260709 13:14:13.668386 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:13.669188 29464 raft_consensus.cc:3055] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:13.669528 29464 raft_consensus.cc:740] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.670414 29464 consensus_queue.cc:260] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.643599 29390 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.671893 30157 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:13.672698 29466 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:13.675094 29393 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:13.634644  1927 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:13.676539  1832 consensus_queue.cc:1175] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:14:13.678490  1927 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:13.680425 29472 raft_consensus.cc:1240] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:14:13.676659 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.681495 29391 raft_consensus.cc:3060] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.682199 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.686115  1924 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.687956  1893 consensus_queue.cc:1059] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:13.674950 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:13.690928 29438 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:13.691555  1832 consensus_queue.cc:1059] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:13.690985  1737 consensus_queue.cc:1059] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:13.668475 29509 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.701923 29391 raft_consensus.cc:2468] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:13.702497 29464 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.704569 29463 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:13.706655 29390 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:13.707283 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.707510 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:13.708798 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.709111 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.709929 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:13.710340 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.710597 29546 raft_consensus.cc:1275] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:13.710843 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.705703  1754 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:13.711846  1868 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:13.712093  1754 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.713124  1754 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.714775 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.717314 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.717912 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.723759 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:13.727553 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.709192  1664 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:13.729173 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.732128 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.732868  1893 raft_consensus.cc:3055] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:13.733292  1893 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.734278  1893 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.735023  1606 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:13.735555  1606 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.736474  1606 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.738049 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:13.715260  1927 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:13.740072 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49235.3us
I20260709 13:14:13.740878 29438 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.741166 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:13.744256 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:13.744391 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.746754 29390 raft_consensus.cc:2393] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 12: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:13.747807 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.748533 29396 raft_consensus.cc:2468] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:14:13.768308 29363 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.757324 29464 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:13.738001  1606 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.771555 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.772682 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.730304  1754 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.774580  1849 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:13.774662  1919 consensus_queue.cc:1048] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:14:13.776671 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53910.5us
I20260709 13:14:13.778362 29435 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:13.779091 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.780272  1924 raft_consensus.cc:2804] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:13.780934  1924 raft_consensus.cc:697] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.771020  1893 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.783712  1934 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:13.784510 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:13.787799 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.788463 29396 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.790104  1832 raft_consensus.cc:2804] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:13.790764  1832 raft_consensus.cc:697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.780174  1850 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:13.781942  1783 consensus_queue.cc:1059] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:14:13.794616  1783 raft_consensus.cc:3055] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:13.742832  1664 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:13.794760 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.795038  1783 raft_consensus.cc:740] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:13.795753  1664 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.747112  1696 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:13.799736 30123 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.799880  1696 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.801163 30123 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.801653  1745 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.802086 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:13.802625  1905 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.802711 29466 raft_consensus.cc:3055] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:13.804423 29466 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:13.778731 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.805634 29512 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:13.806595  1868 raft_consensus.cc:2804] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:13.807121  1868 raft_consensus.cc:697] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:13.806883  1783 consensus_queue.cc:260] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.808223  1783 raft_consensus.cc:3060] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.808097  1868 consensus_queue.cc:237] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.809022  1832 consensus_queue.cc:237] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.810734  1857 raft_consensus.cc:2749] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:13.800863  1696 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.814867 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.817157 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.781947  1924 consensus_queue.cc:237] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.822901 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.824729 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.826454 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.828133 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.830842 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:13.832445 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.833238 29393 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.805240 29466 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:13.835332 29466 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.833559 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.838339 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.839049 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.839470 29390 raft_consensus.cc:3060] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.842397 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.844668 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.846794 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.842651 29396 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:13.859211 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.860427 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:13.860723 29543 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:13.861142 29542 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.844420 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:13.862161 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:13.864362 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.860123 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:13.868129 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.859014  1919 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.877111 29509 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.883252 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:13.891049 29393 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:13.892084 29542 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 13.
I20260709 13:14:13.873576 29466 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 13.
I20260709 13:14:13.897914 29363 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:13.904021 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:13.868572  1849 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.749737  1927 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:13.875771  1745 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.916852 29390 raft_consensus.cc:2468] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:13.910969 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:13.893131  1585 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.924162 29546 raft_consensus.cc:1240] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:13.893429  1664 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:13.934118 29540 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:13.935019 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.899559  1824 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:13.942625 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 72771.1us
I20260709 13:14:13.950263 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:13.868642  1892 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:13.952438 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 51474.3us
I20260709 13:14:13.894925 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:13.893788  1929 consensus_queue.cc:1059] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:14:13.958240 29537 raft_consensus.cc:2393] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:13.935640  1521 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:13.986069 29463 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:14.005707  1894 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:14.006651  1894 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:14.007992  1894 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:14.027732  1668 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:14.030990 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 65970.9us
W20260709 13:14:14.063333 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 92499.9us
I20260709 13:14:14.064935  1927 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:14.100267 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 68262.9us
I20260709 13:14:14.028244  1668 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:14:14.106686  1884 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:14:14.106591  1668 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:14.108091  1668 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.976178  1664 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:14:14.096230  1521 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:14.132269  1521 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:14.096501  1939 log.cc:927] Time spent T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.003s
W20260709 13:14:14.125357 29435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:14.096637  1942 log.cc:927] Time spent T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.008s
I20260709 13:14:14.151496 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:14.152367 30157 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:14.157176 29538 raft_consensus.cc:1240] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:14.162837 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 176398us
W20260709 13:14:14.244886 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 280686us
I20260709 13:14:14.142295  1892 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:14.292184 30157 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:14.302505 29435 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:14:14.304464 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 416583us
I20260709 13:14:14.339588 29540 raft_consensus.cc:1240] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:14.329417 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 264242us
W20260709 13:14:14.336334 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 90067.1us
I20260709 13:14:14.341385 29509 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:14.343135  1940 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:14:14.405416 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53713.3us
I20260709 13:14:14.339157  1754 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:14.343222  1737 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:14.432670 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 91428us
I20260709 13:14:14.444662 29509 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.394297  1927 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:14:14.468703 29463 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:14.424324  1892 consensus_queue.cc:1059] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:14:14.477675  1945 log.cc:927] Time spent T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:14.441045  1944 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:14.481086 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 183229us
I20260709 13:14:14.455678  1928 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:14.488714 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44138.5us
I20260709 13:14:14.489800 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:14.499367  1949 log.cc:927] Time spent T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:14:14.431005  1754 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:14.502589  1958 consensus_queue.cc:1059] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:14.484187  1944 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:14.471145  1737 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:14.527117 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:14.526104 29463 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 5 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:14.534754  1944 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:14.537369  1929 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:14.540350  1924 consensus_queue.cc:1059] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:14.542691 29464 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:14.543649  1960 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:14:14.544283  1696 raft_consensus.cc:3055] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:14.544731  1696 raft_consensus.cc:740] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:14.511977  1868 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:14.551064 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.330466  1850 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 5 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:14.558204  1929 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:14.572867 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45597us
I20260709 13:14:14.566386  1668 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:14.599391 29546 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:14.607524 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:14.608741 29541 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:14:14.545603  1696 consensus_queue.cc:260] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:14.625828 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:14:14.613092 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 58406.4us
I20260709 13:14:14.571293  1868 consensus_queue.cc:1048] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:14:14.636015 29392 raft_consensus.cc:1275] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:14:14.636632 29392 pending_rounds.cc:85] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 5
I20260709 13:14:14.636915 29392 pending_rounds.cc:107] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:14:14.637208 29392 raft_consensus.cc:2889] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:14.650605 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 99647.8us
I20260709 13:14:14.651558 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.625289  1754 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:14.653048 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.577488  1737 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:14.656961  1929 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:14.661291 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:14.648329  1696 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:14.681581 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.684036  1960 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:14.715975  1960 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:14:14.654625  1938 log.cc:927] Time spent T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.712s	user 0.013s	sys 0.000s
I20260709 13:14:14.694955 29390 raft_consensus.cc:1275] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:14:14.719703 29391 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:14.719777 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:14.720902 29392 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 9: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:14.721800 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.723497 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:14.725046 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.725839  1668 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.726608  1668 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:14.726766  1960 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.669080  1929 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:14.709601  1965 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:14.734112 29509 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:14.734745  1951 raft_consensus.cc:3055] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:14.735117  1968 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:14.735241  1951 raft_consensus.cc:740] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:14.736253  1951 consensus_queue.cc:260] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:14.737380 30126 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:14.738901  1913 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:14.748683  1893 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:14.749188  1893 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:14.754807 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:14.760692 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 124821us
W20260709 13:14:14.773681 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 144151us
I20260709 13:14:14.794082  1944 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.794890  1944 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:14.799993 29545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48432 (request call id 3177) took 1233 ms. Trace:
I20260709 13:14:14.801337  1944 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:14.800570 29545 rpcz_store.cc:276] 0709 13:14:13.566682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.566826 (+   144us) service_pool.cc:224] Handling call
0709 13:14:13.567194 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.572283 (+  5089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.572328 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:13.572859 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.741252 (+168393us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:13.741311 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.741386 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.554799 (+813413us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:14.799669 (+244870us) raft_consensus.cc:1685] finished
0709 13:14:14.799697 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.799913 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5151,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":14550,"spinlock_wait_cycles":85998336,"thread_start_us":142464,"threads_started":1,"wal-append.queue_time_us":282503}
W20260709 13:14:14.831305 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 61121.5us
I20260709 13:14:14.750087  1893 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:14.837771 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 65461.7us
W20260709 13:14:14.841077 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 233648us
I20260709 13:14:14.845451  1509 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:14.840219 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 60540.5us
I20260709 13:14:14.868083  1892 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:14:14.887059  1509 consensus_queue.cc:1048] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:14.887563  1832 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:14.895757  1929 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.896486  1929 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:14.899837  1832 consensus_queue.cc:1048] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:14.903076 29363 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.641s (SENT)
I20260709 13:14:14.903630 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:14.924549 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51755.7us
W20260709 13:14:14.925258 29363 leader_election.cc:336] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Timed out: RequestConsensusVote RPC to 127.27.150.131:42971 timed out after 1.698s (SENT)
I20260709 13:14:14.925657 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:14.925716 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:14.927655 29541 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:14.933835  1974 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:14.935968 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:14.946194 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:14.946786 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:14.948607 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:14.950101 29395 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:14.950393  1886 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.951272  1886 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:14.952281  1886 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:14.957085 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:14.960763 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:14.956331 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53339.6us
I20260709 13:14:14.957808 29543 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
W20260709 13:14:14.969812 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 48788.5us
I20260709 13:14:14.969882 30159 raft_consensus.cc:1240] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:14:14.954156  1951 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:14.973193 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:14.969296  1788 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:14.977506 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:14.982546  1948 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:14.982992  1948 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.983368  1948 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:15.001003 30158 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 5 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:15.023700 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:15.029274 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:15.030424  1929 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:15.041375 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:15.008687  1850 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.053894 29438 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:15.049878  1357 raft_consensus.cc:493] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:14:15.048401  1950 log.cc:927] Time spent T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.252s	user 0.004s	sys 0.001s
W20260709 13:14:15.066499 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 56514.2us
W20260709 13:14:15.114105 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 54198.8us
I20260709 13:14:15.114639 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:15.043435  1824 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:15.115407 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 61602us
W20260709 13:14:15.140053 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 98791.5us
I20260709 13:14:15.020126  1966 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:14:15.056622  1745 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:15.106184  1956 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:15.120172  1924 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:15.117290  1850 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:15.121997  1357 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.194701  1357 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.155026  1745 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:15.198031  1977 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:14:15.201445  1980 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:14:15.204595  1745 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.159076  1924 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:15.224737  1836 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.237344 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:15.240375  1924 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:15.256007  1975 log.cc:927] Time spent T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:14:15.258808  1983 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:14:15.264221 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45395.5us
I20260709 13:14:15.266093 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:15.267004 29546 raft_consensus.cc:2393] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 12: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:14:15.267769 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 150824us
I20260709 13:14:15.282572  1948 raft_consensus.cc:515] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.301251  1966 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.304184  1966 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:15.266096  1754 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:15.266952  1836 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:15.331888  1893 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.332374  1836 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.313836  1966 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.318179  1754 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.361398  1927 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:15.362232  1927 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.370954  1841 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:15.371835  1841 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.373708  1948 leader_election.cc:290] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.374559  1754 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.374749 29463 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:15.376535  1927 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.378551  1841 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.383062  1868 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.383615  1868 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.387879  1868 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.387907 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.400065 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:15.400748 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.400836 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.401778 30153 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:15.400774 29540 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:15.403942 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:15.404201 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:15.408025 29295 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 179) took 13363 ms (client timeout 15000 ms). Trace:
I20260709 13:14:15.414650  1951 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:15.415130  1951 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.415540  1951 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:15.393015  1927 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:15.422063 29540 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:14:15.423879 30126 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:15.425089  1948 raft_consensus.cc:2804] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:15.426093  1948 raft_consensus.cc:697] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:15.427305  1948 consensus_queue.cc:237] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.429823  1893 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.431241  1893 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:15.433704  1893 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.440932 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:15.441794 29463 raft_consensus.cc:3060] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:15.443109 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:15.443825 29542 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:15.449632 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:15.451385 29540 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:14:15.452839 29540 pending_rounds.cc:85] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 10
I20260709 13:14:15.453069 29540 pending_rounds.cc:107] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:14:15.453284 29540 raft_consensus.cc:2889] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:15.325908  1850 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.457396 29463 raft_consensus.cc:2468] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
W20260709 13:14:15.411908 29295 rpcz_store.cc:269] 0709 13:14:02.085627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.085996 (+   369us) service_pool.cc:224] Handling call
0709 13:14:15.407926 (+13321930us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:12.860026 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:12.989363 (+129337us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:13.001634 (+ 12271us) write_op.cc:435] Acquired schema lock
0709 13:14:13.004232 (+  2598us) tablet.cc:662] Decoding operations
0709 13:14:13.046076 (+ 41844us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:13.046210 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:13.046242 (+    32us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:14:13.047812 (+  1570us) tablet.cc:701] Row locks acquired
0709 13:14:13.047871 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:14:13.048070 (+   199us) write_op.cc:270] Start()
0709 13:14:13.048251 (+   181us) write_op.cc:276] Timestamp: P: 1783602853047996 usec, L: 0
0709 13:14:13.048276 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:14:13.049149 (+   873us) log.cc:844] Serialized 6458 byte log entry
0709 13:14:13.426420 (+377271us) op_driver.cc:464] REPLICATION: finished
0709 13:14:13.540503 (+114083us) write_op.cc:301] APPLY: starting
0709 13:14:13.540587 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:13.660889 (+120302us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:13.661018 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:13.790366 (+129348us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:13.830575 (+ 40209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:14:13.830630 (+    55us) write_op.cc:312] APPLY: finished
0709 13:14:13.831090 (+   460us) log.cc:844] Serialized 148 byte log entry
0709 13:14:13.831326 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:13.832201 (+   875us) write_op.cc:454] Released schema lock
0709 13:14:13.843361 (+ 11160us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:13.913784 (+ 70423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:13.916607 (+  2823us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1984281,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":113787,"apply.run_cpu_time_us":23170,"apply.run_wall_time_us":353593,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70847,"num_ops":16,"prepare.queue_time_us":50053,"prepare.run_cpu_time_us":45196,"prepare.run_wall_time_us":380964,"raft.queue_time_us":59966,"raft.run_cpu_time_us":14947,"raft.run_wall_time_us":107381,"replication_time_us":377921,"thread_start_us":377870,"threads_started":4,"wal-append.queue_time_us":228558,"wal-append.run_cpu_time_us":13135,"wal-append.run_wall_time_us":1551183}]]}
W20260709 13:14:15.510376 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 366054us
I20260709 13:14:15.520929 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.522285 29396 raft_consensus.cc:2393] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 13: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:15.522190 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:15.525830 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 49788.8us
I20260709 13:14:15.528846 29540 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:15.524708 29509 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:15.539783 29438 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:15.524644  1987 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
W20260709 13:14:15.543589 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 290636us
I20260709 13:14:15.525740  1893 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.555399 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.558683 29395 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:15.561038 29391 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:15.558935 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.563175 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.564949 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.565358 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.564695 29389 raft_consensus.cc:1275] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:15.566208 29394 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:15.572050 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:15.577364 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:15.577996 29542 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 9.
I20260709 13:14:15.578909 29509 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:15.590126 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:15.590637 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.591341 29388 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:15.562674  1968 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:14:15.563023  1987 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.588258  1664 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:15.595629  1946 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:15.570122  1834 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:14:15.549600  1972 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:15.548976  1958 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.582659  1893 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.631290 30153 raft_consensus.cc:1275] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:15.632037  1745 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:15.633235 30159 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:15.610059  1868 consensus_queue.cc:1048] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:15.637657  1924 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:15.570184  1966 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:14:15.641685 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.642518 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a79c5f3852446bd956bcf002f2bd78c" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:15.647459 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 116527us
I20260709 13:14:15.691341 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:15.692456 29472 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:15.658764 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:15.693755  1924 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.692687 30123 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:15.711383  1357 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:15.654137  1946 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.722748  1946 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.654114  1962 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.727136 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:15.727294  1962 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:15.734591  1898 consensus_queue.cc:1048] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:15.736729 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:15.664182  1929 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.740679  1893 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.741457  1893 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:15.664008  1972 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.742558  1972 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.742880 29435 leader_election.cc:304] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:15.744809  1893 raft_consensus.cc:2749] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:15.673507  1832 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:15.746698  1832 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.749379  1832 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.752658 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.758188 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.809991 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:15.810465 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 71850.9us
I20260709 13:14:15.819430  1990 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:15.820051  1990 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.822048 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.820385  1990 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.831167 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:15.854856 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:15.861511 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:15.863026 29545 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:15.864583  1990 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:15.865232  1661 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.868040 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:15.840948  2001 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.871342  1990 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.880718 29292 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 7 to 8, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 8 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:15.884600 29292 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:15.817724  1987 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:15.771471  1745 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.912626 29435 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:15.920645 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:15.833086  1962 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:15.687529  1951 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.932030 30159 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:15.928776 29292 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 7 to 8, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 8 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.953254 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.957967 29389 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:15.959518 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.959820 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:15.960434 29389 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:15.973920  1509 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:15.974787  1509 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:15.979416 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:15.980489 30153 raft_consensus.cc:2393] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 12: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:14:15.999719 30158 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
W20260709 13:14:15.998847 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 306214us
I20260709 13:14:16.015722 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:16.018690 29435 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:16.019783 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:16.027371 29392 raft_consensus.cc:2368] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:15.933832  1948 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:15.934242  1357 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:16.030097 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 251100us
I20260709 13:14:16.042783 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:16.042953 29292 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 8 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 12 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:16.048067 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:16.048763 29546 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:16.006687  1509 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:16.033278  1754 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:16.036198  1357 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:16.070396  1754 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.071281  1754 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.070426  1357 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.082852 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:16.083636 29389 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:16.046854  1855 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:16.103003 29292 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:16.175900 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:16.050809  1970 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:16.177963 29546 raft_consensus.cc:2393] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
W20260709 13:14:16.178120 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 123824us
I20260709 13:14:16.098798  1745 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:16.189630 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 276106us
W20260709 13:14:16.193665 29463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.004s	sys 0.071s
I20260709 13:14:16.194331 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:14:16.194705 29463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.004s	sys 0.071s
I20260709 13:14:16.195032 29466 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.205773 29466 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:14:16.207763 29512 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:16.173220  1849 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:16.231523 29438 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:16.217329  1664 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:16.218850  1951 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:16.252321  1999 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:14:16.229995  1849 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.229764  1754 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.254261  1974 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:16.264878  1664 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:16.319087  1664 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:16.323750  1849 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.325268  1357 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.337002  1357 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.328655 29292 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:16.331367  1754 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.356195 29292 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 5 to 6, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 6 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:16.388273 29292 catalog_manager.cc:5697] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 1 to 4, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 4 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.311879  1832 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:16.400537 29540 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 5 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:16.403374 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 147377us
I20260709 13:14:16.404458 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:16.404488 29435 leader_election.cc:400] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:16.406323 29435 leader_election.cc:403] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:14:16.431721  2010 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:14:16.412288 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 70711.1us
I20260709 13:14:16.440466 29540 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:16.398087  1868 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.354333  1974 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.396032  1832 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.446357  1913 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:16.446385  2004 log.cc:927] Time spent T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:14:16.448236  2007 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:14:16.469748 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 65429.3us
I20260709 13:14:16.458355  1913 consensus_queue.cc:1243] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Peer 7c2e8d3e55c649e2b3acedef25d81e16 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:14:16.472623  1946 consensus_meta.cc:287] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.001s
W20260709 13:14:16.483771 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 252342us
I20260709 13:14:16.456209  1832 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:16.502636 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:16.512912 30158 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.455966  1868 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:16.507115  1972 consensus_meta.cc:287] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.010s
W20260709 13:14:16.521442 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 46356.5us
I20260709 13:14:16.478724  1892 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.530782 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:16.531491 29397 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.532164 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:16.488377  1521 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.513581  1946 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.534373  1972 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.576895 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:16.573218 30158 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:14:16.585839 29539 raft_consensus.cc:2368] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:16.587419 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:16.588399 29540 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.590999 29397 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:16.593302 29544 pending_rounds.cc:85] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting all ops after (but not including) 8
I20260709 13:14:16.593629 29544 pending_rounds.cc:107] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:14:16.593860 29544 raft_consensus.cc:2889] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:16.593917  1868 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:16.594925  1974 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.595507  1836 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:14:16.599725 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:16.569248  1835 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.540908  1892 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:16.580888  2021 log.cc:927] Time spent T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:14:16.573711  1626 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:16.609543 29463 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:16.609419 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:16.621781 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 84582.6us
I20260709 13:14:16.626994 29472 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:14:16.625954  1868 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.640942  1868 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.643287  1868 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:16.656409 29540 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:16.676508 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:16.685493 29438 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:16.611256  1835 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:16.695449 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 63581.6us
I20260709 13:14:16.696373 29435 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:16.696389 29469 raft_consensus.cc:1275] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:16.619185  1626 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.724418  1971 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:16.776005 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 47426.7us
I20260709 13:14:16.786363 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:16.787185 29397 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:16.792629 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:16.793406 29396 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:16.776294  1972 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.796317  1626 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.799055 29397 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:16.784235  1924 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:16.809458 29435 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:16.815835  1924 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:16.816936  1924 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.818575 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:16.819301 29469 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:16.825212  1946 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:16.825639  1835 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.829631  1892 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:16.831626 29512 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:14:16.832876  2014 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.413s	user 0.002s	sys 0.001s
I20260709 13:14:16.834281  2006 consensus_queue.cc:1059] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:16.835250  2006 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:16.835321 30159 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:16.835762  2006 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:16.836690  2006 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.837896  2006 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.835137  2031 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:16.807289  1832 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:16.839802 29471 raft_consensus.cc:2368] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 11. Current term is 12.
I20260709 13:14:16.840170  2032 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:16.838894  2031 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.842690 29435 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:16.850952 29512 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:16.858857 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:16.859735 29396 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 9.
I20260709 13:14:16.856369 29388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 2262) took 1047 ms. Trace:
I20260709 13:14:16.867888 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:16.869807  1521 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027) with higher term. Message: Invalid argument: T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:16.860364 29388 rpcz_store.cc:276] 0709 13:14:15.809256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.809422 (+   166us) service_pool.cc:224] Handling call
0709 13:14:15.819395 (+  9973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:15.819804 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:15.819837 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:15.820304 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:14:16.193446 (+373142us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:16.193502 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.193570 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:16.832462 (+638892us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b240011e1a8. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e573a9c4 00007f61e5738acb 00007f61e58f3dc9 00007f61e58f3a55 00007f61e58f309d 00007f61e852510e 00007f61e853c88c 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221
0709 13:14:16.841031 (+  8569us) raft_consensus.cc:1685] finished
0709 13:14:16.841054 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:16.856289 (+ 15235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10900,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13556,"spinlock_wait_cycles":17251584,"thread_start_us":372817,"threads_started":1,"wal-append.queue_time_us":582608}
I20260709 13:14:16.845961  2031 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.847522  1754 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:16.862253  1605 raft_consensus.cc:2804] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:16.879127 29435 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:16.866781  1946 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:16.886801 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 198493us
I20260709 13:14:16.897881  1855 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:16.898367  1855 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.898743  1855 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.877960  1754 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.908066  1754 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:16.914359  1832 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:16.919030 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:16.883340  1946 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.922202  1946 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:16.931017 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:16.934402 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:16.935863 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:16.936482 30159 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:16.941776 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:16.942618 29396 raft_consensus.cc:2393] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 10: Already voted for candidate 88760af579b54a6393c6251aa3c6b870 in this term.
I20260709 13:14:16.955127 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:16.964896 30159 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
W20260709 13:14:16.967415 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 78340us
I20260709 13:14:16.968564 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:16.969467 29388 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:16.973528 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:16.974493 29392 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:16.887319  1605 raft_consensus.cc:697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:16.976686  1605 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:16.993495 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:17.002972 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:17.003785 29469 raft_consensus.cc:606] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:17.004151 29469 raft_consensus.cc:614] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:17.070685 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:17.077987 29438 leader_election.cc:400] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 9 election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 9. Current term is 10.
I20260709 13:14:17.076434 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:17.034157  2043 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:17.084790 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:17.085445 29540 raft_consensus.cc:3060] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.082969 29388 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.089649  1745 consensus_queue.cc:1048] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:14:17.101877 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:17.067405  2012 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:17.110301 29540 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:17.111063 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:17.111976 29541 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.112645 30126 leader_election.cc:400] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 11. Current term is 12.
I20260709 13:14:17.113027 30126 leader_election.cc:403] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:17.113925  2012 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:17.123097 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a320582e5c548dd888eb981df817079"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:17.123805 29470 raft_consensus.cc:606] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:17.106930  1990 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:17.126616  1990 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.128947  1990 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:17.123416  2031 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.130821 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:17.134516 29542 raft_consensus.cc:2368] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11.
I20260709 13:14:17.134402  2031 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:17.139870  1946 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.143734  2012 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:17.145128 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:17.159773 29544 raft_consensus.cc:2368] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 13. Current term is 14.
I20260709 13:14:17.164812  1745 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 for earlier term 11. Current term is 12.
W20260709 13:14:17.166640 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 63068.5us
W20260709 13:14:17.167981 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 55537.2us
I20260709 13:14:17.166678 29468 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:17.176338 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:17.192602 29465 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
I20260709 13:14:17.194118 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:17.220415 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:17.223287 29363 leader_election.cc:400] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 13. Current term is 14.
I20260709 13:14:17.223798 29363 leader_election.cc:403] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:17.226033 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:17.226907 29538 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:17.226752 29512 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:17.253767 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:17.254627 29390 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.263736 29512 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:17.134146  1754 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.255093 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:17.268862 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:17.190177  2012 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:17.278559 29363 leader_election.cc:400] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11.
I20260709 13:14:17.278887 29363 leader_election.cc:403] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:17.288123 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:17.289718 29472 raft_consensus.cc:2368] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 13. Current term is 14.
I20260709 13:14:17.262734  1841 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:14:17.295603 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:17.298448  1855 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.299086  1585 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:17.299598 29464 raft_consensus.cc:2368] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11.
I20260709 13:14:17.268092  1951 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:17.302731  1855 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:17.268844  1990 raft_consensus.cc:3060] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:14:17.276808  1868 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:17.303984  1868 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:17.305178  1868 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:17.282989 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 57701.6us
I20260709 13:14:17.318347 29541 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
W20260709 13:14:17.324918 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 49478.8us
I20260709 13:14:17.341598 29388 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:17.340976 29390 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:17.344656 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:17.367954  1754 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:17.369335  2058 log.cc:927] Time spent T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:14:17.374759 29435 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:17.377846  1946 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:17.307792  2012 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:17.379256 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:17.379936 29463 raft_consensus.cc:606] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:17.381328  2012 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:17.351780  1934 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11.
I20260709 13:14:17.389227  2038 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:17.389911  2038 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:17.390902  2038 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:17.391407 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:17.392175 29538 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:17.396795 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:17.399827 29363 leader_election.cc:400] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 13. Current term is 14.
I20260709 13:14:17.402737 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:17.403030 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:17.403568 29463 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 14: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:17.398146 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:17.401626 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:17.404793 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:17.404976  2031 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:17.405633  2031 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:17.401612 29363 leader_election.cc:400] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11.
I20260709 13:14:17.415122 29397 raft_consensus.cc:2393] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:17.408043  2031 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.418859 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:17.430069 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 73142.3us
I20260709 13:14:17.351423  1850 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:17.432075 29438 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:17.448164 29388 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:17.436669  2060 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.447185  1754 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.444188  1850 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.579263  1850 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:17.582931 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:17.590883  1990 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971) with higher term. Message: Invalid argument: T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 13. Current term is 14.
W20260709 13:14:17.606149 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 120266us
I20260709 13:14:17.608526  1605 raft_consensus.cc:993] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
W20260709 13:14:17.609416 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 115677us
I20260709 13:14:17.611020  2043 raft_consensus.cc:1081] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:17.617321 29392 raft_consensus.cc:2468] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 14.
I20260709 13:14:17.645861 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:17.649063 29542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a320582e5c548dd888eb981df817079"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:17.649695 29542 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:17.650138 29542 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.651259 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:17.653496 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:17.656546 29544 raft_consensus.cc:2393] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 14: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:17.659152  1990 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:17.635370  1971 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:14:17.666743 29435 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:17.667943  1521 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.673084 29544 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:17.675560 29390 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:17.691272 29438 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:17.680251 29542 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.693625 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:17.694278 29467 raft_consensus.cc:606] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:17.694630 29467 raft_consensus.cc:614] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:17.696463  1952 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:17.693650  1606 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:17.704118  1893 raft_consensus.cc:993] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:17.704571  1893 raft_consensus.cc:1081] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:17.728958  1754 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:17.740125 29537 raft_consensus.cc:1240] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:17.742136 29541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:17.742868 29541 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:17.743248 29541 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.743996 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:17.744661 29463 raft_consensus.cc:3055] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:17.744921 29463 raft_consensus.cc:740] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:17.745800 29463 consensus_queue.cc:260] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.746959 29463 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.756657 29509 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:17.757964 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:17.758610 29392 raft_consensus.cc:3060] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.760658  1841 raft_consensus.cc:2804] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:17.761301  1841 raft_consensus.cc:697] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:17.763263  1841 consensus_queue.cc:237] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.765952 29542 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:17.804111 29463 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:14:17.808565 29392 raft_consensus.cc:2468] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:14:17.786969 29541 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.813943 29295 catalog_manager.cc:5697] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 14, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 14 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.816298 29295 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 10, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.810786 29512 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:17.818177 29295 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 10 to 11, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 11 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.822253 29542 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:17.822351 29295 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.825114 29295 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 12 to 13, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 13 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.829087 29295 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.830483 29295 catalog_manager.cc:5697] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.831876 29295 catalog_manager.cc:5697] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.835678 29295 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 11, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.836988 29295 catalog_manager.cc:5697] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 7 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.838397 29295 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.839959 29295 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 9, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 9 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.842820 29295 catalog_manager.cc:5697] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.843672 29541 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:17.844774 29295 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.846067 29295 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 14, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 14 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.847398 29295 catalog_manager.cc:5697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 4 to 6, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 6 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.848662 29295 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.852502 29295 catalog_manager.cc:5697] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.824461  2031 raft_consensus.cc:2804] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:17.856760 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:17.856487 29295 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 12 to 13, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 13 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.857385 29392 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.857846 29295 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 11, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.862071 29295 catalog_manager.cc:5697] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index -1 to 8, term changed from 5 to 11, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 11 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:17.868501 29295 catalog_manager.cc:5697] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 13, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 13 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.889523  2045 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:17.895359 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:17.896075 29463 raft_consensus.cc:3055] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:17.896368 29463 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:17.897176 29463 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:17.966084 29396 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:17.967499 29292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 286) took 29449 ms (client timeout 15000 ms). Trace:
I20260709 13:14:18.000290 29392 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:18.010031 29541 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:14:17.967984 29292 rpcz_store.cc:269] 0709 13:13:48.517959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.518463 (+   504us) service_pool.cc:224] Handling call
0709 13:14:17.967401 (+29448938us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:16.649344 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:16.650045 (+   701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:16.650087 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:14:16.650111 (+    24us) tablet.cc:662] Decoding operations
0709 13:14:16.651101 (+   990us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:16.651189 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:16.651231 (+    42us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:14:16.697275 (+ 46044us) tablet.cc:701] Row locks acquired
0709 13:14:16.710628 (+ 13353us) write_op.cc:260] PREPARE: finished
0709 13:14:16.722198 (+ 11570us) write_op.cc:270] Start()
0709 13:14:16.729493 (+  7295us) write_op.cc:276] Timestamp: P: 1783602856722089 usec, L: 0
0709 13:14:16.730710 (+  1217us) op_driver.cc:348] REPLICATION: starting
0709 13:14:16.792597 (+ 61887us) log.cc:844] Serialized 3262 byte log entry
0709 13:14:16.818489 (+ 25892us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e58970ac 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b3c02 00007f61e853b20b
0709 13:14:17.015065 (+196576us) op_driver.cc:464] REPLICATION: finished
0709 13:14:17.077115 (+ 62050us) write_op.cc:301] APPLY: starting
0709 13:14:17.077226 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:17.191015 (+113789us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:17.192867 (+  1852us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:17.369287 (+176420us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:17.369562 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:14:17.369607 (+    45us) write_op.cc:312] APPLY: finished
0709 13:14:17.369882 (+   275us) log.cc:844] Serialized 81 byte log entry
0709 13:14:17.370074 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:17.370226 (+   152us) write_op.cc:454] Released schema lock
0709 13:14:17.370291 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:17.428428 (+ 58137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:17.432913 (+  4485us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22602,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":61738,"apply.run_cpu_time_us":13701,"apply.run_wall_time_us":341660,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37487,"num_ops":8,"prepare.queue_time_us":97465,"prepare.run_cpu_time_us":21925,"prepare.run_wall_time_us":216193,"raft.queue_time_us":159450,"raft.run_cpu_time_us":13628,"raft.run_wall_time_us":74200,"replication_time_us":284144,"spinlock_wait_cycles":5176576,"thread_start_us":273466,"threads_started":4,"wal-append.queue_time_us":60433}]]}
I20260709 13:14:18.010481  2031 raft_consensus.cc:697] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:18.037708  2060 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:14:18.038069  2045 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:14:18.084903 29467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:18.085793 29467 raft_consensus.cc:606] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:18.086122 29467 raft_consensus.cc:614] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:18.100304 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 70595.8us
I20260709 13:14:18.114414 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:18.116468 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:18.117093 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:18.150372 29467 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:18.163245  1951 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:18.195178  2071 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:14:18.195178  2072 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:14:18.130519  2031 consensus_queue.cc:237] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:18.224845  2073 log.cc:927] Time spent T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.148s	user 0.000s	sys 0.003s
I20260709 13:14:18.278082 29463 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:18.343946 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 212780us
W20260709 13:14:18.361227 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 177429us
I20260709 13:14:18.341615  1966 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:18.367587  1966 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:18.370111  1966 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:18.378252 29436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.391332 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:18.392117 29543 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:18.391235 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:18.401701 29463 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:18.420253  2060 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:18.435330 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 229709us
I20260709 13:14:18.366686  1951 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:18.431316 29466 raft_consensus.cc:2393] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 10: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:18.440212 29394 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:18.448693 29466 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:14:18.466759 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 104416us
I20260709 13:14:18.475476 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:18.525776 30159 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:18.505245  2035 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:18.539451 29463 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:18.539945  1841 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:18.547643 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 53690.4us
I20260709 13:14:18.544847  2035 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:18.569584 29394 raft_consensus.cc:1275] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:18.562776  2012 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:14:18.569577  2035 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:18.550386  2093 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:14:18.553989  1951 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:18.631110  2045 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:18.682619 29392 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:18.651978  1841 consensus_queue.cc:1048] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:14:18.718593 29541 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:18.722482  2097 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:14:18.723047  1995 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:18.749364  1952 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.779268  1952 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:18.865355  2072 log.cc:927] Time spent T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:14:18.867479  2102 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:14:18.902132  1952 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:18.923416 29390 raft_consensus.cc:1275] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:18.928404 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:18.929334 29541 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
W20260709 13:14:18.934150  2111 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:18.952179 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:18.971673 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:18.973325  2044 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:18.973793  2044 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.974151  2044 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:18.977591  2080 consensus_queue.cc:1048] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:14:18.965783  2035 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:19.034250 29396 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:19.096663  2035 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:19.100152  2111 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:14:19.111027 29463 raft_consensus.cc:1275] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:19.113850 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:19.117087 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:19.147713 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:19.152834 29389 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:19.169179 29541 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:19.146732  2080 consensus_queue.cc:1048] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:14:19.174598 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:19.185925  2034 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:19.187480  2034 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:19.188495  2034 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:19.180194  2093 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:14:19.182021  2044 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:19.243742  2044 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:19.246991 29468 raft_consensus.cc:2368] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11.
I20260709 13:14:19.250222 29363 leader_election.cc:400] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Vote denied by peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713) with higher term. Message: Invalid argument: T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11.
I20260709 13:14:19.253479 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:14:19.253921  2119 log.cc:927] Time spent T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:14:19.254199  2118 log.cc:927] Time spent T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
I20260709 13:14:19.272424 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:19.273198 29542 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:19.301059 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 118277us
I20260709 13:14:19.319258 29542 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
W20260709 13:14:19.447672 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 136348us
W20260709 13:14:19.448549  2091 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.151s	user 0.000s	sys 0.016s
I20260709 13:14:19.356321 29467 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:19.470108  2122 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:19.494269 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 177976us
W20260709 13:14:19.494787 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 175289us
W20260709 13:14:19.542742 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 43861.8us
I20260709 13:14:19.546756 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:19.572464  2126 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:19.575313  2126 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:19.576396  2126 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:19.925608 29538 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:19.932446 29467 raft_consensus.cc:1240] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Rejecting Update request from peer 88760af579b54a6393c6251aa3c6b870 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:19.933967  2136 consensus_queue.cc:1059] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:19.935925  2134 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:19.936393  2134 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:19.937839  2134 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:19.942166  2134 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:20.130797 29295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 180) took 3639 ms. Trace:
W20260709 13:14:20.133095 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 57001.1us
I20260709 13:14:20.120429 29291 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 11, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:20.131572 29295 rpcz_store.cc:276] 0709 13:14:16.491094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.491264 (+   170us) service_pool.cc:224] Handling call
0709 13:14:20.130529 (+3639265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:18.148197 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:18.194963 (+ 46766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:18.195015 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:14:18.195036 (+    21us) tablet.cc:662] Decoding operations
0709 13:14:18.197345 (+  2309us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:18.197430 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:18.197480 (+    50us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:14:18.480388 (+282908us) tablet.cc:701] Row locks acquired
0709 13:14:18.480407 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:14:18.480628 (+   221us) write_op.cc:270] Start()
0709 13:14:18.480771 (+   143us) write_op.cc:276] Timestamp: P: 1783602858480531 usec, L: 0
0709 13:14:18.480791 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:18.481684 (+   893us) log.cc:844] Serialized 8838 byte log entry
0709 13:14:18.894782 (+413098us) op_driver.cc:464] REPLICATION: finished
0709 13:14:19.090798 (+196016us) write_op.cc:301] APPLY: starting
0709 13:14:19.090929 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:19.459248 (+368319us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:19.459372 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:19.685750 (+226378us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:19.686489 (+   739us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 13:14:19.686592 (+   103us) write_op.cc:312] APPLY: finished
0709 13:14:19.687545 (+   953us) log.cc:844] Serialized 196 byte log entry
0709 13:14:19.720288 (+ 32743us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:19.721070 (+   782us) write_op.cc:454] Released schema lock
0709 13:14:19.721183 (+   113us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:19.727184 (+  6001us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:19.727236 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4549,"reported_tablets":26,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":195564,"apply.run_cpu_time_us":44280,"apply.run_wall_time_us":636106,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95867,"num_ops":22,"prepare.queue_time_us":239063,"prepare.run_cpu_time_us":34226,"prepare.run_wall_time_us":422145,"raft.queue_time_us":135977,"raft.run_cpu_time_us":25851,"raft.run_wall_time_us":154613,"replication_time_us":390618,"thread_start_us":389779,"threads_started":4,"wal-append.queue_time_us":88175}]]}
I20260709 13:14:20.136389 29291 catalog_manager.cc:5697] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:20.151990 29545 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:20.152274 29394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133108182cae493ab908290bfa9179d1"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58006
I20260709 13:14:20.153261 29394 raft_consensus.cc:606] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Received request to transfer leadership
I20260709 13:14:20.161865 29397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133108182cae493ab908290bfa9179d1"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58006
I20260709 13:14:20.162475 29397 raft_consensus.cc:606] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Received request to transfer leadership
I20260709 13:14:20.162993  2088 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:20.166056 29279 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 133108182cae493ab908290bfa9179d1 already in progress [suppressed 5 similar messages]
I20260709 13:14:20.147513 29291 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 5 to 8, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 8 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:20.182265 29291 catalog_manager.cc:5697] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.207150 29395 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:14:20.207614 29395 pending_rounds.cc:85] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Aborting all ops after (but not including) 6
I20260709 13:14:20.207880 29395 pending_rounds.cc:107] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:14:20.208165 29395 raft_consensus.cc:2889] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:20.212460 29397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133108182cae493ab908290bfa9179d1"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58006
I20260709 13:14:20.213328 29397 raft_consensus.cc:606] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Received request to transfer leadership
I20260709 13:14:20.218021 29291 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.224881  2140 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:20.229984 29291 catalog_manager.cc:5697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.271301 29291 catalog_manager.cc:5697] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.276738 29291 catalog_manager.cc:5697] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 3 to 10, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
W20260709 13:14:20.310560 29343 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:14:20.311136 29343 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 133108182cae493ab908290bfa9179d1 already in progress
W20260709 13:14:20.311436 29343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 133108182cae493ab908290bfa9179d1 already in progress
I20260709 13:14:20.305382 29291 catalog_manager.cc:5697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.313169 29291 catalog_manager.cc:5697] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.334786 29291 catalog_manager.cc:5697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.343169 29291 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.363720 29291 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.391075 29291 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.399884 29291 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.421836 29291 catalog_manager.cc:5697] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.432065 29291 catalog_manager.cc:5697] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.442063 29291 catalog_manager.cc:5697] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 7 to 10, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:20.444005 29291 catalog_manager.cc:5697] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.456863 29291 catalog_manager.cc:5697] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.468601 29291 catalog_manager.cc:5697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.478251 29291 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.495750 29291 catalog_manager.cc:5697] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 4 to 6, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 6 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.498040 29291 catalog_manager.cc:5697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.512437  1966 raft_consensus.cc:993] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:14:20.513514  1934 raft_consensus.cc:1081] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:14:20.520756 29472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "133108182cae493ab908290bfa9179d1"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59298
I20260709 13:14:20.521438 29472 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:20.521800 29472 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:20.575912 29472 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:20.616137 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:20.618050 29397 raft_consensus.cc:3055] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:20.618543 29397 raft_consensus.cc:740] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:20.619663 29397 consensus_queue.cc:260] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:20.630016 29397 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:20.633095 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:20.633970 29545 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:20.635004 29472 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:20.637832 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:20.638751 30159 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:20.674152 30159 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:20.676462 29545 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:20.710080 29438 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:20.711432  1924 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:20.714203 29397 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:20.714991  1924 raft_consensus.cc:697] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:20.716380  1924 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:20.933466 29291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 286) took 8293 ms. Trace:
I20260709 13:14:20.939579 29291 rpcz_store.cc:276] 0709 13:14:12.640271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.640473 (+   202us) service_pool.cc:224] Handling call
0709 13:14:20.933332 (+8292859us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:20.609030 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:20.613693 (+  4663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:20.613752 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:14:20.613776 (+    24us) tablet.cc:662] Decoding operations
0709 13:14:20.634808 (+ 21032us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:20.634934 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:20.634973 (+    39us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:14:20.637539 (+  2566us) tablet.cc:701] Row locks acquired
0709 13:14:20.637594 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:14:20.637828 (+   234us) write_op.cc:270] Start()
0709 13:14:20.638010 (+   182us) write_op.cc:276] Timestamp: P: 1783602860637742 usec, L: 0
0709 13:14:20.638033 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:20.640708 (+  2675us) log.cc:844] Serialized 9529 byte log entry
0709 13:14:20.678174 (+ 37466us) op_driver.cc:464] REPLICATION: finished
0709 13:14:20.725798 (+ 47624us) write_op.cc:301] APPLY: starting
0709 13:14:20.725986 (+   188us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:20.789821 (+ 63835us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:20.789954 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:20.866177 (+ 76223us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:20.866550 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 13:14:20.866601 (+    51us) write_op.cc:312] APPLY: finished
0709 13:14:20.867095 (+   494us) log.cc:844] Serialized 212 byte log entry
0709 13:14:20.870667 (+  3572us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:20.870949 (+   282us) write_op.cc:454] Released schema lock
0709 13:14:20.871023 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:20.882783 (+ 11760us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:20.882816 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71608,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":19716,"apply.run_cpu_time_us":35520,"apply.run_wall_time_us":156964,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104207,"num_ops":24,"prepare.queue_time_us":84783,"prepare.run_cpu_time_us":8236,"prepare.run_wall_time_us":35349,"replication_time_us":39874,"thread_start_us":76527,"threads_started":2}]]}
I20260709 13:14:21.003463 29290 catalog_manager.cc:5697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 5 to 9, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 9 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.019215 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:21.056582 29295 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 13, leader changed from c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 13 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:21.058524 29295 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:21.060122 29295 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:21.130118 29394 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:21.132432  1924 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:21.159904 30159 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:21.163600  1754 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:21.198143 29542 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:21.201988 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:21.202919 29472 raft_consensus.cc:606] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:21.206189  2140 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:21.219900 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a320582e5c548dd888eb981df817079"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:21.220589 29472 raft_consensus.cc:606] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:21.221041 29472 raft_consensus.cc:614] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:21.241130 29472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:21.242089 29472 raft_consensus.cc:606] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:21.282549 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:21.283324 29463 raft_consensus.cc:606] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:21.298800 29463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:21.299505 29463 raft_consensus.cc:606] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:21.299505  2154 log.cc:927] Time spent T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:14:21.308543 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:21.328742 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:21.365728 29290 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 299) took 11618 ms (client timeout 15000 ms). Trace:
I20260709 13:14:21.393885  2140 raft_consensus.cc:993] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:21.401733  2140 raft_consensus.cc:1081] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:21.403712 30159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:14:21.404755 30159 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.405170 30159 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:21.366348 29290 rpcz_store.cc:269] 0709 13:14:09.746991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.756908 (+  9917us) service_pool.cc:224] Handling call
0709 13:14:21.365621 (+11608713us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:21.029691 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:21.030298 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:21.030334 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:14:21.030352 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:21.030796 (+   444us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:21.030873 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:21.030904 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:21.031121 (+   217us) tablet.cc:701] Row locks acquired
0709 13:14:21.031140 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:14:21.031316 (+   176us) write_op.cc:270] Start()
0709 13:14:21.031446 (+   130us) write_op.cc:276] Timestamp: P: 1783602861031257 usec, L: 0
0709 13:14:21.031469 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:21.032239 (+   770us) log.cc:844] Serialized 540 byte log entry
0709 13:14:21.034966 (+  2727us) op_driver.cc:464] REPLICATION: finished
0709 13:14:21.035332 (+   366us) write_op.cc:301] APPLY: starting
0709 13:14:21.035431 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:21.036481 (+  1050us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:21.038557 (+  2076us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:21.039670 (+  1113us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:21.039945 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:14:21.039996 (+    51us) write_op.cc:312] APPLY: finished
0709 13:14:21.040212 (+   216us) log.cc:844] Serialized 25 byte log entry
0709 13:14:21.041193 (+   981us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.041299 (+   106us) write_op.cc:454] Released schema lock
0709 13:14:21.041349 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:21.041811 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.041851 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7410,"reported_tablets":49,"spinlock_wait_cycles":244096,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":3546,"apply.run_wall_time_us":6409,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4170,"num_ops":1,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":2923,"prepare.run_wall_time_us":2937,"replication_time_us":3324}]]}
I20260709 13:14:21.429378 30159 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:21.452523 30159 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:21.454396 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:21.455214 29472 raft_consensus.cc:3055] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:21.455546 29472 raft_consensus.cc:740] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:21.456460 29472 consensus_queue.cc:260] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:21.457777 29472 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.463960 29295 catalog_manager.cc:5697] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 11 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:21.474139 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 55354.5us
I20260709 13:14:21.476145 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:21.476843 29395 raft_consensus.cc:3060] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:21.500540 29293 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 285) took 25836 ms (client timeout 15000 ms). Trace:
I20260709 13:14:21.502283 29395 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:21.522727 30123 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:21.524206  2008 raft_consensus.cc:2804] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:21.526968  2088 raft_consensus.cc:993] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:21.527640  2088 raft_consensus.cc:1081] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:21.529678 30155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:14:21.530215 30155 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.530586 30155 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:21.531718 29293 rpcz_store.cc:269] 0709 13:13:55.664017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.664395 (+   378us) service_pool.cc:224] Handling call
0709 13:14:21.500232 (+25835837us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106094,"reported_tablets":50}
I20260709 13:14:21.538550 29472 raft_consensus.cc:2468] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:21.539695  2008 raft_consensus.cc:697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:21.547904  2008 consensus_queue.cc:237] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:21.555159 30155 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:21.562049 30155 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:21.562161 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:21.563612 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:21.563861 29395 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.564273 29463 raft_consensus.cc:3055] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:21.564633 29463 raft_consensus.cc:740] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:21.565747 29463 consensus_queue.cc:260] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:21.567940 29463 raft_consensus.cc:3060] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.573606 29395 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:21.591645 30123 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:21.593307  2008 raft_consensus.cc:2804] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:21.593911  2008 raft_consensus.cc:697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:21.594355 29463 raft_consensus.cc:2468] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:21.594978  2008 consensus_queue.cc:237] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:21.575799 29294 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 298) took 32120 ms (client timeout 15000 ms). Trace:
I20260709 13:14:21.584590  2140 raft_consensus.cc:993] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:21.604394  2140 raft_consensus.cc:1081] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:21.587205 29289 catalog_manager.cc:5697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.616946 29542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:21.619342 29542 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.621680 29542 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:21.603127 29294 rpcz_store.cc:269] 0709 13:13:49.455196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.455488 (+   292us) service_pool.cc:224] Handling call
0709 13:14:21.575552 (+32120064us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109163,"reported_tablets":49}
I20260709 13:14:21.672775 29542 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:21.686405 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:21.687150 29395 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:21.703442  1605 raft_consensus.cc:993] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:21.704231  1605 raft_consensus.cc:1081] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:21.710391 29542 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:21.710637 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:21.711341 29463 raft_consensus.cc:3055] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:21.711649 29463 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:21.712319 29395 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:14:21.712550 29463 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:21.714265 29463 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:21.714839 29509 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:21.714465 29291 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 9 to 11, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.715993  2150 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:21.722852  2150 raft_consensus.cc:697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:21.723852 29463 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 6.
I20260709 13:14:21.723896  2150 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:21.721196 29542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:21.730392 29542 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.737136 29542 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.763564 29291 catalog_manager.cc:5697] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 10 to 11, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.765479 29291 catalog_manager.cc:5697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.767694 29291 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 12 to 13, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 13 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.777488 29542 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:21.769522 29291 catalog_manager.cc:5697] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 11 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.793270 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:21.794170 29395 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.804595 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:21.805387 29472 raft_consensus.cc:3055] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:21.805678 29472 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:21.806516 29472 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:21.810038 29472 raft_consensus.cc:3060] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.820050 29542 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:21.822378 29291 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.824479 29291 catalog_manager.cc:5697] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 6 to 7, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 7 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.826225 29291 catalog_manager.cc:5697] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 10 to 11, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.827922 29291 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.833470 29395 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:21.838160 29472 raft_consensus.cc:2468] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:21.846980 29289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 287) took 10084 ms. Trace:
I20260709 13:14:21.847798 29291 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.862200 29512 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:21.861953 29291 catalog_manager.cc:5697] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 12 to 14, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 14 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.863269  2150 raft_consensus.cc:2804] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:21.863902  2150 raft_consensus.cc:697] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:21.863718 29291 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:21.865008  2150 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:21.855541 29463 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:21.867568 29289 rpcz_store.cc:276] 0709 13:14:11.762777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.765451 (+  2674us) service_pool.cc:224] Handling call
0709 13:14:21.846890 (+10081439us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:21.672629 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:21.673241 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:21.673290 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:14:21.673304 (+    14us) tablet.cc:662] Decoding operations
0709 13:14:21.673682 (+   378us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:21.673743 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:21.673773 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:21.673993 (+   220us) tablet.cc:701] Row locks acquired
0709 13:14:21.674006 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:14:21.674166 (+   160us) write_op.cc:270] Start()
0709 13:14:21.674289 (+   123us) write_op.cc:276] Timestamp: P: 1783602861674107 usec, L: 0
0709 13:14:21.674306 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:14:21.675053 (+   747us) log.cc:844] Serialized 540 byte log entry
0709 13:14:21.677876 (+  2823us) op_driver.cc:464] REPLICATION: finished
0709 13:14:21.678378 (+   502us) write_op.cc:301] APPLY: starting
0709 13:14:21.678487 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:21.679489 (+  1002us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:21.679599 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:21.680397 (+   798us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:21.680584 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:14:21.680642 (+    58us) write_op.cc:312] APPLY: finished
0709 13:14:21.680845 (+   203us) log.cc:844] Serialized 25 byte log entry
0709 13:14:21.681006 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.681098 (+    92us) write_op.cc:454] Released schema lock
0709 13:14:21.681159 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:21.681568 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.681616 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":230735,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":259,"apply.run_cpu_time_us":3176,"apply.run_wall_time_us":3176,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4170,"num_ops":1,"prepare.queue_time_us":7422,"prepare.run_cpu_time_us":2758,"prepare.run_wall_time_us":2758,"replication_time_us":3440}]]}
I20260709 13:14:21.906747 29542 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:14:21.907620 29435 consensus_peers.cc:597] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07f0ebecfce24837b2bbdbea5b0b6b8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.908016 29395 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:21.909482  1605 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:21.915920  2088 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:21.973454  1754 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:21.986672 29463 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:21.995851  2158 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:22.027984 29544 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:22.030303 29545 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:22.178733 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 57991.5us
I20260709 13:14:22.183308 29393 raft_consensus.cc:1275] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:22.183614 29396 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:14:22.186044  2158 consensus_queue.cc:1048] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:22.187772  2158 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:22.195549 29295 catalog_manager.cc:5697] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 13 to 14, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 14 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.234581 29472 raft_consensus.cc:1275] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:14:22.240926 29464 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:14:22.245589 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 224535us
I20260709 13:14:22.275259  1951 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:22.307173 29397 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:22.316469 29392 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:22.316283  2167 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:22.322130  2167 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:14:22.376812 29467 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:22.421414  2167 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:14:22.434054 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 53195.5us
W20260709 13:14:22.456547 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 495c8d0b86f84e95b022820009da4795. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.462150 29392 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:22.515069  2187 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:22.563720 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 128657us
W20260709 13:14:22.569413 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 86878.4us
I20260709 13:14:22.580103  2199 consensus_queue.cc:1048] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:14:22.660095 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 49656.2us
W20260709 13:14:22.653407 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 187776us
I20260709 13:14:22.647311 29393 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:14:22.718597 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 73349.6us
W20260709 13:14:22.749536 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 135229us
W20260709 13:14:22.841336 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 109213us
I20260709 13:14:22.864279 29463 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:14:22.887435 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 214972us
W20260709 13:14:22.991421 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74314.1us
W20260709 13:14:22.999063 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 44730.3us
I20260709 13:14:23.007802  2193 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:22.337121 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:23.029565 29295 catalog_manager.cc:5697] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 13 to 14, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 14 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:23.038234  2214 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:14:23.088155  2222 ts_tablet_manager.cc:933] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:23.071744 29392 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.098016 29291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 287) took 2001 ms. Trace:
I20260709 13:14:23.107126 29291 rpcz_store.cc:276] 0709 13:14:21.096559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.097139 (+   580us) service_pool.cc:224] Handling call
0709 13:14:23.097906 (+2000767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:21.874127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:21.874948 (+   821us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:21.874992 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:14:21.875014 (+    22us) tablet.cc:662] Decoding operations
0709 13:14:21.876327 (+  1313us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:21.876401 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:21.876434 (+    33us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:14:21.877567 (+  1133us) tablet.cc:701] Row locks acquired
0709 13:14:21.877585 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:14:21.877762 (+   177us) write_op.cc:270] Start()
0709 13:14:21.877901 (+   139us) write_op.cc:276] Timestamp: P: 1783602861877705 usec, L: 0
0709 13:14:21.877920 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:14:21.879377 (+  1457us) log.cc:844] Serialized 4842 byte log entry
0709 13:14:21.882583 (+  3206us) op_driver.cc:464] REPLICATION: finished
0709 13:14:21.883175 (+   592us) write_op.cc:301] APPLY: starting
0709 13:14:21.883280 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:21.890202 (+  6922us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:21.890322 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:21.972163 (+ 81841us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:21.972455 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:14:21.972508 (+    53us) write_op.cc:312] APPLY: finished
0709 13:14:21.972922 (+   414us) log.cc:844] Serialized 113 byte log entry
0709 13:14:21.987656 (+ 14734us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.987893 (+   237us) write_op.cc:454] Released schema lock
0709 13:14:21.987964 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:21.990763 (+  2799us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.990811 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110769,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":356,"apply.run_cpu_time_us":17258,"apply.run_wall_time_us":107499,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50040,"num_ops":12,"prepare.queue_time_us":2687,"prepare.run_cpu_time_us":4854,"prepare.run_wall_time_us":17522,"replication_time_us":4454}]]}
I20260709 13:14:23.137636  2223 ts_tablet_manager.cc:933] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:23.247844  2193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51814 (request call id 15) took 1220 ms. Trace:
I20260709 13:14:23.248553  2193 rpcz_store.cc:276] 0709 13:14:22.027207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.027430 (+   223us) service_pool.cc:224] Handling call
0709 13:14:22.258230 (+230800us) log.cc:844] Serialized 513 byte log entry
0709 13:14:22.758052 (+499822us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b54003555a0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e891a142 00007f61e88faeaa 00007f61e8901d53 00007f61e8901cd9 00007f61e8901c69 00007f61e8901c31 00007f61e8900dfd 000000000038f354 000000000038f199 00007f61e58b4475
0709 13:14:23.247682 (+489630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1303,"raft.queue_time_us":49183,"raft.run_cpu_time_us":5165,"raft.run_wall_time_us":411732,"spinlock_wait_cycles":12607104,"thread_start_us":199144,"threads_started":2,"wal-append.queue_time_us":93699}
I20260709 13:14:23.219254  2222 tablet_copy_client.cc:323] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:14:23.301739 29468 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:14:23.313493 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08003013c0 after lost signal to thread 28253
W20260709 13:14:23.315203 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08002fda60 after lost signal to thread 29329
W20260709 13:14:23.317010 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd560 after lost signal to thread 29421
W20260709 13:14:23.318529 29567 debug-util.cc:398] Leaking SignalData structure 0x7b080018ad80 after lost signal to thread 29496
W20260709 13:14:23.319975 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7020 after lost signal to thread 29570
W20260709 13:14:23.320235 29567 debug-util.cc:398] Leaking SignalData structure 0x7b0800304e00 after lost signal to thread 29571
W20260709 13:14:23.322588 29567 debug-util.cc:398] Leaking SignalData structure 0x7b080039e9e0 after lost signal to thread 30184
W20260709 13:14:23.322860 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6a40 after lost signal to thread 30185
I20260709 13:14:23.346419 29392 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:23.358274 29290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 300) took 1837 ms. Trace:
I20260709 13:14:23.358801 29290 rpcz_store.cc:276] 0709 13:14:21.520843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.521051 (+   208us) service_pool.cc:224] Handling call
0709 13:14:23.358194 (+1837143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61654,"reported_tablets":32}
I20260709 13:14:23.326895  2223 tablet_copy_client.cc:323] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:14:23.367949 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:14:23.368623 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 07f0ebecfce24837b2bbdbea5b0b6b8f from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-07f0ebecfce24837b2bbdbea5b0b6b8f
I20260709 13:14:23.373258 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 495c8d0b86f84e95b022820009da4795 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:14:23.373966 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 495c8d0b86f84e95b022820009da4795 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-495c8d0b86f84e95b022820009da4795
I20260709 13:14:23.417506 29538 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:23.417990 29468 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:23.421443  1850 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:14:23.418200 29360 consensus_peers.cc:597] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f9e543a8422407185dcc0cc54131e92. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.423609  2213 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:23.428354 29481 tablet_copy_source_session.cc:215] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.435452  2222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.454948 29556 tablet_copy_source_session.cc:215] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.466105  2223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495c8d0b86f84e95b022820009da4795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.510924  2213 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.517040  2223 tablet_copy_client.cc:806] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.517609 29545 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.518473 29469 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.537384 29295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 184) took 1829 ms. Trace:
I20260709 13:14:23.537916 29295 rpcz_store.cc:276] 0709 13:14:21.708132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.708311 (+   179us) service_pool.cc:224] Handling call
0709 13:14:23.537296 (+1828985us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:23.309361 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:23.380890 (+ 71529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:23.380941 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:14:23.380963 (+    22us) tablet.cc:662] Decoding operations
0709 13:14:23.381451 (+   488us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:23.381543 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:23.381575 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:23.381918 (+   343us) tablet.cc:701] Row locks acquired
0709 13:14:23.381939 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:14:23.382123 (+   184us) write_op.cc:270] Start()
0709 13:14:23.382260 (+   137us) write_op.cc:276] Timestamp: P: 1783602863382067 usec, L: 0
0709 13:14:23.382283 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:23.383098 (+   815us) log.cc:844] Serialized 925 byte log entry
0709 13:14:23.479663 (+ 96565us) op_driver.cc:464] REPLICATION: finished
0709 13:14:23.510024 (+ 30361us) write_op.cc:301] APPLY: starting
0709 13:14:23.510141 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:23.528406 (+ 18265us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:23.528514 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:23.529942 (+  1428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:23.534418 (+  4476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:14:23.534485 (+    67us) write_op.cc:312] APPLY: finished
0709 13:14:23.534717 (+   232us) log.cc:844] Serialized 33 byte log entry
0709 13:14:23.534928 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:23.535039 (+   111us) write_op.cc:454] Released schema lock
0709 13:14:23.535089 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:23.535520 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:23.535552 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":995176,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":30051,"apply.run_cpu_time_us":5125,"apply.run_wall_time_us":25499,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"num_ops":2,"prepare.queue_time_us":250264,"prepare.run_cpu_time_us":9819,"prepare.run_wall_time_us":95429,"raft.queue_time_us":46589,"raft.run_cpu_time_us":9837,"raft.run_wall_time_us":20132,"replication_time_us":97162,"thread_start_us":251565,"threads_started":4,"wal-append.queue_time_us":26963}]]}
I20260709 13:14:23.550267 29289 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 11 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:23.563302  2223 tablet_copy_client.cc:670] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.570755  2223 tablet_copy_client.cc:538] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.575520  2222 tablet_copy_client.cc:806] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.590186  2222 tablet_copy_client.cc:670] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.619982 29291 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.622117 29291 catalog_manager.cc:5697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 5 to 6, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 6 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:23.630537  2222 tablet_copy_client.cc:538] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.629911 29545 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:23.674646  2223 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:23.678838 29290 catalog_manager.cc:5697] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 5, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 7 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.682399 29469 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:23.684113 29392 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:23.684273  2205 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:23.686657  2205 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:23.690821  2222 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
W20260709 13:14:23.698377 29509 consensus_peers.cc:597] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d01483a998944f4386fc5dfa1f0fd51a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.727437  2214 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.732038 29468 consensus_queue.cc:237] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:23.736385 29392 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.750624 29291 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 13 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.766209 29469 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.852262 30151 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:23.850237 29291 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 10 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:23.864192 29537 raft_consensus.cc:1275] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:23.873607  2218 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:14:23.884500  2172 consensus_queue.cc:1048] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:23.943091  2204 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:23.941742 29545 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:23.977830 30159 raft_consensus.cc:2955] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:23.985461  2223 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.992448  2223 tablet_bootstrap.cc:492] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:23.993351  2223 ts_tablet_manager.cc:1403] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.339s	user 0.056s	sys 0.017s
I20260709 13:14:24.005844  2223 raft_consensus.cc:359] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:24.016970  2223 raft_consensus.cc:740] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:24.017760  2223 consensus_queue.cc:260] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:24.023895  2242 ts_tablet_manager.cc:933] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027)
I20260709 13:14:24.040587  2242 tablet_copy_client.cc:323] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.129:42027
I20260709 13:14:24.039182  2222 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.045480  2222 tablet_bootstrap.cc:492] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:24.052420  2223 ts_tablet_manager.cc:1434] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.001s
I20260709 13:14:24.054667  2222 ts_tablet_manager.cc:1403] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.364s	user 0.033s	sys 0.006s
I20260709 13:14:24.058754  2222 raft_consensus.cc:359] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:24.059967  2222 raft_consensus.cc:740] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:24.060724  2222 consensus_queue.cc:260] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:24.064301 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-495c8d0b86f84e95b022820009da4795 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:14:24.065126 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-495c8d0b86f84e95b022820009da4795 on tablet 495c8d0b86f84e95b022820009da4795 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:24.063867  2222 ts_tablet_manager.cc:1434] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:24.101078 29407 tablet_copy_service.cc:140] P 88760af579b54a6393c6251aa3c6b870: Received BeginTabletCopySession request for tablet 9f9e543a8422407185dcc0cc54131e92 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:47726)
I20260709 13:14:24.101835 29407 tablet_copy_service.cc:161] P 88760af579b54a6393c6251aa3c6b870: Beginning new tablet copy session on tablet 9f9e543a8422407185dcc0cc54131e92 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:47726: session id = c65265f20d7e42b6bfe314c5d109bdf7-9f9e543a8422407185dcc0cc54131e92
I20260709 13:14:24.114296 29407 tablet_copy_source_session.cc:215] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:24.153239 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:24.154881 29291 catalog_manager.cc:5697] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 8 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:24.185705 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 133108182cae493ab908290bfa9179d1 with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:58006
I20260709 13:14:24.216313 30159 raft_consensus.cc:1217] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:14:24.233469 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 133108182cae493ab908290bfa9179d1 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:24.248916  2247 tablet_replica.cc:333] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:24.250413  2247 raft_consensus.cc:2243] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:24.252489  2247 raft_consensus.cc:2272] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:24.262753 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-07f0ebecfce24837b2bbdbea5b0b6b8f received from {username='slave'} at 127.0.0.1:39036
I20260709 13:14:24.263391 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-07f0ebecfce24837b2bbdbea5b0b6b8f on tablet 07f0ebecfce24837b2bbdbea5b0b6b8f with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:24.264156  2247 ts_tablet_manager.cc:1916] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:24.290385 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 219710us
I20260709 13:14:24.304316  2222 ts_tablet_manager.cc:933] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:24.320760  2242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9e543a8422407185dcc0cc54131e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.362926  2222 tablet_copy_client.cc:323] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:14:24.365475 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet d01483a998944f4386fc5dfa1f0fd51a from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:14:24.366335 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet d01483a998944f4386fc5dfa1f0fd51a from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-d01483a998944f4386fc5dfa1f0fd51a
I20260709 13:14:24.477660  2242 tablet_copy_client.cc:806] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:24.479120  2242 tablet_copy_client.cc:670] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
W20260709 13:14:24.549904 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 85264.6us
I20260709 13:14:24.571637 29556 tablet_copy_source_session.cc:215] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:24.513105  2247 ts_tablet_manager.cc:1929] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:14:24.594257  2222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01483a998944f4386fc5dfa1f0fd51a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:24.596541 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 45737.2us
I20260709 13:14:24.584928  2247 log.cc:1199] T 133108182cae493ab908290bfa9179d1 P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/133108182cae493ab908290bfa9179d1
I20260709 13:14:24.604717 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 133108182cae493ab908290bfa9179d1 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:24.609524 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea2318003a42fea9088b490db583f1"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:24.610215 29468 raft_consensus.cc:606] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:24.637097 30152 raft_consensus.cc:1217] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:14:24.707460 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:24.708179 29468 raft_consensus.cc:606] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:24.736390  2242 tablet_copy_client.cc:538] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:14:24.825619 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 119190us
W20260709 13:14:24.830897 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 56561us
I20260709 13:14:24.973093  2256 raft_consensus.cc:993] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:14:24.973750  2256 raft_consensus.cc:1081] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:14:24.987174  2242 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:25.005822 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57af445de910412cb7903ef2bf682013"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:25.006619 29469 raft_consensus.cc:606] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:25.037052 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 113911us
I20260709 13:14:25.064124 29395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ea2318003a42fea9088b490db583f1"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:14:25.064939 29395 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.065378 29395 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.080289 29395 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.083400 29395 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:25.091038 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:25.091728 29467 raft_consensus.cc:3055] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:25.092069 29467 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:25.092881 29467 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.094205 29467 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.122623 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:25.123452 29543 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.124928  2222 tablet_copy_client.cc:806] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:25.125639  2222 tablet_copy_client.cc:670] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:25.168957  2167 raft_consensus.cc:1064] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:25.172619  2167 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.195264 29467 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:25.196607 29543 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:25.221875  2222 tablet_copy_client.cc:538] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:14:25.223753 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 122335us
I20260709 13:14:25.225919 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:25.226861  2250 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:25.227466  2250 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:25.228555  2250 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.258968 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:25.259691 29469 raft_consensus.cc:606] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:25.261996  2263 raft_consensus.cc:1064] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:25.276235  2206 raft_consensus.cc:993] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:25.277871  2276 raft_consensus.cc:1081] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:25.265234  2263 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.281899 29464 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:25.298607 29395 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:25.286556 29545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:25.305509 29545 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.305965 29545 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.312434 30153 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:25.314703  2205 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:25.316946  2194 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:25.317849  2205 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:25.320494 29545 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.328241 29545 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:25.329370 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:25.329979 29395 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.329283 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:25.330834 29464 raft_consensus.cc:3055] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:25.331141 29464 raft_consensus.cc:740] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:25.336885 29464 consensus_queue.cc:260] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.365329 29464 raft_consensus.cc:3060] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.428085 29395 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:25.428900 29394 raft_consensus.cc:1240] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:25.431069 29509 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:25.431677  2268 raft_consensus.cc:993] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:25.414664  2222 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:25.433475  2279 raft_consensus.cc:2804] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:25.438638 29545 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:25.449412 30152 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:25.442734 29469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:25.450376 29469 raft_consensus.cc:606] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:25.446091 29395 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:25.472990  2280 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:14:25.475184  2172 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:25.486541  2285 log.cc:927] Time spent T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:14:25.488685  2279 raft_consensus.cc:697] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:25.489820  2279 consensus_queue.cc:237] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.490926  2217 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.452028  2268 raft_consensus.cc:1081] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:25.499357 29397 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.518206 29464 raft_consensus.cc:2468] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:25.525569 30155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57af445de910412cb7903ef2bf682013"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:14:25.526264 30155 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.526726 30155 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:25.529117 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:25.530391  2251 raft_consensus.cc:993] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:25.531008  2251 raft_consensus.cc:1081] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:25.532303 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:25.533761 29545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:25.534327 29545 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.534693 29545 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.584741 29290 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 9 to 10, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.603196  2273 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:14:25.610630 29291 catalog_manager.cc:5697] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 8 to 9, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 9 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.611449 30155 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.591886  2242 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:25.619488 29545 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.633159 29464 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.631047 30153 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.670213 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:25.670994 29469 raft_consensus.cc:3055] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:25.671484 29469 raft_consensus.cc:740] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:25.672437 29469 consensus_queue.cc:260] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.673791 29469 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:25.677563 30155 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:25.688854 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:25.689560 29397 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.689630 29545 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:25.690863 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:25.691548 29543 raft_consensus.cc:3060] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:25.698378 29469 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:25.699311 29397 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:25.700413 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:25.701059 29467 raft_consensus.cc:3055] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:25.701330 29467 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:25.702159 29467 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.703384 29467 raft_consensus.cc:3060] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.713651 29543 raft_consensus.cc:2468] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:25.714247 30126 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:25.729718 29467 raft_consensus.cc:2468] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:25.731087  2190 raft_consensus.cc:2804] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:25.731791  2190 raft_consensus.cc:697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:25.732795  2190 consensus_queue.cc:237] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.713109  2242 tablet_bootstrap.cc:492] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:25.746517  2242 ts_tablet_manager.cc:1403] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.760s	user 0.042s	sys 0.011s
I20260709 13:14:25.751327 29512 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:25.770632  2269 raft_consensus.cc:2804] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:25.771314  2269 raft_consensus.cc:697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:25.772830  2172 raft_consensus.cc:993] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:25.773496  2172 raft_consensus.cc:1081] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:25.772338  2269 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:25.774142  2242 raft_consensus.cc:359] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:25.794534 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 83841.5us
I20260709 13:14:25.812619 29295 catalog_manager.cc:5697] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 5 to 6, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.814145  2280 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.823309 29467 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:25.827772 29543 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:25.790692  2242 raft_consensus.cc:740] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:25.838187 30155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:14:25.838835 30155 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.839264 30155 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.852362 29393 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.884886 30155 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.872910 30152 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.896498 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:25.897361 29469 raft_consensus.cc:3055] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:25.897795 29469 raft_consensus.cc:740] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:25.899049 29469 consensus_queue.cc:260] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.900769 29469 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.900847 30155 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:25.903532 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:25.905247 29545 raft_consensus.cc:3060] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.939718 29469 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:25.941354 30126 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:25.942529  2246 raft_consensus.cc:2804] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:25.943081  2246 raft_consensus.cc:697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:25.943989  2246 consensus_queue.cc:237] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:25.950861 29463 raft_consensus.cc:1275] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:25.957604 29545 raft_consensus.cc:2468] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:25.954150  2205 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:14:25.994973 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 110865us
I20260709 13:14:26.006606 29542 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:25.878233  2242 consensus_queue.cc:260] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:26.017694  2242 ts_tablet_manager.cc:1434] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.271s	user 0.009s	sys 0.000s
I20260709 13:14:26.038228 30152 raft_consensus.cc:1217] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:14:26.038913  2295 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:26.073618 29397 raft_consensus.cc:1275] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:26.099766 29407 tablet_copy_service.cc:342] P 88760af579b54a6393c6251aa3c6b870: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-9f9e543a8422407185dcc0cc54131e92 received from {username='slave'} at 127.0.0.1:47726
I20260709 13:14:26.100416 29407 tablet_copy_service.cc:434] P 88760af579b54a6393c6251aa3c6b870: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-9f9e543a8422407185dcc0cc54131e92 on tablet 9f9e543a8422407185dcc0cc54131e92 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:26.120328  2205 consensus_queue.cc:1048] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:26.086580  2249 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:14:26.200006 29289 catalog_manager.cc:5697] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 13 to 14, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 14 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.290100 29463 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:26.238340  2222 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:14:26.306396 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 216077us
I20260709 13:14:26.306489  2299 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:14:26.320801 29469 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:26.323057  2193 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:26.361459 29392 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:26.392894  2222 tablet_bootstrap.cc:492] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:26.394136  2222 ts_tablet_manager.cc:1403] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.980s	user 0.051s	sys 0.007s
I20260709 13:14:26.407058 29545 raft_consensus.cc:1275] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:26.400645  2269 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:14:26.434501  2301 consensus_queue.cc:1048] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:14:26.518740 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 129942us
I20260709 13:14:26.593081  2222 raft_consensus.cc:359] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:26.599486 29545 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:26.533699 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:26.622818 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 91965.8us
W20260709 13:14:26.639653  2314 log.cc:927] Time spent T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 13:14:26.647629 29291 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 11 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.701871 29291 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 6 to 7, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:26.654577  2222 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:26.729666  2222 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:26.700454  2190 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:14:26.732301  2222 ts_tablet_manager.cc:1434] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.338s	user 0.007s	sys 0.003s
I20260709 13:14:26.828634 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-d01483a998944f4386fc5dfa1f0fd51a received from {username='slave'} at 127.0.0.1:51828
I20260709 13:14:26.829213 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-d01483a998944f4386fc5dfa1f0fd51a on tablet d01483a998944f4386fc5dfa1f0fd51a with peer c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:26.840987 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59007.1us
I20260709 13:14:26.955534 30155 raft_consensus.cc:1217] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
W20260709 13:14:26.962970 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 74031.5us
I20260709 13:14:27.006289 29464 raft_consensus.cc:1275] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:27.025483  2315 consensus_queue.cc:1048] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:27.029464  2325 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:27.171552  2249 raft_consensus.cc:1064] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:27.175290  2249 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:27.161641 29295 catalog_manager.cc:5697] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 10 to 11, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 11 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:27.317195 29545 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:27.332338  2193 raft_consensus.cc:1064] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:27.325428  2332 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:14:27.337735  2193 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:27.352571 29463 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:27.353453 30155 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEARNER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:27.356369  2332 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:27.360635  2266 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:27.388576 29538 consensus_queue.cc:237] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:27.454074 29463 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:27.468277 30152 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:27.470067 29392 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:27.477880  2205 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:14:27.558255 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 70042.2us
I20260709 13:14:27.567922 29464 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:14:27.581775  2351 log.cc:927] Time spent T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.111s	user 0.006s	sys 0.000s
I20260709 13:14:27.588274  2270 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:14:27.626266  2350 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 13:14:27.711512  2323 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:27.719798 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 118176us
W20260709 13:14:27.737685 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 58764.3us
I20260709 13:14:27.747071 30152 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:14:27.751267 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72479.1us
I20260709 13:14:27.769200  2270 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:14:27.824792 30152 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:27.836390  2289 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:27.821694 30155 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:27.865963 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 47711us
I20260709 13:14:27.872918  2217 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:27.951817 29467 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:27.982213 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 92494.8us
W20260709 13:14:27.983482 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 190852us
I20260709 13:14:27.986171 29543 raft_consensus.cc:1275] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:27.989478 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:28.003778 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 135552us
I20260709 13:14:28.027752  2206 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.035681  2205 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.083251 29396 raft_consensus.cc:1275] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:28.092253 29470 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.094086 29396 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.096277 30152 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.016117 29289 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.068120 29543 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.104871  2370 consensus_queue.cc:1048] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:14:28.195462 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:28.199083 30152 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.191690  2194 consensus_queue.cc:1048] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:14:28.258373 29470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:28.259297 29470 raft_consensus.cc:606] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
W20260709 13:14:28.282263 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 102459us
I20260709 13:14:28.233187 29295 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.308854 29544 raft_consensus.cc:2955] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.310686 29543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:14:28.311398 29543 raft_consensus.cc:606] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:28.313448 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 120664us
I20260709 13:14:28.357863 29464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:28.360239 29464 raft_consensus.cc:606] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:28.390201  2331 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.391391 30153 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.397179 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:28.400666 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:28.501056 29396 raft_consensus.cc:2955] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.548000  2331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36160 (request call id 0) took 1164 ms. Trace:
I20260709 13:14:28.548655  2331 rpcz_store.cc:276] 0709 13:14:27.384041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.384205 (+   164us) service_pool.cc:224] Handling call
0709 13:14:27.392585 (+  8380us) log.cc:844] Serialized 508 byte log entry
0709 13:14:27.628315 (+235730us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e57dac85 00007f61e57db6a2 00007f61e854d1db 00007f61e8548aaf 00007f61e853c86e 00007f61e853bbb6 00007f61e853b7d8 00007f61e8545221 00007f61e85451d9 00007f61e8545169
0709 13:14:28.547851 (+919536us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61508,"raft.queue_time_us":41548,"raft.run_cpu_time_us":1550,"raft.run_wall_time_us":55021,"spinlock_wait_cycles":54314368,"thread_start_us":345067,"threads_started":2,"wal-append.queue_time_us":204596}
I20260709 13:14:28.550891 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 495c8d0b86f84e95b022820009da4795 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:28.621461  2206 raft_consensus.cc:993] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:28.622196  2206 raft_consensus.cc:1081] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:28.633172 29544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:28.633960 29544 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.634415 29544 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:28.647614  2331 raft_consensus.cc:993] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:28.648272  2331 raft_consensus.cc:1081] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:28.651746 30153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:14:28.652539 30153 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.653033 30153 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:28.657577  2370 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:28.658282  2370 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.663816 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:28.663977  2370 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:28.666091 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:28.691757 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:28.693645 29435 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:28.696836 29391 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.703058  2370 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:28.706909  2368 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:28.707496  2368 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.711781 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:28.712373 29544 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.716203 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:28.718796 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:28.719359 29469 raft_consensus.cc:3055] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:28.719732 29469 raft_consensus.cc:740] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:28.720976 29469 consensus_queue.cc:260] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.724082 29363 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:28.725603  2368 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:28.726289  2368 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:28.729094 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:28.738662 29469 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:28.743803 30152 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:28.738988 29291 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 7 to 8, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 7 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.746788 29544 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:28.747953 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:28.747711 29291 catalog_manager.cc:5697] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 6 to 7, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 7 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:28.748615 30152 raft_consensus.cc:3060] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:28.749840 29543 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.755860 30153 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.850001 29469 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:28.853313 30153 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:28.857648 30152 raft_consensus.cc:2468] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:28.859575 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:28.860396 29543 raft_consensus.cc:3055] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:28.860741 29543 raft_consensus.cc:740] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:28.753353  2262 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:14:28.861673 29543 consensus_queue.cc:260] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:28.870236 29512 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:28.892503 30152 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:28.898790 29543 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:28.918737 29467 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:28.899127  2381 raft_consensus.cc:2804] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:28.907485  2356 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:14:28.962495 29543 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 15.
I20260709 13:14:28.988787 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:28.989553 29467 raft_consensus.cc:3060] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:28.963532  2381 raft_consensus.cc:697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:28.998662 30126 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:29.032429 29467 raft_consensus.cc:2468] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 15.
I20260709 13:14:29.012818  2375 raft_consensus.cc:2804] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:14:29.066730 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 55358.3us
W20260709 13:14:29.096221 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 73064.3us
I20260709 13:14:29.063486  2266 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:14:29.128789 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 58661.9us
W20260709 13:14:29.155287 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 76234.9us
I20260709 13:14:29.081687  2381 consensus_queue.cc:237] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:29.161621  2375 raft_consensus.cc:697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
W20260709 13:14:29.178464 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 44384.7us
W20260709 13:14:29.218618 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 67009.5us
W20260709 13:14:29.219595 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 120229us
W20260709 13:14:29.223739 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 78055.2us
I20260709 13:14:29.250209  2375 consensus_queue.cc:237] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:29.319084 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 76910.9us
W20260709 13:14:29.326860 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 89700.6us
I20260709 13:14:29.332414  2270 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:29.342274  2396 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:29.351416 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 305594us
I20260709 13:14:29.353199 30158 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:29.402721 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:29.389753 29464 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:29.417233 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f0ebecfce24837b2bbdbea5b0b6b8f with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:58006
I20260709 13:14:29.418514 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 495c8d0b86f84e95b022820009da4795 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59284
W20260709 13:14:29.422765 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 66325.6us
I20260709 13:14:29.433185  2407 raft_consensus.cc:993] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:14:29.414961 29463 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:14:29.436008 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 49313.3us
I20260709 13:14:29.433738  2407 raft_consensus.cc:1081] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
W20260709 13:14:29.459043 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 99743.4us
I20260709 13:14:29.468298 29291 catalog_manager.cc:5697] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 14 to 15, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 15 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:29.471980 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 60379.2us
W20260709 13:14:29.498991  2424 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:14:29.515161 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d01483a998944f4386fc5dfa1f0fd51a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:29.490893  2395 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:14:29.578518 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 59712.2us
I20260709 13:14:29.581848 29397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:14:29.582638 29397 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:29.583035 29397 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.584847  2427 tablet_replica.cc:333] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:14:29.586244  2427 raft_consensus.cc:2243] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.600452 29295 catalog_manager.cc:5697] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 11 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:29.612192  2427 raft_consensus.cc:2272] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.620406  2427 ts_tablet_manager.cc:1916] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:29.623459  2426 tablet_replica.cc:333] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:29.631099 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f9e543a8422407185dcc0cc54131e92 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:14:29.612192 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 128306us
I20260709 13:14:29.652086 29467 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:29.619690 29397 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:29.655843 29392 raft_consensus.cc:1240] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:29.664794  2408 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:29.670612 29397 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:29.673434 29290 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 9 to 10, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 13 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:29.684278 30151 raft_consensus.cc:1275] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:29.688584 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:29.711284 29463 raft_consensus.cc:3055] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:29.711606 29463 raft_consensus.cc:740] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:29.710080 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:29.710979 29464 raft_consensus.cc:2955] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:29.712517 29544 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.732115  2356 consensus_queue.cc:1048] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:29.732450 29463 consensus_queue.cc:260] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:29.733659 29463 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:29.741014  2370 consensus_queue.cc:1175] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "88760af579b54a6393c6251aa3c6b870" responder_term: 14 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:29.757637 29463 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 14.
I20260709 13:14:29.763880 29544 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 14.
I20260709 13:14:29.762804 30151 raft_consensus.cc:2955] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:29.821390 29363 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:29.823153  2427 ts_tablet_manager.cc:1929] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:14:29.823815  2427 log.cc:1199] T 495c8d0b86f84e95b022820009da4795 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/495c8d0b86f84e95b022820009da4795
I20260709 13:14:29.824659  2417 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:29.825637  2417 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 14 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:29.826716  2417 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:29.827625 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 495c8d0b86f84e95b022820009da4795 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:29.829612  2426 raft_consensus.cc:2243] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.831103  2426 raft_consensus.cc:2272] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.841354 29544 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:29.888803  2404 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:29.897205 29467 raft_consensus.cc:1275] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:29.919066  2429 consensus_queue.cc:1048] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 13:14:29.938969  2432 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.074s	user 0.009s	sys 0.019s
I20260709 13:14:29.946623  2358 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:29.947403  2358 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:29.944909  2424 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.074s	user 0.007s	sys 0.019s
W20260709 13:14:29.981184  2384 log.cc:927] Time spent T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.026s
W20260709 13:14:29.944443  2433 log.cc:927] Time spent T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.147s	user 0.004s	sys 0.000s
I20260709 13:14:29.996182  2426 ts_tablet_manager.cc:1916] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:30.001127  2358 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:30.061635 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:30.079257 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 89010.7us
I20260709 13:14:30.095301 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:30.153126  2405 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:30.154984  2405 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:30.161689 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:30.195407 29512 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:30.196801 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 85805.7us
I20260709 13:14:30.224308  2380 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:30.231889  2405 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:30.246302 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:30.251443 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:30.291227 29363 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:30.294778  2328 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:30.408941 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 48768.2us
W20260709 13:14:30.445094 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 72657.3us
I20260709 13:14:30.452502 29464 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:30.479816 29291 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 8 to 9, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 10 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.486074 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:30.486764  2366 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:30.489823 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9e543a8422407185dcc0cc54131e92 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36160
I20260709 13:14:30.496206 29544 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:30.559710  2366 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:30.545966  2426 ts_tablet_manager.cc:1929] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:14:30.564494  2426 log.cc:1199] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/07f0ebecfce24837b2bbdbea5b0b6b8f
I20260709 13:14:30.566372  2426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58006 (request call id 5) took 1149 ms. Trace:
I20260709 13:14:30.566875  2426 rpcz_store.cc:276] 0709 13:14:29.416825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.417021 (+   196us) service_pool.cc:224] Handling call
0709 13:14:29.622970 (+205949us) ts_tablet_manager.cc:1151] Deleting tablet 07f0ebecfce24837b2bbdbea5b0b6b8f
0709 13:14:29.623126 (+   156us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:14:30.324837 (+701711us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:30.545630 (+220793us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:30.566236 (+ 20606us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204706,"tablet-delete.queue_time_us":202399,"thread_start_us":158394,"threads_started":1}
I20260709 13:14:30.610219 29383 tablet_service.cc:1558] Processing DeleteTablet for tablet d01483a998944f4386fc5dfa1f0fd51a with delete_type TABLET_DATA_TOMBSTONED (TS 88760af579b54a6393c6251aa3c6b870 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58006
I20260709 13:14:30.625602  2426 tablet_replica.cc:333] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:30.626309 29290 catalog_manager.cc:5697] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 13 to 14, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 14 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.628808 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet 07f0ebecfce24837b2bbdbea5b0b6b8f (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:30.627333  2426 raft_consensus.cc:2243] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.633867  2426 raft_consensus.cc:2272] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.668049  2426 ts_tablet_manager.cc:1916] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:30.885098 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 156246us
I20260709 13:14:30.895764  2447 tablet_replica.cc:333] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:14:30.928031  2447 raft_consensus.cc:2243] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.930874  2447 raft_consensus.cc:2272] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.956588  2447 ts_tablet_manager.cc:1916] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:31.024142  2426 ts_tablet_manager.cc:1929] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:14:31.024863  2426 log.cc:1199] T d01483a998944f4386fc5dfa1f0fd51a P 88760af579b54a6393c6251aa3c6b870: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/wals/d01483a998944f4386fc5dfa1f0fd51a
I20260709 13:14:31.026911 29279 catalog_manager.cc:5028] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): tablet d01483a998944f4386fc5dfa1f0fd51a (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:31.027381  2447 ts_tablet_manager.cc:1929] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:14:31.032809  2447 log.cc:1199] T 9f9e543a8422407185dcc0cc54131e92 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/9f9e543a8422407185dcc0cc54131e92
I20260709 13:14:31.036294 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 9f9e543a8422407185dcc0cc54131e92 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:31.613683 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:31.944020 29545 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:31.984172 29396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea2318003a42fea9088b490db583f1"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:38970
I20260709 13:14:31.985110 29396 raft_consensus.cc:606] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:32.001466 29464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:32.002358 29464 raft_consensus.cc:606] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:32.094624 29542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:14:32.095425 29542 raft_consensus.cc:606] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:32.097216 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:32.099803 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:32.203333 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 85252.4us
I20260709 13:14:32.205399  2459 raft_consensus.cc:993] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
W20260709 13:14:32.207011  2457 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 13:14:32.207190  2459 raft_consensus.cc:1081] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
W20260709 13:14:32.236440 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 48322us
W20260709 13:14:32.241408 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61f7f02fdc8243cd8806a09e7908831e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.257210 29544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ea2318003a42fea9088b490db583f1"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:14:32.258029 29544 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:32.258495 29544 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:32.277288 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 95488.5us
I20260709 13:14:32.282027 29467 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:32.286229 29544 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:32.369065 29544 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:32.374368  2399 raft_consensus.cc:993] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:32.375092  2399 raft_consensus.cc:1081] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:32.377272 30151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:14:32.377950 30151 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:32.378293 30151 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:32.378598 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 78770.8us
I20260709 13:14:32.397593 29393 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:32.410363  2471 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:32.414124 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:32.414914 29467 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.419571  2442 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:32.427166 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:32.427824 29392 raft_consensus.cc:3055] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:32.428140 29392 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:32.428972 29392 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:32.430617 29392 raft_consensus.cc:3060] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.430934  2470 raft_consensus.cc:993] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:14:32.431510  2470 raft_consensus.cc:1081] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:14:32.437271 29463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59308
I20260709 13:14:32.437856 29463 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:32.438236 29463 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:32.445686 29467 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:32.448240 29512 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:32.449194  2461 raft_consensus.cc:2804] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:32.449860  2461 raft_consensus.cc:697] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:32.450975  2461 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:32.461354 29392 raft_consensus.cc:2468] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:32.488940  2470 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:32.492134 29463 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:32.492703 29392 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:32.504084 30151 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:32.539979 29465 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:32.567823 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:32.569543 29394 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:32.573815 30151 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:32.576794 29291 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 10 to 11, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:32.581842 29291 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.586335 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:32.587045 29472 raft_consensus.cc:3055] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:32.587368 29472 raft_consensus.cc:740] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:32.588277 29472 consensus_queue.cc:260] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:32.588680 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:32.589630 29541 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:32.590274 29472 raft_consensus.cc:3060] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:32.584532 29464 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:32.601085 29463 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:32.603257 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:32.603935 29542 raft_consensus.cc:3055] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:32.604256 29542 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:32.606920 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:32.607661 29397 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:32.612351 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 106211us
I20260709 13:14:32.615322 29542 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:32.616640 29542 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:32.621124 29394 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:14:32.623546 29472 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:14:32.665714 29541 raft_consensus.cc:2468] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:14:32.641762 29542 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:32.678536 30126 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:32.681144  2456 raft_consensus.cc:2804] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:32.681741  2456 raft_consensus.cc:697] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:32.682857  2456 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:32.707047 29397 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
W20260709 13:14:32.735033 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 129498us
I20260709 13:14:32.740800 29392 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:14:32.763597 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 160163us
I20260709 13:14:32.766187 29542 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:32.749122 29435 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:32.784122  2479 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:32.784837  2479 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:32.784672  2400 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:14:32.788748  2468 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:32.785949  2479 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:32.812278 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77e08f37d90645918ef0bee732dd4b98. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.820747  2481 ts_tablet_manager.cc:933] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:32.841547 29295 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 12 to 13, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 13 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:32.963099  2481 tablet_copy_client.cc:323] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:14:32.990959 29472 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:32.993497 29397 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:32.993892  2471 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:33.019469  2469 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:33.023732 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 61f7f02fdc8243cd8806a09e7908831e from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:14:33.024463 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 61f7f02fdc8243cd8806a09e7908831e from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-61f7f02fdc8243cd8806a09e7908831e
I20260709 13:14:33.024588  2464 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:33.030752 29544 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:33.035355 29556 tablet_copy_source_session.cc:215] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:33.118139  2486 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:14:33.205715 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 151359us
W20260709 13:14:33.215279 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 68077.5us
W20260709 13:14:33.216394 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 59555.7us
I20260709 13:14:33.225095 29392 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:33.272451  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f7f02fdc8243cd8806a09e7908831e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.327411 29546 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:14:33.336372 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 112238us
I20260709 13:14:33.343894  2502 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:14:33.354189 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47612.5us
I20260709 13:14:33.354969 29393 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:33.397984 29472 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:33.404377  2456 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:14:33.573005 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 214835us
W20260709 13:14:33.619479 29512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.752556 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 347575us
W20260709 13:14:33.798128 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 355701us
I20260709 13:14:33.773005  2513 ts_tablet_manager.cc:933] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:33.846298 29544 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:33.952101 29393 consensus_meta.cc:287] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.000s
I20260709 13:14:33.978665  2462 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:14:33.987257  2513 tablet_copy_client.cc:323] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
W20260709 13:14:33.969627 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 56579.2us
W20260709 13:14:34.112604 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 87124.5us
I20260709 13:14:34.113780 29393 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:34.116080 29542 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:34.149737  2270 raft_consensus.cc:493] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:34.150532  2270 raft_consensus.cc:515] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.161561  2266 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:14:34.180505  2464 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.063s	sys 0.046s
I20260709 13:14:34.204799  2270 leader_election.cc:290] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:34.235325  2464 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.064s	sys 0.046s
I20260709 13:14:34.256348  2516 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.257395  2516 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.259122  2507 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.259364  2492 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:34.259936  2492 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:34.162333  2266 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:34.259881  2507 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:34.319203  2399 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.319976  2399 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:34.320559 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:34.307861  2516 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:34.326869 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:34.328838  2491 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.329803  2520 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.329545  2491 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:34.330485  2520 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:34.331743  2491 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.332985  2520 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.334702 29393 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:34.337496  2266 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.341609  2507 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.342404  2491 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:34.345006 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.322427  2399 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.348338 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.348660  2492 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.354135 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:34.358397 29538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:34.358759 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:34.358824 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:34.360299 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:34.361680  2394 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.362387  2394 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.365566  2394 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.367069 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.367807 29465 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 11.
I20260709 13:14:34.370472 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:34.372193 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.373657 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:34.395823 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:34.381595  2516 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.413551 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:34.418329  2516 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.422001  2492 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:34.441593  2481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49092 (request call id 962) took 1698 ms. Trace:
I20260709 13:14:34.434558  2507 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:34.435396  2478 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.439986  2516 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:34.460968 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c7e9523dd804c659b1f0d34ac3eefb3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:34.438724  2470 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:34.476044 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 77e08f37d90645918ef0bee732dd4b98 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:14:34.477065 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 77e08f37d90645918ef0bee732dd4b98 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-77e08f37d90645918ef0bee732dd4b98
I20260709 13:14:34.478901 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.479027  2470 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.479332 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:34.481225 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:33.565702 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:34.490803  2399 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.491389  2399 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:34.493793  2399 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.495422  2391 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.490141  2491 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.496301  2491 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.464713 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:34.513175 29435 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:34.514490 29295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60116 (request call id 201) took 1721 ms. Trace:
W20260709 13:14:34.518864 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54240.4us
I20260709 13:14:34.525491 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:34.531647 29291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 319) took 1960 ms. Trace:
I20260709 13:14:34.535791 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:34.510141  2463 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.537840  2266 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:34.518864  2510 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:34.542493 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:34.464162  2492 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.549250 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:34.512780  2507 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.569416  2477 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.552435  2529 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:34.515010 29295 rpcz_store.cc:276] 0709 13:14:32.777825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.778047 (+   222us) service_pool.cc:224] Handling call
0709 13:14:32.824319 (+ 46272us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890b090 00007f61e89a9f3a 00007f61ee7601cc 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc 00007f61ecd1e392 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:34.499263 (+1674944us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:32.854161 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:32.854757 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:32.854792 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:14:32.854808 (+    16us) tablet.cc:662] Decoding operations
0709 13:14:32.855166 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:32.855212 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:32.855237 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:32.855421 (+   184us) tablet.cc:701] Row locks acquired
0709 13:14:32.855437 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:14:32.855574 (+   137us) write_op.cc:270] Start()
0709 13:14:32.855686 (+   112us) write_op.cc:276] Timestamp: P: 1783602872855528 usec, L: 0
0709 13:14:32.855704 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:14:32.856322 (+   618us) log.cc:844] Serialized 603 byte log entry
0709 13:14:33.087800 (+231478us) op_driver.cc:464] REPLICATION: finished
0709 13:14:33.143694 (+ 55894us) write_op.cc:301] APPLY: starting
0709 13:14:33.143781 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:33.145025 (+  1244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:33.145135 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:33.145887 (+   752us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:33.146103 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:14:33.146162 (+    59us) write_op.cc:312] APPLY: finished
0709 13:14:33.146380 (+   218us) log.cc:844] Serialized 25 byte log entry
0709 13:14:33.195710 (+ 49330us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.200109 (+  4399us) write_op.cc:454] Released schema lock
0709 13:14:33.203104 (+  2995us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:33.211922 (+  8818us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.211971 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38854,"reported_tablets":1,"spinlock_wait_cycles":99031296,"child_traces":[["op",{"apply.queue_time_us":55597,"apply.run_cpu_time_us":3359,"apply.run_wall_time_us":68131,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4170,"num_ops":1,"prepare.queue_time_us":6366,"prepare.run_cpu_time_us":2431,"prepare.run_wall_time_us":2431,"replication_time_us":231911,"thread_start_us":112037,"threads_started":1}]]}
I20260709 13:14:34.587740 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3e26705f6f42428e0c9830d7dbedb6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.481985  2478 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.442255  2481 rpcz_store.cc:276] 0709 13:14:32.745500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.746178 (+   678us) service_pool.cc:224] Handling call
0709 13:14:32.834592 (+ 88414us) ts_tablet_manager.cc:934] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
0709 13:14:33.055432 (+220840us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:34.229003 (+1173571us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:34.229175 (+   172us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:34.440588 (+211413us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:34.440991 (+   403us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:34.441448 (+   457us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:34.441514 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":23695,"tablet-copy.queue_time_us":64672,"thread_start_us":165183,"threads_started":2}
I20260709 13:14:34.495997  2391 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.553364  2463 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:34.584290  2496 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:34.580075  2477 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:34.532145 29291 rpcz_store.cc:276] 0709 13:14:32.571011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.571200 (+   189us) service_pool.cc:224] Handling call
0709 13:14:34.531566 (+1960366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:32.687781 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:32.688564 (+   783us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:32.688612 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:14:32.688637 (+    25us) tablet.cc:662] Decoding operations
0709 13:14:32.689252 (+   615us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:32.689311 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:32.689366 (+    55us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:32.689676 (+   310us) tablet.cc:701] Row locks acquired
0709 13:14:32.689700 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:14:32.689879 (+   179us) write_op.cc:270] Start()
0709 13:14:32.690034 (+   155us) write_op.cc:276] Timestamp: P: 1783602872689825 usec, L: 0
0709 13:14:32.690064 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:14:32.743929 (+ 53865us) log.cc:844] Serialized 994 byte log entry
0709 13:14:33.016491 (+272562us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b540011dda0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e891f343 00007f61e8922d75 00007f61e8922d09 00007f61e8922c99 00007f61e8922c61 00007f61e8921f5d 000000000038f354 000000000038f199 00007f61e58b4475 00007f61e58b67c1
0709 13:14:33.016826 (+   335us) op_driver.cc:464] REPLICATION: finished
0709 13:14:33.136053 (+119227us) write_op.cc:301] APPLY: starting
0709 13:14:33.136167 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:33.138361 (+  2194us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:33.138404 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:33.140255 (+  1851us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:33.140518 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:14:33.140566 (+    48us) write_op.cc:312] APPLY: finished
0709 13:14:33.141004 (+   438us) log.cc:844] Serialized 33 byte log entry
0709 13:14:33.141891 (+   887us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.142004 (+   113us) write_op.cc:454] Released schema lock
0709 13:14:33.142054 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:33.143172 (+  1118us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.143211 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87674,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":118903,"apply.run_cpu_time_us":5405,"apply.run_wall_time_us":7126,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"num_ops":2,"prepare.queue_time_us":96297,"prepare.run_cpu_time_us":16406,"prepare.run_wall_time_us":135661,"raft.queue_time_us":193740,"raft.run_cpu_time_us":103930,"raft.run_wall_time_us":203931,"replication_time_us":326593,"spinlock_wait_cycles":23855872,"thread_start_us":221258,"threads_started":4,"wal-append.queue_time_us":135659,"wal-append.run_cpu_time_us":11569,"wal-append.run_wall_time_us":1346723}]]}
I20260709 13:14:34.638955 29395 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 6.
W20260709 13:14:34.639802 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 113829us
I20260709 13:14:34.641913 29512 leader_election.cc:304] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:34.630725  2477 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:34.682386 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 130122us
I20260709 13:14:34.645162  2481 tablet_copy_client.cc:806] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:34.698544  2557 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:34.662904  2461 raft_consensus.cc:2749] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:34.719316  2481 tablet_copy_client.cc:670] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:34.699584  2557 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:34.706410  2391 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:34.717696  2491 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:34.737020 29294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 304) took 1860 ms. Trace:
I20260709 13:14:34.735342 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:34.739138 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 54778.6us
I20260709 13:14:34.706785  2468 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:14:34.737674 29294 rpcz_store.cc:276] 0709 13:14:32.758853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.759073 (+   220us) service_pool.cc:224] Handling call
0709 13:14:32.821096 (+ 62023us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890b090 00007f61e89a9f3a 00007f61ee7601cc 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc 00007f61ecd1e392 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:34.619170 (+1798074us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":636409,"reported_tablets":2,"spinlock_wait_cycles":135547648}
W20260709 13:14:34.750913 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 119296us
I20260709 13:14:34.752367 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:34.757328 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.758090 29463 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 6.
I20260709 13:14:34.758792 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.760243 30123 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:34.761411  2394 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:34.763024 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:34.763765 29290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 305) took 2000 ms. Trace:
I20260709 13:14:34.764165 29481 tablet_copy_source_session.cc:215] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:34.764730  2541 log.cc:927] Time spent T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:14:34.767004 29393 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:34.764182 29290 rpcz_store.cc:276] 0709 13:14:32.763528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.763956 (+   428us) service_pool.cc:224] Handling call
0709 13:14:32.825100 (+ 61144us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b540011d854. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890b090 00007f61e89a9f3a 00007f61ee7601cc 00007f61ee85e37e 00007f61ecd1f2a4 00007f61ecd1f232 00007f61ecd1f161 00007f61ecd1f0dc 00007f61ecd1e392 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:34.763673 (+1938573us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":131510016}
I20260709 13:14:34.773778  2478 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:34.775904  2470 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:34.780781  2557 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:34.787206  2463 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:34.806900 29472 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:14:34.751596  2544 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:14:34.751675  2492 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:34.849947 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:34.863328 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:34.886384 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:34.882328 29438 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:34.888738 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:35.032843 29393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
W20260709 13:14:35.047289 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 158596us
I20260709 13:14:34.881208  2507 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:35.076159 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:35.084671 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 193916us
I20260709 13:14:35.096357 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.099509 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.100170 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:35.055339  2442 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:14:35.104480 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.111500 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c21d46fd7a440b09555995fc5c75ad3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.124574 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
W20260709 13:14:35.096547 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 449493us
I20260709 13:14:35.133633 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:35.138854 29435 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:35.146584 29438 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.152278 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.158810 29363 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:35.150418  2561 log.cc:927] Time spent T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:35.165503 29438 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.169325 29438 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.158816  2478 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:35.193156 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.164266 29435 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.183044  2521 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:35.185995  2538 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:35.146853  2492 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:35.163502  2399 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:35.225281  2466 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:35.225589  2551 raft_consensus.cc:2749] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:35.226666  2506 raft_consensus.cc:2749] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:35.190896  2478 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:35.228070  2478 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:35.229255  2571 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:35.230971  2527 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:35.231562  2527 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:35.233103  2517 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:35.233708  2517 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:35.243685 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.200428  2548 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:35.200407  2492 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:35.212415  2499 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:35.266527  2492 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:35.276383  2477 consensus_meta.cc:287] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Time spent flushing consensus metadata: real 0.587s	user 0.004s	sys 0.011s
I20260709 13:14:35.298338  2493 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:35.299216  2493 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:35.302637  2467 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.269490  2548 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.295903  2477 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.304564  2513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e08f37d90645918ef0bee732dd4b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.315325  2548 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:35.315644  2477 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:35.316535 29466 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:35.321041  2516 consensus_meta.cc:287] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: Time spent flushing consensus metadata: real 0.808s	user 0.008s	sys 0.009s
I20260709 13:14:35.321601  2516 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.324273  2516 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:35.325239 29394 raft_consensus.cc:1240] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:35.338122 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 141715us
W20260709 13:14:35.354904 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 106718us
I20260709 13:14:35.334151 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:35.330078  2493 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:35.379006  2573 ts_tablet_manager.cc:933] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:35.388756 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 224597us
W20260709 13:14:35.390650 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 112314us
I20260709 13:14:35.424676  2517 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:35.424515 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:35.434773  2560 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:35.435549  2560 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.438041  2560 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:35.444146 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:35.466346 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:35.470600 29389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
W20260709 13:14:35.512527 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 112976us
W20260709 13:14:35.510574 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 93432.5us
I20260709 13:14:35.550138 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:35.560366  2576 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:35.561180  2576 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.556761  2573 tablet_copy_client.cc:323] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:14:35.563741  2576 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:35.565083 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:35.568861  2478 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.570266 29465 raft_consensus.cc:1240] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:14:35.573300  2478 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:35.573638 29390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:35.573943  2577 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:35.608009  2577 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:35.578389 29394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36866 (request call id 2584) took 1192 ms. Trace:
I20260709 13:14:35.589129 29470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:35.594131 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:35.594417 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:35.610623 29394 rpcz_store.cc:276] 0709 13:14:34.385663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.385846 (+   183us) service_pool.cc:224] Handling call
0709 13:14:34.480707 (+ 94861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:35.342245 (+861538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.576649 (+234404us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54001725d4. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a1e01 00007f61e89a083e 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6
0709 13:14:35.578076 (+  1427us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54001725d0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e89a08ad 00007f61ed965419 00007f61e6edcbd4 00007f61e6edcb62 00007f61e6edca91 00007f61e6edca0c 00007f61e6edbcc2 00007f61e6cdc48c 00007f61e6cdb8c6 00007f61e6cdb26f
0709 13:14:35.578263 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158698624}
I20260709 13:14:35.617314 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.617583 29537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.617898 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:35.620616 29509 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.601552 29290 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 11 to 12, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.622527 29290 catalog_manager.cc:5697] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 7, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.626736  2492 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.628182 29388 raft_consensus.cc:1240] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Rejecting Update request from peer 7c2e8d3e55c649e2b3acedef25d81e16 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:14:35.631740  2492 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:35.643137  2481 tablet_copy_client.cc:538] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:35.656795  2464 raft_consensus.cc:2749] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:35.656888 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:35.659631  2538 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:35.660210  2538 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.663090  2527 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:35.666410  2538 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:35.667784  2531 consensus_queue.cc:1059] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:35.669096  2442 raft_consensus.cc:3055] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:35.669466  2442 raft_consensus.cc:740] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:35.669593 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:35.670502 29465 raft_consensus.cc:2393] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 7: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:35.670639  2442 consensus_queue.cc:260] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:35.671321  2481 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:35.672139  2577 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:35.680533 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:35.681332 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:35.688194 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.701229 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:35.712711 29438 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:35.716374 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:35.720009 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:35.724290 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:35.731688 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:35.724901 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:35.739494 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:35.702407  2576 consensus_queue.cc:1059] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:14:35.756048  2442 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.757054 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:35.759311 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 5c7e9523dd804c659b1f0d34ac3eefb3 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:14:35.759979 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 5c7e9523dd804c659b1f0d34ac3eefb3 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-5c7e9523dd804c659b1f0d34ac3eefb3
I20260709 13:14:35.762495 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:35.764659 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:35.766515  2465 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:35.778671 29438 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:35.777887 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.706750  2513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49108 (request call id 1372) took 2339 ms. Trace:
I20260709 13:14:35.708288  2492 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:35.781406 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:35.781811 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:35.782737  2531 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:35.767333  2465 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.789249 29438 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:35.736519  2581 raft_consensus.cc:2749] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.794167 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:35.783294  2555 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:35.702948  2527 consensus_queue.cc:1059] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:14:35.798421  2557 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.788506  2477 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:14:35.830075 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 92503.6us
I20260709 13:14:35.807807  2539 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:35.838732 29512 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:35.842109 29512 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:35.843178  2576 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.852867  2539 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:35.844610  2514 consensus_queue.cc:1059] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:14:35.784279  2513 rpcz_store.cc:276] 0709 13:14:33.367402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.396597 (+ 29195us) service_pool.cc:224] Handling call
0709 13:14:33.839044 (+442447us) ts_tablet_manager.cc:934] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
0709 13:14:35.164897 (+1325853us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:35.548704 (+383807us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:35.548868 (+   164us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:35.685680 (+136812us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:35.686027 (+   347us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:35.698986 (+ 12959us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:35.702792 (+  3806us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19119,"tablet-copy.queue_time_us":200577,"thread_start_us":149339,"threads_started":2}
I20260709 13:14:35.879213  2513 tablet_copy_client.cc:806] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:35.887938  2513 tablet_copy_client.cc:670] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:35.891206 29539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:14:35.892062 29539 raft_consensus.cc:606] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:35.893054  2513 tablet_copy_client.cc:538] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:14:35.906317 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 64272us
I20260709 13:14:35.911736 29556 tablet_copy_source_session.cc:215] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:35.912199  2471 raft_consensus.cc:3055] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:35.924630  2471 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:35.925774  2471 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:35.940438  2471 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:35.952355  2573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7e9523dd804c659b1f0d34ac3eefb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.953261 29539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:14:35.953974 29539 raft_consensus.cc:606] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Received request to transfer leadership to TS 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:35.967247 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:35.969834 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:35.993479  2513 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:36.101732  2467 raft_consensus.cc:993] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:14:36.102417  2464 raft_consensus.cc:1081] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
W20260709 13:14:36.125854 29509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.147039 29471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59308
I20260709 13:14:36.147971 29471 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.148455 29471 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.194873  2471 raft_consensus.cc:993] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:14:36.195597  2471 raft_consensus.cc:1081] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Signalling peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 to start an election
I20260709 13:14:36.207291 29290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33542 (request call id 306) took 1416 ms. Trace:
I20260709 13:14:36.211870 29464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
 from {username='slave'} at 127.0.0.1:59308
I20260709 13:14:36.212563 29464 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.212985 29464 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.207962 29290 rpcz_store.cc:276] 0709 13:14:34.790664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.790944 (+   280us) service_pool.cc:224] Handling call
0709 13:14:36.207207 (+1416263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:35.888636 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:35.889278 (+   642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:35.889320 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:14:35.889339 (+    19us) tablet.cc:662] Decoding operations
0709 13:14:35.889890 (+   551us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:35.889976 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:35.890003 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:35.890291 (+   288us) tablet.cc:701] Row locks acquired
0709 13:14:35.890304 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:14:35.890488 (+   184us) write_op.cc:270] Start()
0709 13:14:35.890628 (+   140us) write_op.cc:276] Timestamp: P: 1783602875890410 usec, L: 0
0709 13:14:35.890645 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:14:35.899586 (+  8941us) log.cc:844] Serialized 994 byte log entry
0709 13:14:36.015853 (+116267us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b1800263b00. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e5896e07 00007f61ee6f1ab9 00007f61e58b369b 00007f61e58b193f 00007f61e58b1455 00007f61e891e190 00007f61e8917ae7 00007f61e8916dd9 00007f61e8921930
0709 13:14:36.100470 (+ 84617us) op_driver.cc:464] REPLICATION: finished
0709 13:14:36.159867 (+ 59397us) write_op.cc:301] APPLY: starting
0709 13:14:36.159975 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:36.161938 (+  1963us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:36.161961 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:36.163387 (+  1426us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:36.163613 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:14:36.163662 (+    49us) write_op.cc:312] APPLY: finished
0709 13:14:36.163900 (+   238us) log.cc:844] Serialized 33 byte log entry
0709 13:14:36.171088 (+  7188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:36.171206 (+   118us) write_op.cc:454] Released schema lock
0709 13:14:36.171255 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:36.171724 (+   469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:36.171752 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":364391,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":59098,"apply.run_cpu_time_us":4868,"apply.run_wall_time_us":11847,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"num_ops":2,"prepare.queue_time_us":201593,"prepare.run_cpu_time_us":20776,"prepare.run_wall_time_us":90162,"raft.queue_time_us":97351,"raft.run_cpu_time_us":9722,"raft.run_wall_time_us":44002,"replication_time_us":209619,"spinlock_wait_cycles":20549760,"thread_start_us":285849,"threads_started":4,"wal-append.queue_time_us":80749}]]}
I20260709 13:14:36.201298 29471 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:36.219343 29291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33534 (request call id 305) took 1106 ms. Trace:
I20260709 13:14:36.219790 29291 rpcz_store.cc:276] 0709 13:14:35.113054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.113212 (+   158us) service_pool.cc:224] Handling call
0709 13:14:36.219268 (+1106056us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10721,"reported_tablets":4}
I20260709 13:14:36.228896 29295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33552 (request call id 320) took 1353 ms. Trace:
I20260709 13:14:36.229604 29295 rpcz_store.cc:276] 0709 13:14:34.875083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.875309 (+   226us) service_pool.cc:224] Handling call
0709 13:14:36.228792 (+1353483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66502,"reported_tablets":4}
I20260709 13:14:36.234695 29471 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:36.234863 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:36.235597 30152 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.232069 29544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:36.238131 29544 raft_consensus.cc:3055] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:36.238523 29544 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:36.239463 29544 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:36.248700 29544 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.248878  2573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49092 (request call id 982) took 1045 ms. Trace:
I20260709 13:14:36.249454  2573 rpcz_store.cc:276] 0709 13:14:35.203144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.203555 (+   411us) service_pool.cc:224] Handling call
0709 13:14:35.379570 (+176015us) ts_tablet_manager.cc:934] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
0709 13:14:35.949794 (+570224us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:36.042507 (+ 92713us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:36.042722 (+   215us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:36.247957 (+205235us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:36.248288 (+   331us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:36.248665 (+   377us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:36.248726 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":40134,"tablet-copy.queue_time_us":88093,"thread_start_us":199082,"threads_started":2}
I20260709 13:14:36.258086  2573 tablet_copy_client.cc:806] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:36.283651 30152 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:36.285763 29464 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:36.290233 29435 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:36.258801  2573 tablet_copy_client.cc:670] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:36.293301  2560 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:36.296025  2560 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:36.305064 29544 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:36.305951 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:36.306687 29539 raft_consensus.cc:3055] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:36.307046 29539 raft_consensus.cc:740] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:36.311599 29464 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Requested vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:36.309576 29539 consensus_queue.cc:260] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:36.313226 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:36.317639 30152 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.320443 29539 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.327196  2560 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:36.370509 30152 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 14.
I20260709 13:14:36.372627 29435 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:36.380492 29539 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 14.
I20260709 13:14:36.381456  2557 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:36.393268  2557 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:36.406641  2573 tablet_copy_client.cc:538] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:36.422644  2557 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:36.425745  2481 log.cc:927] Time spent T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.110s	user 0.006s	sys 0.000s
I20260709 13:14:36.435506  2481 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.443871  2481 tablet_bootstrap.cc:492] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:36.444895  2481 ts_tablet_manager.cc:1403] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.774s	user 0.071s	sys 0.032s
I20260709 13:14:36.454114 30152 consensus_queue.cc:237] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:36.454033  2513 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.465304  2513 tablet_bootstrap.cc:492] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:36.469596  2513 ts_tablet_manager.cc:1403] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.476s	user 0.037s	sys 0.021s
I20260709 13:14:36.486443  2573 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:36.496449 29295 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 10 to 11, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.497790 29388 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:14:36.499315  2513 raft_consensus.cc:359] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:36.499380  2481 raft_consensus.cc:359] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:36.501101  2513 raft_consensus.cc:740] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:36.501205  2481 raft_consensus.cc:740] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:36.508165  2378 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:36.509441 29539 raft_consensus.cc:1275] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:14:36.515137  2378 consensus_queue.cc:1048] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:36.502722  2481 consensus_queue.cc:260] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:36.522598  2378 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEADER]: Committing config change with OpId 13.13: config changed from index 9 to 13, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:36.501891  2513 consensus_queue.cc:260] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:36.523030 29388 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 9 to 13, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:36.530516  2513 ts_tablet_manager.cc:1434] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.002s
I20260709 13:14:36.532337 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-77e08f37d90645918ef0bee732dd4b98 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:14:36.532799 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-77e08f37d90645918ef0bee732dd4b98 on tablet 77e08f37d90645918ef0bee732dd4b98 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:36.536335  2481 ts_tablet_manager.cc:1434] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.002s
I20260709 13:14:36.538262 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-61f7f02fdc8243cd8806a09e7908831e received from {username='slave'} at 127.0.0.1:51828
I20260709 13:14:36.538753 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-61f7f02fdc8243cd8806a09e7908831e on tablet 61f7f02fdc8243cd8806a09e7908831e with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:36.544694 29539 raft_consensus.cc:2955] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 9 to 13, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:36.563351 29295 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 13 to 14, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 14 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.593973 29279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0585fb6756aa496392b1ee0371aa9804 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:36.597975 29294 catalog_manager.cc:5697] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 9 to 13, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 13 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:36.637602 30153 raft_consensus.cc:1217] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:14:36.640365 30152 raft_consensus.cc:1217] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:14:36.644709  2573 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:14:36.658799  2573 tablet_bootstrap.cc:492] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:36.659792  2573 ts_tablet_manager.cc:1403] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.174s	user 0.029s	sys 0.009s
I20260709 13:14:36.664158  2573 raft_consensus.cc:359] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:36.667363  2573 raft_consensus.cc:740] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:36.668056  2573 consensus_queue.cc:260] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:36.670632  2573 ts_tablet_manager.cc:1434] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:14:36.673105 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5c7e9523dd804c659b1f0d34ac3eefb3 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:14:36.673554 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5c7e9523dd804c659b1f0d34ac3eefb3 on tablet 5c7e9523dd804c659b1f0d34ac3eefb3 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:36.706583 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 0585fb6756aa496392b1ee0371aa9804 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:36.802336  2603 tablet_replica.cc:333] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:14:36.809372  2603 raft_consensus.cc:2243] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.820405  2603 raft_consensus.cc:2272] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.831317 30152 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:36.834779  2560 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:36.850355  2603 ts_tablet_manager.cc:1916] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:36.906299  2603 ts_tablet_manager.cc:1929] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.12
I20260709 13:14:36.923100  2603 log.cc:1199] T 0585fb6756aa496392b1ee0371aa9804 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/0585fb6756aa496392b1ee0371aa9804
I20260709 13:14:36.925966 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 0585fb6756aa496392b1ee0371aa9804 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:36.935757 29544 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:36.960240  2547 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:36.971156 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:36.981226  2589 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.981959  2589 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:36.987789 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:36.988615 29396 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:36.990245 29509 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:36.991075  2460 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:36.991557  2460 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.991959  2460 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:36.995393 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:36.996126 29464 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:36.984496  2589 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:37.016292 29539 raft_consensus.cc:1275] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:37.030984  2560 consensus_queue.cc:1048] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:37.071278 30152 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:37.075105  2560 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:37.116402  2589 raft_consensus.cc:1064] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:37.139515  2589 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:37.210788  2560 raft_consensus.cc:1064] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:37.219648  2460 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:37.221959  2460 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:37.225598  2560 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:37.228379 29471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:37.234594 29471 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:37.244889 29471 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:14:37.246536 29512 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:37.283661 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:37.289753 29395 raft_consensus.cc:3060] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:37.267269  2460 raft_consensus.cc:2804] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:37.300395  2460 raft_consensus.cc:697] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:37.286681  2617 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.302917  2617 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:37.307161 29395 raft_consensus.cc:2468] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:14:37.310667 29395 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:37.301745  2460 consensus_queue.cc:237] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:37.316846 30153 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:37.322127  2478 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:37.318015  2617 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:37.318112 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:37.328295 29464 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:14:37.316931 29546 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:37.330466 29512 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:37.331483  2617 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:37.331892  2617 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.332228  2617 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:37.334646  2478 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:14:37.346516 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 56737.4us
I20260709 13:14:37.347114 29463 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:37.350580  2589 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:37.362382  2617 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:37.365533  2617 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:37.368036 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:37.370543 29463 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:37.341773  2478 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:14:37.426074 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 132516us
I20260709 13:14:37.436827 30152 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:37.425501  2492 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.440171 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:37.440975 29396 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:37.441555 29388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:37.442605 29463 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 8.
I20260709 13:14:37.450323 29512 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:37.454424  2492 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:37.459028  2492 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:37.459702 29395 raft_consensus.cc:2468] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 7.
I20260709 13:14:37.485090  2589 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:37.487897 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:37.489264 29464 raft_consensus.cc:2393] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88760af579b54a6393c6251aa3c6b870 in current term 8: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:37.489034  2622 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:37.497076 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:37.519824 29294 catalog_manager.cc:5697] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.504525  2460 raft_consensus.cc:2804] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:37.589373 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 59909us
I20260709 13:14:37.628552  2460 raft_consensus.cc:697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:37.671129  2460 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:37.659838 29544 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:37.677454  2471 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:37.695406 30157 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:37.687472 30153 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:37.761724 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 69333.4us
W20260709 13:14:37.778499 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52437.1us
I20260709 13:14:37.782735 29290 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:37.828850 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 75490.7us
I20260709 13:14:37.836023 29463 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:37.860952 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 91129.5us
I20260709 13:14:37.682782  2478 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:37.932663 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 153018us
W20260709 13:14:37.939702 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 66459.7us
W20260709 13:14:37.941574 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 83820.7us
I20260709 13:14:37.951527 29394 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:37.983196 29397 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:37.993280 29394 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:37.993508 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:38.002745  2621 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:38.015239 29468 raft_consensus.cc:1275] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:38.017796  2621 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:38.023104  2617 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:38.048285 29295 catalog_manager.cc:5697] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 7 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.057819 30153 raft_consensus.cc:3060] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 LEARNER]: Advancing to term 8
I20260709 13:14:38.069000 30153 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:38.102319 29463 consensus_queue.cc:237] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:38.104856 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:38.100214 29291 catalog_manager.cc:5697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130), VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131), NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 8 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.119884  2649 consensus_queue.cc:1048] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:38.148753 30152 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:38.134435 29388 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:38.150563  2478 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:38.158715  2615 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.177217 29464 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:38.184921  2649 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:14:38.200544 29539 consensus_queue.cc:237] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:38.203784 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77e08f37d90645918ef0bee732dd4b98 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:38.229617 29388 raft_consensus.cc:1275] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:38.231544  2610 consensus_queue.cc:1048] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:38.236375  2649 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:38.235960 29394 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.252223  2640 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:38.248483 30153 raft_consensus.cc:2955] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.299757 30157 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:38.329293 29394 raft_consensus.cc:1275] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:38.387504  2622 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.397857 29463 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.385192  2460 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:14:38.424444  2622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51814 (request call id 18) took 4897 ms. Trace:
I20260709 13:14:38.424970  2622 rpcz_store.cc:276] 0709 13:14:33.527386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.527632 (+   246us) service_pool.cc:224] Handling call
0709 13:14:33.919486 (+391854us) log.cc:844] Serialized 513 byte log entry
0709 13:14:34.407977 (+488491us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b1800378ee0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e582ec0a 00007f61eef6e219 00007f61e58b6a40 00007f61e58b14e4 00007f61e58b1455 00007f61e88fab0b 00007f61e897fb63 00007f61e89a7752 00007f61ed967d29
0709 13:14:34.722375 (+314398us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4c00108400. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e6c6da20 00007f61e6c7ea29 00007f61e6c7f13f 00007f61e6c432ab 00007f61e6c70f3c 00007f61e6c713fe 00007f61e6efe50b 00007f61e88fd381 00007f61e88fb26b 00007f61e8901d53 00007f61e8901cd9
0709 13:14:38.424340 (+3701965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108362,"raft.queue_time_us":210313,"raft.run_cpu_time_us":11695,"raft.run_wall_time_us":554135,"spinlock_wait_cycles":72532224,"thread_start_us":278143,"threads_started":1,"wal-append.queue_time_us":344789,"wal-append.run_cpu_time_us":3916,"wal-append.run_wall_time_us":1115851}
I20260709 13:14:38.425736  2613 consensus_queue.cc:1048] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:38.434489  2649 raft_consensus.cc:1064] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:38.444204 30159 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.477824 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:38.479112 29468 raft_consensus.cc:606] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Received request to transfer leadership to TS 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:38.488368 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:38.489184 29468 raft_consensus.cc:606] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:38.495110  2617 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.496416 29544 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:38.437145  2649 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:38.508002 29468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:38.508661 29468 raft_consensus.cc:606] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:38.507752 30153 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.509049 29468 raft_consensus.cc:630] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Rejecting request to transfer leadership because tablet server 7c2e8d3e55c649e2b3acedef25d81e16 is not a voter in the active config
I20260709 13:14:38.522519 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:38.525676 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:38.521392 29291 catalog_manager.cc:5697] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 8 to 9, VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) evicted. New cstate: current_term: 8 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.580873 29468 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:38.605314 29468 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:38.607764  2649 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:38.611464 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 61f7f02fdc8243cd8806a09e7908831e with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:38.616269 29388 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:14:38.627883 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5afd3c3bb2df4807a6bdcea59110dee6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:38.632035 29394 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:38.631310 29395 raft_consensus.cc:2955] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.634267  2614 raft_consensus.cc:993] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:14:38.634821  2614 raft_consensus.cc:1081] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Signalling peer 88760af579b54a6393c6251aa3c6b870 to start an election
I20260709 13:14:38.644912 29532 tablet_service.cc:1558] Processing DeleteTablet for tablet 77e08f37d90645918ef0bee732dd4b98 with delete_type TABLET_DATA_TOMBSTONED (TS 7c2e8d3e55c649e2b3acedef25d81e16 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:36160
I20260709 13:14:38.651468 30153 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:38.636957  2649 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:14:38.653767 29394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
 from {username='slave'} at 127.0.0.1:36874
I20260709 13:14:38.654368 29394 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.654793 29394 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:38.642913 29295 catalog_manager.cc:5697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added, pending config changed, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.705693  2640 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:38.712848 29294 catalog_manager.cc:5697] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 10 to 11, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.749531 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 61f7f02fdc8243cd8806a09e7908831e with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:38.751436  2460 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:38.769011  2478 raft_consensus.cc:993] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:38.769647  2478 raft_consensus.cc:1081] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:38.783824 29539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:14:38.784668 29539 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.785137 29539 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.766300 29394 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:38.796216 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:38.796875 29464 raft_consensus.cc:3055] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:38.797190 29464 raft_consensus.cc:740] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:38.799686 29394 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:38.799475 29464 consensus_queue.cc:260] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:38.804860 29464 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:38.809281  2460 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:38.809892  2668 tablet_replica.cc:333] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:14:38.811251  2668 raft_consensus.cc:2243] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:38.812147  2668 raft_consensus.cc:2272] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:38.812212 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:38.812865 29541 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:38.808115 29388 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.828120 29539 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:38.829306 29541 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:38.836297 29539 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:38.837183 29464 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88760af579b54a6393c6251aa3c6b870 in term 10.
I20260709 13:14:38.837563 29468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:38.838182 29468 raft_consensus.cc:3055] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:38.838474 29468 raft_consensus.cc:740] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:38.839264 29468 consensus_queue.cc:260] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:38.840452 29468 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.845480 29363 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870; no voters: 
I20260709 13:14:38.846489  2645 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:38.848299  2645 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Leader. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:38.856029 29468 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:38.856168  2645 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:38.857254 29512 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:38.860710  2460 raft_consensus.cc:2804] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:38.861254  2460 raft_consensus.cc:697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:38.861639 29395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:38.864496  2668 ts_tablet_manager.cc:1916] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:38.868994 29463 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.862265 29395 raft_consensus.cc:3060] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.869732 30153 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.866820  2617 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.879377  2665 tablet_replica.cc:333] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:14:38.880826  2665 raft_consensus.cc:2243] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:38.862262  2460 consensus_queue.cc:237] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:38.881937  2665 raft_consensus.cc:2272] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:38.866074  2642 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 6 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.918351 29395 raft_consensus.cc:2468] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:38.924429 29290 catalog_manager.cc:5697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 6 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129), VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130), VOTER 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131), VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 8 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.958249 29390 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.961270 29295 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:38.970583 29388 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:38.976421  2665 ts_tablet_manager.cc:1916] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:39.086405 29295 catalog_manager.cc:5697] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 11 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:39.099054 29290 catalog_manager.cc:5697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: term changed from 9 to 10, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 88760af579b54a6393c6251aa3c6b870 (127.27.150.129). New cstate: current_term: 10 leader_uuid: "88760af579b54a6393c6251aa3c6b870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.099874 29464 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:39.118664  2668 ts_tablet_manager.cc:1929] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:14:39.119387  2668 log.cc:1199] T 61f7f02fdc8243cd8806a09e7908831e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/61f7f02fdc8243cd8806a09e7908831e
I20260709 13:14:39.121374 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 61f7f02fdc8243cd8806a09e7908831e (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:39.143819 29541 consensus_queue.cc:237] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:39.150785 30153 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:14:39.153971  2671 log.cc:927] Time spent T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:14:39.154956  2460 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:39.175527  2672 ts_tablet_manager.cc:933] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:39.197575  2460 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:39.203063 30153 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:39.210134 29390 raft_consensus.cc:1275] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:39.241021  2672 tablet_copy_client.cc:323] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:14:39.242599  2649 consensus_queue.cc:1048] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:39.288317 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 5afd3c3bb2df4807a6bdcea59110dee6 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:14:39.288949 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 5afd3c3bb2df4807a6bdcea59110dee6 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-5afd3c3bb2df4807a6bdcea59110dee6
I20260709 13:14:39.300561 29390 raft_consensus.cc:2955] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:39.306521  2665 ts_tablet_manager.cc:1929] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:14:39.307121  2665 log.cc:1199] T 77e08f37d90645918ef0bee732dd4b98 P 7c2e8d3e55c649e2b3acedef25d81e16: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/wals/77e08f37d90645918ef0bee732dd4b98
I20260709 13:14:39.318364 29556 tablet_copy_source_session.cc:215] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:39.331077  2672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5afd3c3bb2df4807a6bdcea59110dee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:39.340785 29282 catalog_manager.cc:5028] TS 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): tablet 77e08f37d90645918ef0bee732dd4b98 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
I20260709 13:14:39.341949 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c7e9523dd804c659b1f0d34ac3eefb3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:39.354179 29295 catalog_manager.cc:5697] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: config changed from index 8 to 9, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 8 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:39.375420 29464 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:39.380213 29388 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:39.395392  2460 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:39.395774  2621 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:39.507587 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c7e9523dd804c659b1f0d34ac3eefb3 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:59284
W20260709 13:14:39.589766 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 84936.4us
I20260709 13:14:39.592999 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:39.594714  2668 tablet_replica.cc:333] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:14:39.595095  2672 tablet_copy_client.cc:806] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:39.595784  2672 tablet_copy_client.cc:670] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:39.596035  2668 raft_consensus.cc:2243] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:39.597148  2668 raft_consensus.cc:2272] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:39.602733  2668 ts_tablet_manager.cc:1916] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:39.607275 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 187134us
W20260709 13:14:39.719762 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 92691.3us
I20260709 13:14:39.806989 29469 raft_consensus.cc:1275] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:14:39.811523  2675 log.cc:927] Time spent T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
W20260709 13:14:39.862706 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 246229us
W20260709 13:14:39.897763 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 81173us
I20260709 13:14:39.908612  2622 consensus_queue.cc:1048] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:39.984261 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 95748.5us
W20260709 13:14:39.987697 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 50436.6us
W20260709 13:14:40.014181 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 113432us
W20260709 13:14:40.098518 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 103633us
I20260709 13:14:40.143713  2668 ts_tablet_manager.cc:1929] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:14:40.188599 29541 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer 88760af579b54a6393c6251aa3c6b870: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:40.175843  2668 log.cc:1199] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/5c7e9523dd804c659b1f0d34ac3eefb3
I20260709 13:14:40.213537 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 5c7e9523dd804c659b1f0d34ac3eefb3 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
W20260709 13:14:40.192981 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 69401us
I20260709 13:14:40.256639  2672 tablet_copy_client.cc:538] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:40.329835  2672 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
W20260709 13:14:40.371454 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 138148us
I20260709 13:14:40.503556  2692 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.505134  2692 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:40.519768 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:40.536955 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 88734.4us
I20260709 13:14:40.514314  2692 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:40.542841 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 73041.1us
I20260709 13:14:40.631173  2701 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:40.759658 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "88760af579b54a6393c6251aa3c6b870" is_pre_election: true
I20260709 13:14:40.786329  2672 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:40.822726  2672 tablet_bootstrap.cc:492] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:40.886790  2672 ts_tablet_manager.cc:1403] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.557s	user 0.041s	sys 0.033s
I20260709 13:14:40.892107 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:40.904430  2641 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:40.925033  2672 raft_consensus.cc:359] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:40.933112  2672 raft_consensus.cc:740] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:40.933915  2672 consensus_queue.cc:260] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:40.954152  2672 ts_tablet_manager.cc:1434] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.002s
I20260709 13:14:40.957181 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5afd3c3bb2df4807a6bdcea59110dee6 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:14:40.957826 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-5afd3c3bb2df4807a6bdcea59110dee6 on tablet 5afd3c3bb2df4807a6bdcea59110dee6 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:41.115264 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:41.387780 30153 raft_consensus.cc:1217] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:14:41.389843 29394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6"
dest_uuid: "88760af579b54a6393c6251aa3c6b870"
mode: GRACEFUL
new_leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:38970
I20260709 13:14:41.390735 29394 raft_consensus.cc:606] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Received request to transfer leadership to TS 7c2e8d3e55c649e2b3acedef25d81e16
I20260709 13:14:41.396981 29466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a"
dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:40742
I20260709 13:14:41.397603 29466 raft_consensus.cc:606] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:41.404659 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:41.410130 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:41.450858  2701 raft_consensus.cc:993] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: : Instructing follower 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:41.451587  2701 raft_consensus.cc:1081] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Signalling peer 7c2e8d3e55c649e2b3acedef25d81e16 to start an election
I20260709 13:14:41.453727 29546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:14:41.454375 29546 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.454844 29546 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.489682 29546 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:41.497092 29546 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:41.499316 29394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "88760af579b54a6393c6251aa3c6b870"
I20260709 13:14:41.500133 29394 raft_consensus.cc:3055] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:41.500620 29394 raft_consensus.cc:740] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 88760af579b54a6393c6251aa3c6b870, State: Running, Role: LEADER
I20260709 13:14:41.501588 29394 consensus_queue.cc:260] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:41.500038 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:41.509969 30151 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.520076 29394 raft_consensus.cc:3060] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.585111 30151 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:41.612039 29509 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:41.613318  2687 raft_consensus.cc:2804] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:41.613924  2687 raft_consensus.cc:697] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:41.615018  2687 consensus_queue.cc:237] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:41.629209 29394 raft_consensus.cc:2468] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:41.717794  2680 raft_consensus.cc:993] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:41.718482  2680 raft_consensus.cc:1081] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:41.720281 30153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49108
I20260709 13:14:41.720908 30153 raft_consensus.cc:493] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.721243 30153 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.709656 29290 catalog_manager.cc:5697] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 10 to 11, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:41.762850 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 60090.1us
I20260709 13:14:41.835587 30153 raft_consensus.cc:515] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:41.844961 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:41.845649 29469 raft_consensus.cc:3055] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:41.845953 29469 raft_consensus.cc:740] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:41.846922 29469 consensus_queue.cc:260] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:41.848294 29469 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.851538 30153 leader_election.cc:290] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:41.862819 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01483a998944f4386fc5dfa1f0fd51a" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:41.863610 29541 raft_consensus.cc:3060] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.865815  2642 raft_consensus.cc:1064] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:41.870858  2642 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:41.876560 29469 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:14:41.878815 29541 raft_consensus.cc:2468] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:14:41.881204 30126 leader_election.cc:304] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:41.882843  2690 raft_consensus.cc:2804] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:41.883375  2690 raft_consensus.cc:697] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:41.884330  2690 consensus_queue.cc:237] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:41.902984 29469 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:41.904645 30153 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:41.911317  2641 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:41.906556 29388 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:41.922899  2642 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:41.939514  2642 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:41.957581 29295 catalog_manager.cc:5697] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 11 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 12 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.973233  2717 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:41.975054 30153 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:41.997466 29396 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:42.024408 29469 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:42.028167 29290 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.034390 29396 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:42.036239  2717 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:42.099285 29541 consensus_queue.cc:237] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:42.153231 29396 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:42.155108 30151 raft_consensus.cc:1275] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:42.157596 30153 raft_consensus.cc:1275] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:42.173118  2642 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:42.176819  2687 consensus_queue.cc:1048] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:42.204074  2687 consensus_queue.cc:1048] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:42.275352  2613 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:42.288520 30153 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:42.299556 29396 raft_consensus.cc:2955] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:42.327617 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5afd3c3bb2df4807a6bdcea59110dee6 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:42.337046 29295 catalog_manager.cc:5697] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index 9 to 10, VOTER 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) evicted. New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:42.397379 29453 tablet_service.cc:1558] Processing DeleteTablet for tablet 5afd3c3bb2df4807a6bdcea59110dee6 with delete_type TABLET_DATA_TOMBSTONED (TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:42.411623 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:42.424803 29466 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:42.430552  2690 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:42.435524  2732 tablet_replica.cc:333] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:14:42.437013  2732 raft_consensus.cc:2243] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.437820  2732 raft_consensus.cc:2272] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.471746 29546 raft_consensus.cc:1275] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:42.474532  2684 consensus_queue.cc:1048] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:42.556761  2732 ts_tablet_manager.cc:1916] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:42.656862  2732 ts_tablet_manager.cc:1929] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:14:42.657431  2732 log.cc:1199] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Deleting WAL directory at /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/wals/5afd3c3bb2df4807a6bdcea59110dee6
I20260709 13:14:42.659549 29282 catalog_manager.cc:5028] TS 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): tablet 5afd3c3bb2df4807a6bdcea59110dee6 (table test-workload [id=5433e180200445a58200b950e8ca4a4b]) successfully deleted
W20260709 13:14:43.193985 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 153141us
I20260709 13:14:43.551537 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:43.564069 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 77903.9us
W20260709 13:14:43.573848 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 87051.4us
W20260709 13:14:43.634191 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 53968.8us
I20260709 13:14:43.790225 29540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334"
dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
mode: GRACEFUL
new_leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:51398
I20260709 13:14:43.790973 29540 raft_consensus.cc:606] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Received request to transfer leadership to TS c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:43.806668 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:14:43.809384 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:43.825150 29463 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:43.948918 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 930d24af7f0e45c19e80e2efaab717d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.952387 29540 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:43.954223  2680 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:43.957897  2757 raft_consensus.cc:993] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: : Instructing follower c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:43.958664  2757 raft_consensus.cc:1081] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Signalling peer c65265f20d7e42b6bfe314c5d109bdf7 to start an election
I20260709 13:14:43.960843 30153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334"
dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
 from {username='slave'} at 127.0.0.1:49092
I20260709 13:14:43.961475 30153 raft_consensus.cc:493] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:43.961828 30153 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.964767 29396 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:43.967459  2750 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:43.991338  2750 raft_consensus.cc:2955] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:43.999751 29540 raft_consensus.cc:2955] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:44.004767 30153 raft_consensus.cc:515] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:44.009749 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:44.010479 29463 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:44.016134 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225e23ac0b4c490cb213c4d4945ec334" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:44.016855 29543 raft_consensus.cc:3055] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:44.017138 29543 raft_consensus.cc:740] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:44.018055 29543 consensus_queue.cc:260] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:44.019621 29543 raft_consensus.cc:3060] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:44.022540 30153 leader_election.cc:290] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:44.036721 29543 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:44.038950 30126 leader_election.cc:304] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:44.039233 29463 raft_consensus.cc:2468] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
I20260709 13:14:44.054016  2684 raft_consensus.cc:2804] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:44.054682  2684 raft_consensus.cc:697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:44.055721  2684 consensus_queue.cc:237] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:44.047410 29295 catalog_manager.cc:5697] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.063278 29467 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:44.048687 29388 raft_consensus.cc:2955] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:14:44.145654 29435 consensus_peers.cc:597] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29153e3fc529491aa91c830a4456d35a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:44.146075 29388 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:44.147186 29543 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:44.149526  2683 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:44.150594  2680 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:44.189792 29294 catalog_manager.cc:5697] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 13 to 14, leader changed from 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 14 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:44.209457  2683 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:44.211582 29388 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:44.225421 29543 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:44.233669 29540 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
W20260709 13:14:44.396697 30181 debug-util.cc:398] Leaking SignalData structure 0x7b080022ad80 after lost signal to thread 28253
W20260709 13:14:44.398561 30181 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8820 after lost signal to thread 29329
W20260709 13:14:44.400559 30181 debug-util.cc:398] Leaking SignalData structure 0x7b0800278f20 after lost signal to thread 29421
W20260709 13:14:44.402292 30181 debug-util.cc:398] Leaking SignalData structure 0x7b080025c8c0 after lost signal to thread 29496
W20260709 13:14:44.404228 30181 debug-util.cc:398] Leaking SignalData structure 0x7b080016b300 after lost signal to thread 29570
W20260709 13:14:44.406190 30181 debug-util.cc:398] Leaking SignalData structure 0x7b080034e6c0 after lost signal to thread 30184
I20260709 13:14:44.445437 29467 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:14:44.447492  2758 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:44.464772  2773 ts_tablet_manager.cc:933] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:44.486841  2773 tablet_copy_client.cc:323] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:14:44.495658 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 930d24af7f0e45c19e80e2efaab717d7 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:14:44.496323 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 930d24af7f0e45c19e80e2efaab717d7 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-930d24af7f0e45c19e80e2efaab717d7
I20260709 13:14:44.525610 29481 tablet_copy_source_session.cc:215] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:44.590651 29467 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:44.596410 29546 raft_consensus.cc:1275] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:14:44.608163 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 45753.3us
I20260709 13:14:44.611009  2780 consensus_queue.cc:1048] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:44.601848  2747 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:14:44.643116  2773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930d24af7f0e45c19e80e2efaab717d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:44.742177 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50016.7us
I20260709 13:14:44.769353  2787 ts_tablet_manager.cc:933] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:44.786149 29291 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 reported cstate change: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:44.815588 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:44.838861 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 48083.5us
W20260709 13:14:44.901926 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 74354.3us
I20260709 13:14:44.906699  2787 tablet_copy_client.cc:323] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
W20260709 13:14:44.915310 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 90692.7us
W20260709 13:14:44.929522 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 122813us
I20260709 13:14:44.947059 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 29153e3fc529491aa91c830a4456d35a from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:14:44.947736 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 29153e3fc529491aa91c830a4456d35a from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-29153e3fc529491aa91c830a4456d35a
I20260709 13:14:44.989599 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
I20260709 13:14:45.020669 29481 tablet_copy_source_session.cc:215] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:45.082926 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 121868us
W20260709 13:14:45.090004 29509 consensus_peers.cc:597] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02ea2318003a42fea9088b490db583f1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.093330 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 131077us
I20260709 13:14:45.158874  2773 tablet_copy_client.cc:806] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
W20260709 13:14:45.168983 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 69159.3us
W20260709 13:14:45.171192 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 50463.4us
W20260709 13:14:45.174798 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 64526.1us
I20260709 13:14:45.169088  2773 tablet_copy_client.cc:670] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
W20260709 13:14:45.194795 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 107435us
W20260709 13:14:45.199409 29435 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:45.222569 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 54350.8us
I20260709 13:14:45.222954  2805 ts_tablet_manager.cc:933] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:45.228199  2787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29153e3fc529491aa91c830a4456d35a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:45.263782 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 163606us
W20260709 13:14:45.264926 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 66062.3us
W20260709 13:14:45.272492 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 57229.4us
I20260709 13:14:45.274847  2745 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:45.342238  2773 tablet_copy_client.cc:538] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:45.350883  2805 tablet_copy_client.cc:323] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.131:42971
I20260709 13:14:45.348902 29465 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:14:45.378144 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 104392us
I20260709 13:14:45.404256 29556 tablet_copy_service.cc:140] P 7c2e8d3e55c649e2b3acedef25d81e16: Received BeginTabletCopySession request for tablet 02ea2318003a42fea9088b490db583f1 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:51828)
I20260709 13:14:45.406904 29556 tablet_copy_service.cc:161] P 7c2e8d3e55c649e2b3acedef25d81e16: Beginning new tablet copy session on tablet 02ea2318003a42fea9088b490db583f1 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:51828: session id = c65265f20d7e42b6bfe314c5d109bdf7-02ea2318003a42fea9088b490db583f1
W20260709 13:14:45.414045 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.404036  2745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51814 (request call id 20) took 1164 ms. Trace:
W20260709 13:14:45.425099 29509 consensus_peers.cc:597] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.427874 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 171561us
I20260709 13:14:45.426473  2745 rpcz_store.cc:276] 0709 13:14:44.231135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.231295 (+   160us) service_pool.cc:224] Handling call
0709 13:14:44.238057 (+  6762us) log.cc:844] Serialized 513 byte log entry
0709 13:14:44.676219 (+438162us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b5400291c18. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e895d7bc 00007f61e89602c0 00007f61e8960248 00007f61e89601c8 00007f61e8960183 00007f61e895f44c 00007f61ee80c626 00007f61ee806dd8 00007f61e8548b41 00007f61e853bf2a
0709 13:14:44.778326 (+102107us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5400291ba0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8916dbe 00007f61e8921930 00007f61e89218d8 00007f61e8921858 00007f61e8921813 00007f61e8920a9c 00007f61ee80c626 00007f61ee806dd8 00007f61e895d7cb 00007f61e89602c0
0709 13:14:44.779509 (+  1183us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b1800480280. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61ee77cde1 00007f61ee7895b1 00007f61e58822a6 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8921b26 00007f61e891b49a 00007f61e891a714
0709 13:14:44.780495 (+   986us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b5400291ba0. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e890a571 00007f61e8921b26 00007f61e891b49a 00007f61e891a714 00007f61e88faeaa 00007f61e8901d53 00007f61e8901cd9 00007f61e8901c69 00007f61e8901c31 00007f61e8900dfd 000000000038f354
0709 13:14:45.386671 (+606176us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":218,"mutex_wait_us":19410,"raft.queue_time_us":3854,"raft.run_cpu_time_us":5834,"raft.run_wall_time_us":193707,"spinlock_wait_cycles":351405312,"thread_start_us":346808,"threads_started":1,"wal-append.queue_time_us":367754}
I20260709 13:14:45.445111  2773 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:45.456892 29556 tablet_copy_source_session.cc:215] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:45.459983 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.461439 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.462041 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.467298 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.468008 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.468544 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.473626 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.483053 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.472144 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.483723 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.487793 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 61036.2us
W20260709 13:14:45.488045 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.492430  2805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea2318003a42fea9088b490db583f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:45.506739 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.509389 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.510018 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.510571 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.511132 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.511695 29435 consensus_peers.cc:597] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.519593 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.520813  2809 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:45.534231  2809 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:45.537892  2809 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:45.534224 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.540093 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.541152 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.545645 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.541544  2787 tablet_copy_client.cc:806] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:45.549015  2787 tablet_copy_client.cc:670] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:45.560300 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:45.557004 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.562712 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:45.565596 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.572548 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:45.576757  2770 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:45.579008 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.580114 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.581933 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.583375 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.584263  2821 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:45.584964  2821 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:45.584969 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.590386 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.594568  2821 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:45.597551 29466 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:45.586046  2787 tablet_copy_client.cc:538] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:45.611079 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:45.613538 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:45.619192 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:45.621130  2809 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:45.687901  2805 tablet_copy_client.cc:806] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:45.688659  2805 tablet_copy_client.cc:670] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:45.712241 29540 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:45.724279  2809 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:45.727123  2809 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:45.729629  2809 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:45.732807  2812 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:45.736647 29294 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 8, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.741417 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:45.743160 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.757015  2821 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:14:45.765010 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609): Couldn't send request to peer c65265f20d7e42b6bfe314c5d109bdf7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48cbba4289f149fa85b4f656897b6390. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.757654  2805 tablet_copy_client.cc:538] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:45.776211  2821 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:45.798117 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:45.802421 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:45.807497  2821 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:45.809445 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:45.813186 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:45.814558  2821 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:45.827750 29363 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:45.828848  2821 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:45.828930  2805 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:45.835583 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:45.841984  2787 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:45.852732  2750 raft_consensus.cc:2955] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:45.858773 29539 raft_consensus.cc:2955] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
W20260709 13:14:46.006981 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 74967.7us
I20260709 13:14:46.010556  2818 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.011224  2818 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.013863  2818 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.016352  2818 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.016944  2818 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.019466  2821 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.020117  2821 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.022221  2821 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.028327  2818 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.035559 29290 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index -1 to 9, NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) added. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } } }
I20260709 13:14:46.043071 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.047998  2821 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.052156  2769 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.052830  2769 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.054903  2809 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.055533  2809 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.057934  2809 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.064885  2818 raft_consensus.cc:493] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.084252 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.092177 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.098012 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.065621  2818 raft_consensus.cc:515] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.103261 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.085690  2809 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.067893  2821 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:46.100013  2820 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.106964 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.111222 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.115200  2821 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.125270 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e08f37d90645918ef0bee732dd4b98" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.130600  2809 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.131721  2820 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.133052  2809 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.133877  2769 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.134194  2820 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.136920  2818 leader_election.cc:290] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:46.173096 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 69387us
I20260709 13:14:46.149619  2809 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.163166  2769 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.167208  2820 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.191256 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.193157  2773 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.197129  2770 raft_consensus.cc:493] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.197784  2770 raft_consensus.cc:515] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.194384  2773 tablet_bootstrap.cc:492] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:46.215480  2827 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.190287  2809 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.189090  2769 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.189435  2820 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.221871  2831 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.296944 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:46.231258  2773 ts_tablet_manager.cc:1403] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.786s	user 0.037s	sys 0.016s
W20260709 13:14:46.318638 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 104842us
I20260709 13:14:46.342682 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:46.227510  2827 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.304442  2830 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.427678 28250 tablet_replica.cc:333] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
W20260709 13:14:46.435158 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 206101us
I20260709 13:14:46.450616  2798 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.451524  2798 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.383426  2830 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.427052  2837 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.326462  2831 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.457451  2832 raft_consensus.cc:493] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.515491  2832 raft_consensus.cc:515] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.457553  2833 ts_tablet_manager.cc:933] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:46.486378 28250 raft_consensus.cc:2243] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:46.566161 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 223602us
I20260709 13:14:46.572410 28250 raft_consensus.cc:2272] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:46.577975 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.475458  2820 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.508926  2827 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.481352  2831 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.487756  2818 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.484229  2821 raft_consensus.cc:493] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.508112  2845 raft_consensus.cc:493] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.505330  2809 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.462790  2834 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.495872  2836 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.595570  2836 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.598089  2836 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.500010  2830 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.506058  2770 leader_election.cc:290] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:46.585705 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 206308us
I20260709 13:14:46.523176  2832 leader_election.cc:290] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.591490 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.592831  2845 raft_consensus.cc:515] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.479130  2837 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:46.605950  2837 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.606588  2818 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.609318  2818 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.609825  2821 raft_consensus.cc:515] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.610463  2787 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.611817  2787 tablet_bootstrap.cc:492] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:46.612108  2821 leader_election.cc:290] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.612416 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.612816  2787 ts_tablet_manager.cc:1403] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.771s	user 0.051s	sys 0.012s
I20260709 13:14:46.603366  2845 leader_election.cc:290] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.454408  2798 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.615440 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.483243  2773 raft_consensus.cc:359] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:46.618796 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6194a4e996b4050bfb519664b72df1c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.621598 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.622728 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.622783 28250 tablet_replica.cc:333] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:46.627686 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.634238 28250 raft_consensus.cc:2243] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:46.637259 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.623641  2773 raft_consensus.cc:740] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:46.659487 28250 raft_consensus.cc:2272] T 4a320582e5c548dd888eb981df817079 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:46.671317  2769 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.673187  2821 raft_consensus.cc:493] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.682777  2773 consensus_queue.cc:260] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:46.683511  2832 raft_consensus.cc:493] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.684149  2832 raft_consensus.cc:515] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.673945  2821 raft_consensus.cc:515] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.696209  2821 leader_election.cc:290] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.697952  2809 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:46.704249  2809 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:46.705552  2773 ts_tablet_manager.cc:1434] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.384s	user 0.009s	sys 0.000s
I20260709 13:14:46.703652 28250 tablet_replica.cc:333] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:46.706887  2849 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:46.707038  2830 raft_consensus.cc:493] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:46.707583  2849 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.707710  2830 raft_consensus.cc:515] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:46.709939  2830 leader_election.cc:290] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.706875 28250 raft_consensus.cc:2243] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:46.712314  2805 log.cc:927] Time spent T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
W20260709 13:14:46.712970 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 59001.2us
W20260709 13:14:46.713574 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 73462.9us
I20260709 13:14:46.730785 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-930d24af7f0e45c19e80e2efaab717d7 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:14:46.714166 29360 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.740204 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef663d2174234a11995ce0c886e35150" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.744240 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.731801 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.749329 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-930d24af7f0e45c19e80e2efaab717d7 on tablet 930d24af7f0e45c19e80e2efaab717d7 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.774662 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.712683  2849 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:46.779668 28250 raft_consensus.cc:2272] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:46.789232  2837 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.792745  2809 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.794062 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.797291  2787 raft_consensus.cc:359] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:46.798617 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.799223 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6c0a7893ec49c19f3e702094ed4941" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.806229 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.807893 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.810680 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.810972 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.811725 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.814512 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.818683 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.817981 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.798254  2787 raft_consensus.cc:740] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
W20260709 13:14:46.835417 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 197956us
I20260709 13:14:46.833577 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.835480 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2068d180d9904ad9abf956769d9a2f1d" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.833959 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.835063 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.831120 28250 tablet_replica.cc:333] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
W20260709 13:14:46.838028 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 123907us
I20260709 13:14:46.841979 29360 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:46.847298 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 99440.4us
I20260709 13:14:46.847482 29360 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.820554 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.817361  2833 tablet_copy_client.cc:323] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.27.150.130:39713
I20260709 13:14:46.849429  2809 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:46.856594  2787 consensus_queue.cc:260] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:46.851774  2849 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:46.859095  2787 ts_tablet_manager.cc:1434] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.246s	user 0.008s	sys 0.001s
I20260709 13:14:46.860126 29481 tablet_copy_service.cc:140] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Received BeginTabletCopySession request for tablet 48cbba4289f149fa85b4f656897b6390 from peer c65265f20d7e42b6bfe314c5d109bdf7 ({username='slave'} at 127.0.0.1:39036)
I20260709 13:14:46.860737 29481 tablet_copy_service.cc:161] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Beginning new tablet copy session on tablet 48cbba4289f149fa85b4f656897b6390 from peer c65265f20d7e42b6bfe314c5d109bdf7 at {username='slave'} at 127.0.0.1:39036: session id = c65265f20d7e42b6bfe314c5d109bdf7-48cbba4289f149fa85b4f656897b6390
I20260709 13:14:46.861207 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.861944 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f7f02fdc8243cd8806a09e7908831e" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.722560  2832 leader_election.cc:290] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:46.867975 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.869380 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc3743d348b41f48617d0cb35c85353" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.875543 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.876251 28250 raft_consensus.cc:2243] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:46.876709 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.880949 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.882294 29363 leader_election.cc:304] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.884855 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fdcb033993416ca10b3d79544c9d59" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.886662  2821 raft_consensus.cc:2749] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:46.897989 29481 tablet_copy_source_session.cc:215] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:46.901198 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40cc430e0bf4a5f946bc53291d0b771" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.902151 29482 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-29153e3fc529491aa91c830a4456d35a received from {username='slave'} at 127.0.0.1:39036
I20260709 13:14:46.902710 29482 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-29153e3fc529491aa91c830a4456d35a on tablet 29153e3fc529491aa91c830a4456d35a with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.903569 28250 raft_consensus.cc:2272] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:46.960304 30151 raft_consensus.cc:1217] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:14:46.962575 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.973115 29360 leader_election.cc:304] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.977831 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.978017 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:46.979879 29360 leader_election.cc:304] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.989800 29360 leader_election.cc:304] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:46.992574 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:46.976162  2798 raft_consensus.cc:2749] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.996838 29463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:47.000128 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6296aca66540dc81b696ae74a6fd42" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:47.002866 29363 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.003835 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0585fb6756aa496392b1ee0371aa9804" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:47.010612  2833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cbba4289f149fa85b4f656897b6390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:47.012898 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6fccf47ee14532860e20ec4b983155" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:47.016439 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d0e544e6ea1421bb32b24408af01b22" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:47.018102 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:46.991313  2836 raft_consensus.cc:2749] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:47.238221 29360 raft_consensus.cc:2686] T c40cc430e0bf4a5f946bc53291d0b771 P 88760af579b54a6393c6251aa3c6b870: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:14:47.239867 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 250104us
W20260709 13:14:47.257772 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 254992us
I20260709 13:14:47.258774 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.278817  2770 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:47.265416  2832 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.307073 29363 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:47.306428 29360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 43674.1us
I20260709 13:14:47.325556 29363 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.328737 30159 raft_consensus.cc:1217] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:14:47.327247 28250 tablet_replica.cc:333] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.345041 29363 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.348887  2832 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:47.350167 29363 raft_consensus.cc:2686] T 61f7f02fdc8243cd8806a09e7908831e P 88760af579b54a6393c6251aa3c6b870: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:14:47.364696 29363 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.366051 29363 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.326464  2837 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:47.345773 28250 raft_consensus.cc:2243] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:14:47.368299 29363 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.372303  2832 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:47.397970 28250 raft_consensus.cc:2272] T cb7c51305cb0421f843fcf7f543b7163 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.410281  2770 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.410858 29363 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.411825  2770 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:47.412328 29363 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:47.413074 29363 raft_consensus.cc:2686] T 1aeb2ba78c7749cb983fda41498f1bea P 88760af579b54a6393c6251aa3c6b870: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:14:47.367414  2862 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.424791 28250 tablet_replica.cc:333] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.425916 28250 raft_consensus.cc:2243] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:14:47.427978  2833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49108 (request call id 1550) took 1298 ms. Trace:
I20260709 13:14:47.428993  2805 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.430074  2805 tablet_bootstrap.cc:492] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
W20260709 13:14:47.430943 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:47.439080 28250 raft_consensus.cc:2272] T 5c1e2c054c694186bc648342e40f4d3b P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.439641 29363 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.428418  2833 rpcz_store.cc:276] 0709 13:14:46.129148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.143066 (+ 13918us) service_pool.cc:224] Handling call
0709 13:14:46.519030 (+375964us) ts_tablet_manager.cc:934] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: Initiating tablet copy from peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
0709 13:14:46.966805 (+447775us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:47.397817 (+431012us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:47.397984 (+   167us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:47.427197 (+ 29213us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:47.427521 (+   324us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:47.427822 (+   301us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:47.427889 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":168730,"tablet-copy.queue_time_us":242227,"thread_start_us":227046,"threads_started":2}
I20260709 13:14:47.441713  2862 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:47.443537  2805 ts_tablet_manager.cc:1403] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 1.615s	user 0.054s	sys 0.017s
I20260709 13:14:47.442943 29363 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.445024 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.444466  2862 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:47.446201 29363 leader_election.cc:304] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.445819  2834 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:47.447031  2862 raft_consensus.cc:2749] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.448550 28250 tablet_replica.cc:333] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.448458 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.449275  2862 raft_consensus.cc:2749] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:47.449851 28250 raft_consensus.cc:2243] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.454931  2833 tablet_copy_client.cc:806] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:47.455605  2833 tablet_copy_client.cc:670] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:47.457386  2805 raft_consensus.cc:359] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:47.458400  2805 raft_consensus.cc:740] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:47.458420 29363 leader_election.cc:304] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.461671  2862 raft_consensus.cc:2749] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:47.459250  2805 consensus_queue.cc:260] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:47.467855  2805 ts_tablet_manager.cc:1434] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:14:47.469954 28250 raft_consensus.cc:2272] T 77e08f37d90645918ef0bee732dd4b98 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.472316 29556 tablet_copy_service.cc:342] P 7c2e8d3e55c649e2b3acedef25d81e16: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-02ea2318003a42fea9088b490db583f1 received from {username='slave'} at 127.0.0.1:51828
I20260709 13:14:47.472760 29556 tablet_copy_service.cc:434] P 7c2e8d3e55c649e2b3acedef25d81e16: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-02ea2318003a42fea9088b490db583f1 on tablet 02ea2318003a42fea9088b490db583f1 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.469781 29363 leader_election.cc:304] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.474674  2834 raft_consensus.cc:2749] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:47.476903 28250 tablet_replica.cc:333] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.478045 28250 raft_consensus.cc:2243] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:14:47.481467 29363 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:47.482259  2834 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:47.469185  2833 tablet_copy_client.cc:538] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:14:47.509543 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.509805 28250 raft_consensus.cc:2272] T 268b94ce95ed4e5abc8be97084461e57 P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.540282 30159 raft_consensus.cc:1217] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:14:47.532853  2751 raft_consensus.cc:1064] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:47.538847  2833 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap starting.
I20260709 13:14:47.546846  2812 raft_consensus.cc:1064] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
W20260709 13:14:47.552183 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:47.550441  2751 consensus_queue.cc:237] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:47.555799  2812 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:47.557724 28250 tablet_replica.cc:333] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.562367 28250 raft_consensus.cc:2243] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.567006 29363 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.587917  2834 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:47.588320 28250 raft_consensus.cc:2272] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.589666 29363 leader_election.cc:304] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
W20260709 13:14:47.590399 29363 raft_consensus.cc:2686] T 4e6fccf47ee14532860e20ec4b983155 P 88760af579b54a6393c6251aa3c6b870: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:14:47.591852 28250 tablet_replica.cc:333] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.592972 28250 raft_consensus.cc:2243] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:14:47.599109 29543 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:47.599606 30159 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:47.600800  2797 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:47.602561  2797 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:47.610024 28250 raft_consensus.cc:2272] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.634166 30159 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:47.636493  2812 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:47.642292 29435 consensus_peers.cc:597] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.648109 29546 raft_consensus.cc:1275] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:47.650475  2746 consensus_queue.cc:1048] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:47.627418  2862 raft_consensus.cc:493] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:47.653172  2862 raft_consensus.cc:515] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:47.662401 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:47.674291 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:47.680907  2862 leader_election.cc:290] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:47.708590  2751 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:47.714890 30152 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:47.729455 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea2318003a42fea9088b490db583f1" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:47.737728 29543 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:47.723959 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.750798 29294 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.750842 28250 tablet_replica.cc:333] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.769654 28250 raft_consensus.cc:2243] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.770424 28250 raft_consensus.cc:2272] T 38fdcb033993416ca10b3d79544c9d59 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.781277 29363 leader_election.cc:304] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.783706  2834 raft_consensus.cc:2749] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.785190 28250 tablet_replica.cc:333] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.786283 28250 raft_consensus.cc:2243] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.788115 28250 raft_consensus.cc:2272] T 02ea2318003a42fea9088b490db583f1 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.791477 28250 tablet_replica.cc:333] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.792452 28250 raft_consensus.cc:2243] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:14:47.793659 28250 raft_consensus.cc:2272] T 91c368d56c234a6ea4e13263c724dbda P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.804260 28250 tablet_replica.cc:333] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.805148 28250 raft_consensus.cc:2243] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.805924 28250 raft_consensus.cc:2272] T 48cbba4289f149fa85b4f656897b6390 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.808869 28250 tablet_replica.cc:333] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.809670 28250 raft_consensus.cc:2243] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.844134 28250 raft_consensus.cc:2272] T 495c8d0b86f84e95b022820009da4795 P 88760af579b54a6393c6251aa3c6b870 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:47.850380 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:47.854199  2812 raft_consensus.cc:2955] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:47.867235 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:47.869117 30159 raft_consensus.cc:2955] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:47.871614  2833 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.872761  2833 tablet_bootstrap.cc:492] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: Bootstrap complete.
I20260709 13:14:47.873586  2833 ts_tablet_manager.cc:1403] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent bootstrapping tablet: real 0.335s	user 0.035s	sys 0.011s
I20260709 13:14:47.887203 28250 tablet_replica.cc:333] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.892272 28250 raft_consensus.cc:2243] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.890841  2821 raft_consensus.cc:493] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:47.896360 28250 raft_consensus.cc:2272] T 1c6c0a7893ec49c19f3e702094ed4941 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.897817  2821 raft_consensus.cc:515] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:47.907850  2821 leader_election.cc:290] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:47.909802 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:47.910545 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2fd913c0b414a81386c129004967f" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:47.912395 29363 leader_election.cc:304] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:47.914423  2821 raft_consensus.cc:2749] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:47.924925 29543 raft_consensus.cc:2955] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:47.936234 28250 tablet_replica.cc:333] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.937374 28250 raft_consensus.cc:2243] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:14:47.953505  2833 raft_consensus.cc:359] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:47.970837 28250 raft_consensus.cc:2272] T 1820d3fb534c4bbeb79d583637982dfb P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.983208 28250 tablet_replica.cc:333] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.985263 28250 raft_consensus.cc:2243] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.986004 28250 raft_consensus.cc:2272] T 3e8fc42a067a41aa89e5d120919426e3 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.979166  2833 raft_consensus.cc:740] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Initialized, Role: LEARNER
I20260709 13:14:47.988421  2833 consensus_queue.cc:260] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: NON_VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: true } }
I20260709 13:14:47.989130 28250 tablet_replica.cc:333] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.993567 28250 raft_consensus.cc:2243] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:47.994426 28250 raft_consensus.cc:2272] T 29e2fd913c0b414a81386c129004967f P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:47.997442 28250 tablet_replica.cc:333] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:47.998306 28250 raft_consensus.cc:2243] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.021202  2833 ts_tablet_manager.cc:1434] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: Time spent starting tablet: real 0.147s	user 0.005s	sys 0.007s
I20260709 13:14:48.023474 29481 tablet_copy_service.cc:342] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: Request end of tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-48cbba4289f149fa85b4f656897b6390 received from {username='slave'} at 127.0.0.1:39036
I20260709 13:14:48.023926 29481 tablet_copy_service.cc:434] P 7ffbae1cdd164f7181ae5fbf7ecf65d6: ending tablet copy session c65265f20d7e42b6bfe314c5d109bdf7-48cbba4289f149fa85b4f656897b6390 on tablet 48cbba4289f149fa85b4f656897b6390 with peer c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:48.030778 28250 raft_consensus.cc:2272] T 0d0e544e6ea1421bb32b24408af01b22 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.034143 28250 tablet_replica.cc:333] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.044662 29467 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.051208 28250 raft_consensus.cc:2243] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:14:48.052652 28250 raft_consensus.cc:2272] T 8b624c2ca9f340c787fc611feea71f37 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.053334 30159 raft_consensus.cc:1217] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:14:48.064896 28250 tablet_replica.cc:333] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.066012 28250 raft_consensus.cc:2243] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.066695 28250 raft_consensus.cc:2272] T a6194a4e996b4050bfb519664b72df1c P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.069072 29543 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:48.070744  2797 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:48.069968 29295 catalog_manager.cc:5697] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.079566 30159 raft_consensus.cc:1275] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:48.095256  2829 consensus_queue.cc:1048] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:48.069981 28250 tablet_replica.cc:333] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.112401 28250 raft_consensus.cc:2243] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:14:48.113879 28250 raft_consensus.cc:2272] T 184cb00180cf42c7b6803577c868b1dd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.126910  2812 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.130339 29546 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.136169 28250 tablet_replica.cc:333] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.137356 28250 raft_consensus.cc:2243] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.140512  2788 raft_consensus.cc:1064] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:48.143843  2788 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.148181 30152 raft_consensus.cc:2955] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.138378 28250 raft_consensus.cc:2272] T cbc3743d348b41f48617d0cb35c85353 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.157940 28250 tablet_replica.cc:333] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.179513 28250 raft_consensus.cc:2243] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.185480 28250 raft_consensus.cc:2272] T 2d6296aca66540dc81b696ae74a6fd42 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.186173  2821 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:48.186944  2821 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.188848 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 29153e3fc529491aa91c830a4456d35a with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:48.192941  2821 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:48.188822 28250 tablet_replica.cc:333] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.197361 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:48.197654 28250 raft_consensus.cc:2243] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:14:48.199002 28250 raft_consensus.cc:2272] T bd61183c8c5845d289dedeb85f533fa0 P 88760af579b54a6393c6251aa3c6b870 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.199756 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:48.202111 29363 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:48.203294 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:48.214407 29467 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:48.216571  2788 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:48.221015 30159 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEARNER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:48.221745  2821 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:48.224395 29509 consensus_peers.cc:597] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:48.230166  2788 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:48.231102 29290 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 10 to 11, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:48.260843 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.293447 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.294871  2841 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.295605  2841 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.298050  2841 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:48.300860 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:48.304672 29509 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:48.305156 29509 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:48.307497  2793 raft_consensus.cc:2749] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:48.315905 28250 tablet_replica.cc:333] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.324952 28250 raft_consensus.cc:2243] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.343878 28250 raft_consensus.cc:2272] T ef663d2174234a11995ce0c886e35150 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:48.354763 29279 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 79884us
W20260709 13:14:48.358304 29279 catalog_manager.cc:4755] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 29153e3fc529491aa91c830a4456d35a: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:14:48.359403  2788 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
W20260709 13:14:48.358395 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.367129 30151 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.388712 28250 tablet_replica.cc:333] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.416589 28250 raft_consensus.cc:2243] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.425763 28250 raft_consensus.cc:2272] T 29153e3fc529491aa91c830a4456d35a P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.424209 29294 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.483245 28250 tablet_replica.cc:333] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.484366 28250 raft_consensus.cc:2243] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.485131 28250 raft_consensus.cc:2272] T 2068d180d9904ad9abf956769d9a2f1d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.500663  2788 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.501331  2788 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:48.504154  2788 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:48.483132 29546 consensus_queue.cc:237] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.500696  2751 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.507123  2751 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.511592  2751 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:48.513460 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:48.518951 29435 leader_election.cc:336] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:48.519553 29435 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:48.520802  2751 raft_consensus.cc:2749] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:48.539227 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.541410  2881 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.542374  2881 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.541953 29467 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } attrs { replace: true } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.549049  2881 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:48.583993  2821 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:48.576045 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:48.586421  2821 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:48.588829  2821 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:48.600292 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:48.611910 29466 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:48.614913 28250 tablet_replica.cc:333] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.616803  2812 raft_consensus.cc:1064] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: attempting to promote NON_VOTER c65265f20d7e42b6bfe314c5d109bdf7 to VOTER
I20260709 13:14:48.620529 30152 raft_consensus.cc:1275] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:48.623266 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:14:48.630713 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.628013 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1f2ca19fef40e2aa07c8513a7bffbd" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:48.631940 28250 raft_consensus.cc:2243] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Raft consensus shutting down.
W20260709 13:14:48.632192 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.638337  2788 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:14:48.645054  2812 consensus_queue.cc:237] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.656278  2881 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.658581 29467 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.670805 28250 raft_consensus.cc:2272] T 04f141f7950d4a72a8aac7ed37a423fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.673193  2788 consensus_queue.cc:1048] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:48.676211 28250 tablet_replica.cc:333] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
W20260709 13:14:48.678138 29509 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:48.687565 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:48.694725  2788 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:48.677212 28250 raft_consensus.cc:2243] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.698172 28250 raft_consensus.cc:2272] T 0585fb6756aa496392b1ee0371aa9804 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.700184 29282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02ea2318003a42fea9088b490db583f1 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:48.700872 30152 raft_consensus.cc:2955] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.712389 29294 catalog_manager.cc:5697] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: config changed from index 9 to 10, VOTER 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) evicted. New cstate: current_term: 11 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.722760 29546 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:48.722760 30151 raft_consensus.cc:1275] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEARNER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:48.728956  2797 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:48.730875  2797 consensus_queue.cc:1048] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:48.689563 29363 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:48.747085  2883 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:48.748350 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 58932.4us
W20260709 13:14:48.764053 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:48.770678  2751 raft_consensus.cc:2955] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.772619 29543 raft_consensus.cc:2955] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.780727 28250 tablet_replica.cc:333] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.781930 28250 raft_consensus.cc:2243] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 6 LEADER]: Raft consensus shutting down.
W20260709 13:14:48.784471 29509 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:48.785002 29509 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:48.786226  2788 raft_consensus.cc:2749] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:48.796298 30151 raft_consensus.cc:2955] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } } }
I20260709 13:14:48.821228  2884 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.821873  2884 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.824319  2782 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.824577  2853 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.825300  2853 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.824705 29295 catalog_manager.cc:5697] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: config changed from index 9 to 10, c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.824958  2782 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.827602  2853 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:48.828212  2782 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:48.831808 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:48.832230  2884 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:48.833108 28250 raft_consensus.cc:2272] T 59bfc5123acd4083b0f36af624300133 P 88760af579b54a6393c6251aa3c6b870 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.833727 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:48.834482 29546 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:14:48.834827 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:48.835487 29466 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:48.835906 30126 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:48.836627 28250 tablet_replica.cc:333] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.837644 28250 raft_consensus.cc:2243] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.837574 30126 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:48.838691  2782 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:48.839102  2782 raft_consensus.cc:493] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.839473  2782 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:48.842051 29543 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:48.844453 30126 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:48.845259  2853 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:48.845634  2853 raft_consensus.cc:493] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.846000  2853 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:48.858502  2884 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:48.858965  2884 raft_consensus.cc:493] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.859359  2884 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:48.883143 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.884089 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.885921  2883 raft_consensus.cc:493] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:48.886606  2883 raft_consensus.cc:515] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:48.885296 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.888777 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.889233 28250 raft_consensus.cc:2272] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:48.893803 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.893936  2883 leader_election.cc:290] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:48.901482 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:14:48.903544 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.909351  2853 raft_consensus.cc:515] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.939472  2856 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:48.940529  2856 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.941455  2853 leader_election.cc:290] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:48.914170 28250 tablet_replica.cc:333] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.946755  2856 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:48.948143  2782 raft_consensus.cc:515] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:48.949724 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:48.950294 28250 raft_consensus.cc:2243] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.958101 28250 raft_consensus.cc:2272] T 1f99e4a3e3c44d748842c65d1be7d08e P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.961166 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1016126be7f841c4acc0cd897e5df0c3" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:48.962598  2782 leader_election.cc:290] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:48.962518 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c51305cb0421f843fcf7f543b7163" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:48.963816 29466 raft_consensus.cc:3060] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:48.963675 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e2c054c694186bc648342e40f4d3b" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:48.964519 29543 raft_consensus.cc:3060] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:48.967916 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.968876 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.971194 30123 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:48.973718 30123 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:48.974890 30123 leader_election.cc:336] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:48.976495 28250 tablet_replica.cc:333] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:48.978603 29363 leader_election.cc:304] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:48.979656 29543 raft_consensus.cc:2468] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 9.
I20260709 13:14:48.980990 29466 raft_consensus.cc:2468] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:48.980952 30126 leader_election.cc:304] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:48.982671 28250 raft_consensus.cc:2243] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.982697 30126 leader_election.cc:304] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:14:48.984704 30123 leader_election.cc:336] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:48.983685  2883 raft_consensus.cc:2749] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:48.986090  2856 raft_consensus.cc:2804] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:48.985692  2782 raft_consensus.cc:2804] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:48.988425 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.989576 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.990593 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.995800 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:48.996343 30123 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:48.998230  2853 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:48.999722 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:49.002990  2797 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.003592  2797 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.004658  2751 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.005174  2751 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:49.007297  2751 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:49.012773 29435 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:49.016709 29435 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:49.000872 30123 leader_election.cc:336] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:49.014993 28250 raft_consensus.cc:2272] T d03f148e37fd4109805d1d7b3b02b2fd P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.020505  2797 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:49.022111 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:49.023110 29543 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:49.024466 29438 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:49.027252  2797 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.030085  2797 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.030488  2797 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.033169  2821 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:49.033085  2884 raft_consensus.cc:515] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.033782  2821 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.036553  2821 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:49.039773 28250 tablet_replica.cc:333] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:49.040751 28250 raft_consensus.cc:2243] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:14:49.042404 28250 raft_consensus.cc:2272] T 3890858f888845ec958c83aa9b1ccf5d P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.049772 28250 tablet_replica.cc:333] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:49.052737 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b94ce95ed4e5abc8be97084461e57" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:49.053656 29546 raft_consensus.cc:3060] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:49.055234 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:49.058882 28250 raft_consensus.cc:2243] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:49.061241 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:49.067142 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:49.026896  2856 raft_consensus.cc:697] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:49.076836 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:49.078923 29363 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:49.044906  2884 leader_election.cc:290] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:49.080284 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:49.092948 30152 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:49.080508  2770 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:49.094739 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:49.098098 28250 raft_consensus.cc:2272] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.096160  2782 raft_consensus.cc:697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:49.102985  2782 consensus_queue.cc:237] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.106853  2856 consensus_queue.cc:237] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.122491 29546 raft_consensus.cc:2468] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:49.104223  2797 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:49.125821  2812 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.143013  2812 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.143487  2812 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.079421  2853 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.147445  2853 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.149884  2853 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:49.160462  2797 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:49.163188 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:49.164274 29542 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:49.165812 30126 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:49.166641  2884 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:49.167025  2884 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.171090  2884 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:49.171738 29363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 89782.4us
W20260709 13:14:49.184654 29435 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:49.172981 28250 tablet_replica.cc:333] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:49.184767 30126 leader_election.cc:304] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:14:49.190728 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:49.194070 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:49.196683 28250 raft_consensus.cc:2243] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:49.200676 30123 leader_election.cc:336] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:49.194711 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:49.211362 28250 raft_consensus.cc:2272] T 930d24af7f0e45c19e80e2efaab717d7 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.200270  2890 raft_consensus.cc:2804] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:49.241321 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6fe7feab0c45ddb9198327b19a5bc5" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:49.242072 29546 raft_consensus.cc:3060] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.243633 29295 catalog_manager.cc:5697] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 10 to 11, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 11 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.229990  2883 raft_consensus.cc:493] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:49.245589 29295 catalog_manager.cc:5697] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 8 to 9, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 9 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.238319  2890 raft_consensus.cc:697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:49.257085 29546 raft_consensus.cc:2468] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:49.250231  2883 raft_consensus.cc:515] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.263126  2883 leader_election.cc:290] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:49.272748 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:49.273851  2883 raft_consensus.cc:493] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:49.274619  2883 raft_consensus.cc:515] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.279525 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:49.281194  2883 leader_election.cc:290] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:49.300352  2881 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.248303  2812 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.303550  2898 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.304236  2898 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:49.305154  2812 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:49.309238  2898 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:49.313051 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:49.313792 30151 raft_consensus.cc:3060] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.317283  2883 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:14:49.317489 29438 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:49.317880  2883 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:49.321209  2883 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:49.321529  2751 raft_consensus.cc:2804] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:49.322078  2751 raft_consensus.cc:697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:49.323073  2751 consensus_queue.cc:237] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:49.326896 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:49.327265 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:49.328540  2890 consensus_queue.cc:237] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.333392 30151 raft_consensus.cc:2468] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:49.340823 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa3c8fa6cf741bdafed124439764c9c" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:14:49.338812 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 46015.3us
I20260709 13:14:49.301589  2881 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:49.363384 29363 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:14:49.398988 29540 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:49.396575 29295 catalog_manager.cc:5697] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 9 to 10, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 10 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.400736 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf141daac9d14f459ccbaeee8764a9e6" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:49.409250 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36373f233812459591c31993a4959894" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:49.413736 29360 leader_election.cc:304] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:49.415282 29360 leader_election.cc:304] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:49.356532  2897 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.380088  2883 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:49.424510 30123 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:49.443529 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 47274.8us
I20260709 13:14:49.458240 29438 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
W20260709 13:14:49.461678 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 47544.2us
I20260709 13:14:49.421912  2821 raft_consensus.cc:2749] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:49.405298  2884 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.474568  2797 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.454739  2788 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.434396  2892 raft_consensus.cc:2749] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:49.488310 29279 catalog_manager.cc:4755] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 02ea2318003a42fea9088b490db583f1: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:14:49.491246 29435 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:49.479050  2797 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.491519  2788 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:49.543663 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 52682.7us
I20260709 13:14:49.518764 28250 tablet_replica.cc:333] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:49.550040 28250 raft_consensus.cc:2243] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:49.558336 29466 raft_consensus.cc:1275] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:49.532200  2884 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:49.559510  2898 raft_consensus.cc:2804] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:49.560104  2884 consensus_queue.cc:1048] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:14:49.553403 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:49.520442  2797 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:49.521708  2903 log.cc:927] Time spent T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.005s
I20260709 13:14:49.573096 28250 raft_consensus.cc:2272] T 5afd3c3bb2df4807a6bdcea59110dee6 P 88760af579b54a6393c6251aa3c6b870 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.440321  2897 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.560168  2898 raft_consensus.cc:697] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:49.552248  2892 raft_consensus.cc:493] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:14:49.678612  2898 consensus_queue.cc:237] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.681318  2895 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.682029  2897 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:49.689193 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:49.689960 29543 raft_consensus.cc:3060] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:49.702338 29435 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:49.692662  2892 raft_consensus.cc:515] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:49.735994  2895 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:14:49.872897 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 182581us
I20260709 13:14:49.894357 29543 raft_consensus.cc:2468] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
W20260709 13:14:49.882925 29435 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:49.896670 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 183613us
I20260709 13:14:49.882891  2782 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:49.919770  2881 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:49.949730 28250 tablet_replica.cc:333] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:49.950801 28250 raft_consensus.cc:2243] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:49.962107 28250 raft_consensus.cc:2272] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.971534  2892 leader_election.cc:290] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:49.979646 28250 tablet_replica.cc:333] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:49.980631 28250 raft_consensus.cc:2243] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:14:49.981492 28250 raft_consensus.cc:2272] T 0648129226444c81aef501f2bf17e434 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.985456 28250 tablet_replica.cc:333] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:49.996116  2895 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:49.986254 28250 raft_consensus.cc:2243] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:14:49.927385  2782 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.007112  2782 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:50.010962  2797 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.013722  2797 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:50.019711 29363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.025221  2899 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.026072  2899 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:50.026252 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 129928us
I20260709 13:14:50.042995 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:50.049279 30126 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:50.112149 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:50.115428 29542 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 14.
I20260709 13:14:50.131728 29542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:50.132511 29542 raft_consensus.cc:3060] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.133342 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fb5043e48f4e1a86ec8d962d18b0b4" candidate_uuid: "88760af579b54a6393c6251aa3c6b870" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:50.114158  2926 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.135468 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:50.106915  2927 raft_consensus.cc:2804] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:50.138885 30152 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:50.143996 29539 raft_consensus.cc:1275] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:50.143306 29543 raft_consensus.cc:1275] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:50.145423  2927 raft_consensus.cc:697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:50.149067  2899 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:50.150344 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:50.134457  2929 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.151052 29469 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:50.161144 29540 raft_consensus.cc:1275] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:14:50.159377 30123 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.146643  2927 consensus_queue.cc:237] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.174963 29363 leader_election.cc:304] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88760af579b54a6393c6251aa3c6b870; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:50.151569  2929 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.178894 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:50.180531  2929 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:50.181772  2929 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:50.141360  2926 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.184567  2926 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:50.185081  2881 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.185361  2916 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.185704  2881 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.185971  2916 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.188793  2916 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:50.182178  2929 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
W20260709 13:14:50.197407 29363 raft_consensus.cc:2686] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 88760af579b54a6393c6251aa3c6b870: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:14:50.199153 30123 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 279 similar messages]
I20260709 13:14:50.200533 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:50.206908 30152 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:50.211388 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:50.209730 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:50.211143 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:50.218102 29543 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:50.219969 29542 raft_consensus.cc:2468] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 11.
I20260709 13:14:50.226879 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:50.227638 29466 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:50.228307  2890 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:50.228817  2890 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.229209  2890 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.234591 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
W20260709 13:14:50.226867 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 52573us
I20260709 13:14:50.208243  2929 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:50.241796 29509 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.243018 29509 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.255334 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1820d3fb534c4bbeb79d583637982dfb" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:50.254280 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:50.258448 29466 raft_consensus.cc:2393] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:50.260003 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:50.272253  2930 consensus_queue.cc:1048] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:14:50.277774  2881 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:50.272677  2931 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:50.285180  2933 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.287133  2933 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.287569  2933 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:50.286759 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 51985.6us
I20260709 13:14:50.284271  2931 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.304136  2931 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.284654  2916 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.306510  2916 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.307045  2916 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.308640 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:50.309614 29466 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
W20260709 13:14:50.333695 29435 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.350994 29512 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.353607  2937 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:50.360929 29435 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.362789 29435 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.379122  2890 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.381641  2890 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:50.366062 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 104026us
I20260709 13:14:50.382411  2788 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:50.383634 29438 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.384857  2905 raft_consensus.cc:2804] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:50.384415 29294 catalog_manager.cc:5697] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 10 to 11, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:50.385488  2905 raft_consensus.cc:697] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:50.410673  2929 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.411614  2905 consensus_queue.cc:237] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.412261  2922 consensus_queue.cc:1048] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:50.394063 28250 raft_consensus.cc:2272] T 9f9e543a8422407185dcc0cc54131e92 P 88760af579b54a6393c6251aa3c6b870 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:50.413872  2884 consensus_queue.cc:1048] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:50.416759 28250 tablet_replica.cc:333] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:50.417677 28250 raft_consensus.cc:2243] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:14:50.422009 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:50.422724 29546 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 6.
I20260709 13:14:50.430290 28250 raft_consensus.cc:2272] T 5bfd9651b2124a8580054a3a43fff99d P 88760af579b54a6393c6251aa3c6b870 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:50.431206 29467 raft_consensus.cc:2393] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 15: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:50.432224  2929 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:50.437626 28250 tablet_replica.cc:333] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
W20260709 13:14:50.395085 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:50.438760 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 43730.3us
W20260709 13:14:50.399051 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 43710.5us
I20260709 13:14:50.399567  2933 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.404018  2916 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.444970  2916 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:50.447381  2933 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:50.449543 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.451773  2916 raft_consensus.cc:493] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:14:50.452471  2916 raft_consensus.cc:515] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.442639 29512 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:50.454021 29512 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.454552  2904 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:50.454979  2916 leader_election.cc:290] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:50.455221  2936 raft_consensus.cc:3060] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:50.474869 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:50.476890 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd61183c8c5845d289dedeb85f533fa0" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:50.470885 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
W20260709 13:14:50.474861 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.479882 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.450321 29435 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.482188 29435 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.437769  2931 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.490828 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aeb2ba78c7749cb983fda41498f1bea" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:50.495242 29438 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.489428 29295 catalog_manager.cc:5697] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 11 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 12 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:50.496563 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:50.455037  2904 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.510667 29465 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:50.512210 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:50.513161 30151 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 12: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:14:50.512317  2916 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:50.487510 30123 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.514103  2904 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.527194 30123 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.527796  2916 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.535895  2916 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.541607  2931 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:50.529624  2933 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:50.542755  2933 raft_consensus.cc:493] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:50.543159  2933 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:50.483884 28250 raft_consensus.cc:2243] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:50.581534 28250 raft_consensus.cc:2272] T 6aa3c8fa6cf741bdafed124439764c9c P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:50.600543 28250 tablet_replica.cc:333] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:50.488392 29469 raft_consensus.cc:2393] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 12: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:50.602396 28250 raft_consensus.cc:2243] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:50.602752 29435 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.619686 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:50.620464 29435 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.620940 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:14:50.623145 29435 leader_election.cc:336] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.623781 29435 leader_election.cc:304] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:50.528340 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:50.640107 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 111697us
I20260709 13:14:50.620983 28250 raft_consensus.cc:2272] T cf141daac9d14f459ccbaeee8764a9e6 P 88760af579b54a6393c6251aa3c6b870 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:50.651052 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:50.651741 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.658656 30151 raft_consensus.cc:1275] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:50.661149 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:50.662849 30152 raft_consensus.cc:2393] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:14:50.683637 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 190521us
I20260709 13:14:50.720996  2829 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.750347 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.770804  2751 raft_consensus.cc:2749] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:50.789621 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.797346 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 47264.9us
I20260709 13:14:50.805974  2927 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.810694  2904 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.813433 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.815092  2904 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:50.819339 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:50.822811  2890 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.828722 28250 tablet_replica.cc:333] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:50.832996  2921 consensus_queue.cc:1048] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:50.846112 29542 raft_consensus.cc:1275] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:50.829774 28250 raft_consensus.cc:2243] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:50.867991 28250 raft_consensus.cc:2272] T 1016126be7f841c4acc0cd897e5df0c3 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:50.879505  2936 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:50.880566 29435 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:50.887868 29435 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:50.890713  2895 raft_consensus.cc:2749] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.866240  2933 raft_consensus.cc:515] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:50.897986 29543 raft_consensus.cc:1275] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:50.910243  2890 consensus_queue.cc:1048] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:50.914158  2955 consensus_queue.cc:1048] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:14:50.920749  2933 leader_election.cc:290] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:50.921020  2916 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.922565 29469 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
I20260709 13:14:50.924927 28250 tablet_replica.cc:333] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870: stopping tablet replica
I20260709 13:14:50.925479 29539 raft_consensus.cc:2468] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 15.
I20260709 13:14:50.925959 28250 raft_consensus.cc:2243] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:50.935443 29509 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.936924 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 52271.9us
I20260709 13:14:50.955614 29438 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:50.957273  2895 raft_consensus.cc:2804] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:50.957861  2895 raft_consensus.cc:697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:50.959400  2895 consensus_queue.cc:237] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:50.960345 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:50.961273 29539 raft_consensus.cc:2393] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:14:50.963925  2916 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:14:50.967170 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:50.978518 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:50.978260 30123 leader_election.cc:336] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:50.985970 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:50.991983 28250 raft_consensus.cc:2272] T 36373f233812459591c31993a4959894 P 88760af579b54a6393c6251aa3c6b870 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.017596 29279 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 44025.6us
I20260709 13:14:51.019074 29539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfc5123acd4083b0f36af624300133" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:14:51.019866 29539 raft_consensus.cc:3060] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:51.024746 29509 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:51.025271 29509 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:51.034549  2904 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:51.021870 29279 catalog_manager.cc:4755] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 29153e3fc529491aa91c830a4456d35a: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:14:51.031142 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:51.059370 29539 raft_consensus.cc:2468] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
I20260709 13:14:51.060765 30126 leader_election.cc:304] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:51.061766 29435 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:51.062454 29435 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:51.065392  2933 raft_consensus.cc:2804] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:51.066042  2933 raft_consensus.cc:697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:51.067224  2933 consensus_queue.cc:237] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:51.079113  2797 raft_consensus.cc:2749] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:51.100044 29435 consensus_peers.cc:597] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.113193 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:51.133448 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:51.426671 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 105361us
I20260709 13:14:51.520964 29545 raft_consensus.cc:1275] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:51.548115 29295 catalog_manager.cc:5697] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 10 to 11, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } }
I20260709 13:14:51.550760  2889 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.551558  2889 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:51.553967  2889 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:14:51.585273  2955 consensus_queue.cc:1048] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:14:51.619571 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:51.668540 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:51.706481 29290 catalog_manager.cc:5697] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 10 to 11, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 11 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.704097  2797 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.708772 29290 catalog_manager.cc:5697] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 14 to 15, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 15 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:51.709237  2797 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:51.712214  2797 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:51.701388  2955 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.726825  2955 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:51.762682  2853 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.746840 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:14:51.764424  2853 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:51.784860  2955 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:51.791525  2853 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:51.838323 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 43570.2us
W20260709 13:14:51.840652 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 95271.6us
I20260709 13:14:51.831527 29295 catalog_manager.cc:5697] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 6 to 7, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 7 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:51.844638 29435 consensus_peers.cc:597] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.846894 29435 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:51.848634 29435 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:51.869127 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 120682us
W20260709 13:14:51.870967 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:51.889051  2974 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.889890  2974 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:51.892243 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:51.893002 29466 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:14:51.894536  2974 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:51.927122 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:51.927942 29464 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 13.
I20260709 13:14:51.931123 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:51.931946 30157 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 10.
I20260709 13:14:51.932367 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:51.933108 30153 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
W20260709 13:14:51.939235 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:51.923697 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:51.947479  2973 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:51.947947  2973 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.948376  2973 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.959913 30126 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:51.960911  2974 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:51.963135 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:51.966997  2797 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:51.967396  2797 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.967782  2797 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.971701 29543 raft_consensus.cc:1275] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:14:51.972663 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:51.974112 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.975893 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:51.977895 30123 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:51.961383  2974 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.980875  2974 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:51.982474  2895 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:51.982946  2895 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:51.983353  2895 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:51.986294 30123 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:14:51.995714 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:51.999727  2899 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:51.986742  2973 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:52.035121 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:52.052489 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.053809 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.056468 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 70239.9us
W20260709 13:14:52.074210 30123 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:52.094730  2969 consensus_queue.cc:1048] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:14:52.110334  2973 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:52.112483  2894 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:52.113205  2894 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:52.133672  2894 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:52.137620 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:52.138494 30159 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 9.
I20260709 13:14:52.141709 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:52.158690  2976 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:52.159304  2976 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 88760af579b54a6393c6251aa3c6b870)
I20260709 13:14:52.159759  2976 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:52.162330  2797 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:52.173555  2895 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:52.186319 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:52.208412 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 146701us
I20260709 13:14:52.211294  2797 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:52.208609 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.212275 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.226744 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:52.227546 29469 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 11: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:14:52.237571 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.242455  2895 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:52.245656 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:52.246567 30151 raft_consensus.cc:2393] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 11: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:14:52.246738 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:52.253949 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:52.255355  2853 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:52.260178 29435 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:52.262676 29435 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:52.266031  2986 raft_consensus.cc:2749] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:52.266880 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.271173  2976 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:52.273648  2976 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:52.274726 29435 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:52.238746 29509 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:52.175282  2974 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:52.276299 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.278905 30159 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in current term 14: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
W20260709 13:14:52.278095 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.287561 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:14:52.290520  2797 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:52.300792 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:52.301471 30151 raft_consensus.cc:3060] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:52.322930  2974 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:52.341914 30151 raft_consensus.cc:2468] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 10.
W20260709 13:14:52.354135 30123 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:52.363899 29509 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:52.369489 29469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:52.371160 29469 raft_consensus.cc:2393] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 14: Already voted for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in this term.
W20260709 13:14:52.373690 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.373399  2894 raft_consensus.cc:2804] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:52.388830  2894 raft_consensus.cc:697] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:14:52.390129  2894 consensus_queue.cc:237] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:52.404217 30126 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:52.418758  2853 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:14:52.433271 29509 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:52.434707 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.448273 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.453812 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.456391 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.462394 29295 catalog_manager.cc:5697] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 9 to 10, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 10 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.487939  2969 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.488835  2969 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:52.492246  2969 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:14:52.498011 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.498677 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:52.499413 29464 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
W20260709 13:14:52.507850 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:52.511354 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:52.512351  2969 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:52.512730  2969 raft_consensus.cc:493] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.513072  2969 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:52.514132 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.519142 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:52.521332 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:52.540009 30123 connection.cc:573] client connection to 127.27.150.129:42027 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:14:52.526537  2969 raft_consensus.cc:515] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:52.561542  2969 leader_election.cc:290] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:52.562806 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184cb00180cf42c7b6803577c868b1dd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:52.563499 29464 raft_consensus.cc:3060] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:52.604677 29464 raft_consensus.cc:2468] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:14:52.608644 30126 leader_election.cc:304] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:52.609968  2969 raft_consensus.cc:2804] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:52.610570  2969 raft_consensus.cc:697] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:52.611759  2969 consensus_queue.cc:237] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:52.654518 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:52.664592 30123 leader_election.cc:336] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:52.695641 29295 catalog_manager.cc:5697] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 10 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 12 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.755887  2989 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.756645  2989 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:52.759189  2989 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:52.762405 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:52.763293 30151 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 12.
I20260709 13:14:52.775161 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:52.779878  2986 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:52.780334  2986 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.780678  2986 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:52.792907 29435 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:52.795696  2971 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.796324  2971 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:52.798988  2971 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:52.808162 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:52.808916 29464 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:14:52.810091 29512 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:52.810997  2971 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:52.811388  2971 raft_consensus.cc:493] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.811764  2971 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:52.820456 29509 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:52.835310  2986 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:52.839600 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:52.844048 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:52.844777 30151 raft_consensus.cc:3060] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:52.857647  2971 raft_consensus.cc:515] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:52.876420 30151 raft_consensus.cc:2468] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 13.
I20260709 13:14:52.878052 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f141f7950d4a72a8aac7ed37a423fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:52.878545  2971 leader_election.cc:290] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:52.878768 29464 raft_consensus.cc:3060] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:52.887616 29464 raft_consensus.cc:2468] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:14:52.841858  2986 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:14:52.873760 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:52.888629 29512 leader_election.cc:304] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 
I20260709 13:14:52.893903  2971 raft_consensus.cc:2804] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:52.903404  2971 raft_consensus.cc:697] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:14:52.906102 29509 leader_election.cc:336] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:52.907280 29435 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:52.915792  2989 raft_consensus.cc:2804] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:52.916352  2989 raft_consensus.cc:697] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:52.917481  2989 consensus_queue.cc:237] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:52.926934 29435 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:52.924782  2971 consensus_queue.cc:237] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:14:52.963616 29295 catalog_manager.cc:5697] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 11 to 13, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 13 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.969939 30151 raft_consensus.cc:1275] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:14:52.973515  2894 consensus_queue.cc:1048] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:14:53.003371 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.007227 29509 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.046579 29290 catalog_manager.cc:5697] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 10 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.091240 29466 raft_consensus.cc:1275] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:53.094099  2969 consensus_queue.cc:1048] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:14:53.191144 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:53.193720 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.250849 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.313230 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:53.316659 29279 catalog_manager.cc:4755] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 02ea2318003a42fea9088b490db583f1: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:14:53.356729 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:53.365403 29435 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:53.417177 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:53.417265 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.448820 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:53.498333 29509 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.544924 30159 raft_consensus.cc:1275] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:14:53.545691 28250 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 29418)
I20260709 13:14:53.546682  2986 consensus_queue.cc:1048] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:53.625849 29464 raft_consensus.cc:1275] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer 7c2e8d3e55c649e2b3acedef25d81e16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:53.631393  2894 consensus_queue.cc:1048] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:53.639050 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.664003 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:53.780186 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:53.808251 29435 consensus_peers.cc:597] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.814735 29435 consensus_peers.cc:597] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.834074 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:53.913184 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.939761  2969 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.940457  2969 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:53.948019 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:53.951879  2969 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:53.952529 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:14:53.953338 29466 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:14:53.954864 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:53.956130  2969 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:53.956991  2969 raft_consensus.cc:493] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.957406  2969 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:54.046219 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:54.055461  2969 raft_consensus.cc:515] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:54.058426 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 58996.1us
I20260709 13:14:54.058010  2969 leader_election.cc:290] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:14:54.070779 29466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0648129226444c81aef501f2bf17e434" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6"
I20260709 13:14:54.071463 29466 raft_consensus.cc:3060] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.082199 29466 raft_consensus.cc:2468] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
W20260709 13:14:54.098906 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:54.107108 30126 leader_election.cc:304] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:54.108050  2969 raft_consensus.cc:2804] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:54.108610  2969 raft_consensus.cc:697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:14:54.109726  2969 consensus_queue.cc:237] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:54.152971 30123 leader_election.cc:336] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:54.153908 29290 catalog_manager.cc:5697] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 10 to 12, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 12 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:54.192549 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.215461 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.246924 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:54.273224  2907 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.273975  2907 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:54.276487  2907 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:54.280300 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:14:54.281127 30159 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 14.
I20260709 13:14:54.285032 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:14:54.286979  2986 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:54.287384  2986 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.287755  2986 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:54.293634 29435 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:54.311731  2986 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:14:54.316748  2986 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 election: Requested vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:14:54.319716 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:14:54.320369 30159 raft_consensus.cc:3060] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:54.322023 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.327673 29435 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:14:54.362025 30159 raft_consensus.cc:2468] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffbae1cdd164f7181ae5fbf7ecf65d6 in term 15.
I20260709 13:14:54.364276 29435 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 88760af579b54a6393c6251aa3c6b870
I20260709 13:14:54.365505  2986 raft_consensus.cc:2804] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:54.366137  2986 raft_consensus.cc:697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7ffbae1cdd164f7181ae5fbf7ecf65d6, State: Running, Role: LEADER
I20260709 13:14:54.367149  2986 consensus_queue.cc:237] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:14:54.419238 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:54.445880 29290 catalog_manager.cc:5697] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 reported cstate change: term changed from 13 to 15, leader changed from 88760af579b54a6393c6251aa3c6b870 (127.27.150.129) to 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130). New cstate: current_term: 15 leader_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:54.467851 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.546684 28250 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 29418)
W20260709 13:14:54.625771 30123 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:54.628064 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.675484 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.705782 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.709314 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.736208 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:54.739243 29464 raft_consensus.cc:1275] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Refusing update from remote peer c65265f20d7e42b6bfe314c5d109bdf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:54.740935  2969 consensus_queue.cc:1048] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:14:54.751478 29435 consensus_peers.cc:597] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:54.769892 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:54.805511 30159 raft_consensus.cc:1275] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Refusing update from remote peer 7ffbae1cdd164f7181ae5fbf7ecf65d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:54.808805  2986 consensus_queue.cc:1048] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:14:54.812384 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.883826 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.901551 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.927803  3027 log.cc:927] Time spent T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:14:54.936239 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:54.981178 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:54.987818 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:55.010743 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 103904us
W20260709 13:14:55.061980 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:55.161245 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:55.211668 29435 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111) [suppressed 435 similar messages]
W20260709 13:14:55.489600 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:55.500332 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.508987 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:55.514256 29509 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:55.531596 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.542361 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.547377 28250 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 29418)
W20260709 13:14:55.548444 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.612622 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:55.740135 29435 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:55.838727 29509 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:55.897179 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:55.942054 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:55.950997 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.017565 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.027500 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.130731 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:56.224354 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.351732 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.360266 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.362972 29435 consensus_peers.cc:597] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.431372 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.547879 28250 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 29418)
W20260709 13:14:56.638976 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.701749 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.707646 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.741576 29435 consensus_peers.cc:597] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.887388 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.931265 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:56.975958 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.021756 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.037902 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.094399 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.159729 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.188275 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.196295 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.215870 30123 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:57.269119 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.337613 29435 consensus_peers.cc:597] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:57.369042 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.424026 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.427939 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.530483 29279 catalog_manager.cc:4755] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 02ea2318003a42fea9088b490db583f1: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:14:57.539499 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.548470 28250 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 29418)
W20260709 13:14:57.566128 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:57.621923 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.724270 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.814491 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:57.848086 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:57.916671 29435 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:58.004768 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:58.009130 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.012194 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.135455 29509 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:58.160252 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.191022 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:58.307060 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:58.309369 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:58.409754 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:58.500098 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:58.516050 29509 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:58.533942 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.549674 28250 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 29418)
W20260709 13:14:58.673944 29435 consensus_peers.cc:597] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.676352 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:58.720153 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.774272 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:58.798128 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:58.989234 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.018970 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.111665 29435 consensus_peers.cc:597] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.236418 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.240442 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.321287 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.388584 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.551039 28250 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 29418)
W20260709 13:14:59.555274 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.556910 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.570451 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.617255 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.631285 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.662761 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.730631 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.781687 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.859542 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.871846 29435 consensus_peers.cc:597] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:59.878582 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.882874 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:59.972129 30123 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:00.060640 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:00.118472 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:00.175180 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:00.217398 29509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 13:15:00.222913 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:00.303761 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:00.370584 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:00.449442 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:00.523957 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:00.551688 28250 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:00.552968 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:00.604099 29509 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:00.619786 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:00.651895 29435 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:00.659176 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:00.661952 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:00.780508 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:00.907076 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.034629 29509 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:01.099556 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:01.118851 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.119706 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.142043 29435 consensus_peers.cc:597] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:01.153182 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:01.190954 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.306690 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:01.413534 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.497411 29435 consensus_peers.cc:597] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:01.554175 28250 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:01.562848 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:01.610003 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.631910 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.721762 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.724848 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.921804 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:01.973960 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.093043 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.118784 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.133144 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.161707 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 113163us
W20260709 13:15:02.218334 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.221119 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.307452 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.311024 30123 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:02.314139 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.494185 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.555773 28250 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:02.564735 29435 consensus_peers.cc:597] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:02.601431 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:02.634254 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.717057 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.714927 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.777045 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.786774 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:02.815982 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.878571 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:02.891211 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:02.908746 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:02.915771 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:03.026835 29567 debug-util.cc:398] Leaking SignalData structure 0x7b0800309060 after lost signal to thread 28253
W20260709 13:15:03.028381 29567 debug-util.cc:398] Leaking SignalData structure 0x7b080035a7e0 after lost signal to thread 29329
W20260709 13:15:03.030196 29567 debug-util.cc:398] Leaking SignalData structure 0x7b080031c2e0 after lost signal to thread 29496
W20260709 13:15:03.032161 29567 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7e80 after lost signal to thread 29570
W20260709 13:15:03.033881 29567 debug-util.cc:398] Leaking SignalData structure 0x7b080039d360 after lost signal to thread 30184
W20260709 13:15:03.057730 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:03.098389 29435 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:03.193177 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:03.230388 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:03.249995 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:03.351394 29509 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:03.419817 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:03.479957 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:03.523309 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:03.538653 29509 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:03.544580 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:03.556383 28250 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:03.635087 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:03.660188 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:03.767984 29435 consensus_peers.cc:597] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:03.825441 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:04.557019 28250 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:04.799713 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:04.844530 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:15:04.862303  3060 raft_consensus.cc:493] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:15:04.863400  3060 raft_consensus.cc:515] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:04.867995 29435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.016s	sys 0.069s
W20260709 13:15:04.868472 29435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.016s	sys 0.069s
W20260709 13:15:04.923130 29493 debug-util.cc:398] Leaking SignalData structure 0x7b080023dc80 after lost signal to thread 28253
I20260709 13:15:04.931387  3052 raft_consensus.cc:493] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:15:04.932204  3052 raft_consensus.cc:515] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:04.939958  3060 leader_election.cc:290] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:15:04.942171 29493 debug-util.cc:398] Leaking SignalData structure 0x7b0800383480 after lost signal to thread 29329
W20260709 13:15:04.944639 29493 debug-util.cc:398] Leaking SignalData structure 0x7b0800089c80 after lost signal to thread 29496
W20260709 13:15:04.949644 29493 debug-util.cc:398] Leaking SignalData structure 0x7b0800117360 after lost signal to thread 29570
W20260709 13:15:04.951817 29493 debug-util.cc:398] Leaking SignalData structure 0x7b08003aeae0 after lost signal to thread 30184
I20260709 13:15:04.961849  3052 leader_election.cc:290] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:04.969609  3066 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:04.970350  3066 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:04.978926  3052 raft_consensus.cc:493] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:04.979176  3073 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:04.979655  3052 raft_consensus.cc:515] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:04.979779  3073 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:04.982353  3052 leader_election.cc:290] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:04.988962 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:04.997354  3066 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:04.998787  3076 raft_consensus.cc:493] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c65265f20d7e42b6bfe314c5d109bdf7)
I20260709 13:15:05.004221  3076 raft_consensus.cc:515] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.009312  3076 leader_election.cc:290] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:05.009958  3073 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:05.010210 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a320582e5c548dd888eb981df817079" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:05.023837  3079 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:05.024893  3079 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.029870  3079 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:05.032286  3081 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:05.033092  3081 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.036576  3081 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:15:05.055260 30123 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:05.059965 30123 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:05.068321 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 79859.2us
I20260709 13:15:05.073992  3081 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:05.074721  3081 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.078639  3081 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:15:05.076601 29512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 162680us
I20260709 13:15:05.102487 29465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.117676 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.118395 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.123291 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57af445de910412cb7903ef2bf682013" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:15:05.126612 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 46678.8us
I20260709 13:15:05.127825 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.129972  3063 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:05.130228 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9e543a8422407185dcc0cc54131e92" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.133422  3077 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:05.127894  3070 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:05.134780  3070 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.143536  3074 raft_consensus.cc:493] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:05.133996  3077 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.144134  3074 raft_consensus.cc:515] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.146157  3077 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:05.146382  3074 leader_election.cc:290] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:15:05.156205 30123 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.150962  3063 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.152103 29467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8fc42a067a41aa89e5d120919426e3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.142252  3070 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:05.156241 29509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 97533.5us
I20260709 13:15:05.160938 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.161245  3063 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:05.156550  3069 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
W20260709 13:15:05.162145 30123 leader_election.cc:336] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.162081  3069 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.166395  3069 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:05.169186  3069 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:05.169662  3069 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.176528 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad87ed6ec2e4df0b1a1f4bde07cb53e" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:15:05.178934 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.181659  3069 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:05.192617 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b624c2ca9f340c787fc611feea71f37" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:15:05.194005 30123 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.194239 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:05.196331 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:05.198374 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:05.200124 29435 leader_election.cc:304] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:05.201154  3084 raft_consensus.cc:2749] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:05.149834 30126 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:15:05.203933 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 54210.4us
I20260709 13:15:05.203954  3069 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:05.205701 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c368d56c234a6ea4e13263c724dbda" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
I20260709 13:15:05.207710 29464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3890858f888845ec958c83aa9b1ccf5d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" is_pre_election: true
W20260709 13:15:05.217752 29509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111) [suppressed 382 similar messages]
W20260709 13:15:05.220234 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:05.220786 29435 consensus_peers.cc:597] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:05.221376 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:15:05.224617 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfd9651b2124a8580054a3a43fff99d" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:05.231002 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f2621d025741fcb1f7e73ad1af2f4f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:05.231374 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afd3c3bb2df4807a6bdcea59110dee6" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:05.233145 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7e9523dd804c659b1f0d34ac3eefb3" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:05.236021 29509 leader_election.cc:304] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:05.241338  3079 raft_consensus.cc:2749] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:05.253384 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:15:05.254118 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
W20260709 13:15:05.254747 29435 leader_election.cc:336] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.255626 29435 leader_election.cc:304] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.256313  3081 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:05.257614 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.259222  3063 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:05.260510  3084 raft_consensus.cc:2749] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:05.264402 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.257393 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:05.268927  3081 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:05.270566 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:05.273864  3081 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:05.271415 30123 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:15:05.271948  3069 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:05.273006 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.277873  3069 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:05.289991 30126 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.301872  3069 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:05.303318 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.305889 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:15:05.303592 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:05.307857  3069 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:05.309404 30126 leader_election.cc:304] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:15:05.310542 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.311146 29509 leader_election.cc:336] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.311518 29509 leader_election.cc:304] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:05.310608  3063 raft_consensus.cc:2749] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:05.312311  3076 raft_consensus.cc:2749] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:05.321362 30126 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.324554  3069 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:05.349501 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:15:05.375882  3066 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:05.376737  3066 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:05.379308  3066 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:05.385510 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8d0b86f84e95b022820009da4795" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:15:05.387269 30123 leader_election.cc:336] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.407842  3084 raft_consensus.cc:493] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:05.408530  3084 raft_consensus.cc:515] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:05.412792 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f99e4a3e3c44d748842c65d1be7d08e" candidate_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:05.416277 30126 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.421999  3077 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:05.426177 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.426759 29435 leader_election.cc:336] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:05.427170 29435 leader_election.cc:304] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:05.429364  3044 raft_consensus.cc:2749] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:05.443723  3084 leader_election.cc:290] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:15:05.499090 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.499768 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.558571 28250 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:05.585296 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.589072 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.629613 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.689455 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.751401 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.841140 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.853613 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:05.867055 29279 catalog_manager.cc:4755] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 02ea2318003a42fea9088b490db583f1: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:05.922812 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.959830 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:05.995604 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:06.002713 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:06.088354 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:06.123288 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:06.151401 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:06.165319 29435 consensus_peers.cc:597] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:06.303750 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:06.408107 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:06.458457 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:06.505751 29435 consensus_peers.cc:597] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:06.559283 28250 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:06.573792 29435 consensus_peers.cc:597] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:06.577600 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:06.622223 29509 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:06.627755 29435 consensus_peers.cc:597] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:06.726220 29435 consensus_peers.cc:597] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:06.768573 29435 consensus_peers.cc:597] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:06.786954 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:06.820102 29435 consensus_peers.cc:597] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:06.890007 29435 consensus_peers.cc:597] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:06.893217 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:06.894575 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:07.177259 29509 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:07.227437 29438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 45108.5us
W20260709 13:15:07.398751 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:39713, user_credentials={real_user=slave}} blocked reactor thread for 49732.7us
W20260709 13:15:07.418718 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.419382 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.448741 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:07.449682 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.458196 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 50284us
W20260709 13:15:07.482429 29435 consensus_peers.cc:597] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.484172 29435 consensus_peers.cc:597] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.559921 28250 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 29418)
W20260709 13:15:07.592308 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.676455 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.817519 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.838699 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:07.845088 29435 consensus_peers.cc:597] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:07.958079 29326 debug-util.cc:398] Leaking SignalData structure 0x7b080025b620 after lost signal to thread 28253
W20260709 13:15:07.959718 29326 debug-util.cc:398] Leaking SignalData structure 0x7b0800330c60 after lost signal to thread 29329
W20260709 13:15:07.961454 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08003d77c0 after lost signal to thread 29496
W20260709 13:15:07.963199 29326 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5b00 after lost signal to thread 29570
W20260709 13:15:07.964870 29326 debug-util.cc:398] Leaking SignalData structure 0x7b080037a540 after lost signal to thread 30184
W20260709 13:15:07.987166 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.003834 30123 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:08.188602 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.235407 29435 consensus_peers.cc:597] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.256772 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.275982 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.294847 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.301445 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.314121 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.318976 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:08.395367 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.440188 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.444378 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:08.544807 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
I20260709 13:15:08.763134 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
W20260709 13:15:08.778867 29512 consensus_peers.cc:597] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.847982 29435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:38609, user_credentials={real_user=slave}} blocked reactor thread for 56496.4us
W20260709 13:15:08.844512 30126 consensus_peers.cc:597] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.853787 30126 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.873318 30126 consensus_peers.cc:597] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.907873 30126 consensus_peers.cc:597] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.934088 29435 consensus_peers.cc:597] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:08.942539 29435 consensus_peers.cc:597] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:08.958271 29512 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.960163 29509 consensus_peers.cc:597] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.961634 29512 consensus_peers.cc:597] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.965716 29512 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.966341 29512 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.986487 30126 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.987401 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:08.997810 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:08.999567 29435 consensus_peers.cc:597] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:09.039712 29512 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:09.040655 30126 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:09.041817 30126 consensus_peers.cc:597] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.044577 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:15:09.044617 30126 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.050115 28250 tablet_replica.cc:333] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
W20260709 13:15:09.050264 30126 consensus_peers.cc:597] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.051625 28250 raft_consensus.cc:2243] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.052484 28250 raft_consensus.cc:2272] T cb7c51305cb0421f843fcf7f543b7163 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.055435 28250 tablet_replica.cc:333] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.056107 28250 raft_consensus.cc:2243] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.056669 28250 raft_consensus.cc:2272] T c40cc430e0bf4a5f946bc53291d0b771 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.059187 28250 tablet_replica.cc:333] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.059945 28250 raft_consensus.cc:2243] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.060488 28250 raft_consensus.cc:2272] T 1aeb2ba78c7749cb983fda41498f1bea P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.062808 28250 tablet_replica.cc:333] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.063560 28250 raft_consensus.cc:2243] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.064152 28250 raft_consensus.cc:2272] T 4a320582e5c548dd888eb981df817079 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.067070 28250 tablet_replica.cc:333] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.067950 28250 raft_consensus.cc:2243] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.069010 28250 raft_consensus.cc:2272] T 77e08f37d90645918ef0bee732dd4b98 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.074018 28250 tablet_replica.cc:333] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
W20260709 13:15:09.075490 30126 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.076306 28250 raft_consensus.cc:2243] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.077386 28250 raft_consensus.cc:2272] T a6194a4e996b4050bfb519664b72df1c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:09.077924 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:15:09.080469 28250 tablet_replica.cc:333] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.081171 28250 raft_consensus.cc:2243] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.081815 28250 raft_consensus.cc:2272] T 225e23ac0b4c490cb213c4d4945ec334 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.084844 28250 tablet_replica.cc:333] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.085703 28250 raft_consensus.cc:2243] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.086608 28250 raft_consensus.cc:2272] T cbc3743d348b41f48617d0cb35c85353 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.089321 28250 tablet_replica.cc:333] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.090354 28250 raft_consensus.cc:2243] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.091506 28250 raft_consensus.cc:2272] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.093631 28250 tablet_replica.cc:333] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.094211 28250 raft_consensus.cc:2243] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.094974 28250 raft_consensus.cc:2272] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.098274 28250 tablet_replica.cc:333] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.099164 28250 raft_consensus.cc:2243] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.102238 28250 raft_consensus.cc:2272] T 0d0e544e6ea1421bb32b24408af01b22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.104632 28250 tablet_replica.cc:333] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.105243 28250 raft_consensus.cc:2243] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.105746 28250 raft_consensus.cc:2272] T d01483a998944f4386fc5dfa1f0fd51a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.108381 28250 tablet_replica.cc:333] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.109409 28250 raft_consensus.cc:2243] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.109998 28250 raft_consensus.cc:2272] T 184cb00180cf42c7b6803577c868b1dd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.117358 28250 tablet_replica.cc:333] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.118254 28250 raft_consensus.cc:2243] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.119675 28250 raft_consensus.cc:2272] T 1c6c0a7893ec49c19f3e702094ed4941 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:09.119683 29512 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.122795 28250 tablet_replica.cc:333] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.123660 28250 raft_consensus.cc:2243] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.126034 28250 raft_consensus.cc:2272] T 1820d3fb534c4bbeb79d583637982dfb P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.129961 28250 tablet_replica.cc:333] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.130872 28250 raft_consensus.cc:2243] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.132205 28250 raft_consensus.cc:2272] T 3e8fc42a067a41aa89e5d120919426e3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:09.135294 29512 consensus_peers.cc:597] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:09.137162 30126 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.139596 28250 tablet_replica.cc:333] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.140621 28250 raft_consensus.cc:2243] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.141501 28250 raft_consensus.cc:2272] T 6c21d46fd7a440b09555995fc5c75ad3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.145220 28250 tablet_replica.cc:333] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.146199 28250 raft_consensus.cc:2243] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.146873 28250 raft_consensus.cc:2272] T 29e2fd913c0b414a81386c129004967f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.149955 28250 tablet_replica.cc:333] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.150802 28250 raft_consensus.cc:2243] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.151402 28250 raft_consensus.cc:2272] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.154392 28250 tablet_replica.cc:333] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.155279 28250 raft_consensus.cc:2243] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.156574 28250 raft_consensus.cc:2272] T bd61183c8c5845d289dedeb85f533fa0 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.159642 28250 tablet_replica.cc:333] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.160526 28250 raft_consensus.cc:2243] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.161121 28250 raft_consensus.cc:2272] T 38fdcb033993416ca10b3d79544c9d59 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:09.162993 30126 consensus_peers.cc:597] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:09.164004 30126 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.164170 28250 tablet_replica.cc:333] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.165488 28250 raft_consensus.cc:2243] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.166720 28250 raft_consensus.cc:2272] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.169620 28250 tablet_replica.cc:333] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.170452 28250 raft_consensus.cc:2243] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.172274 28250 raft_consensus.cc:2272] T 48cbba4289f149fa85b4f656897b6390 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.174580 28250 tablet_replica.cc:333] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.175174 28250 raft_consensus.cc:2243] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.176205 28250 raft_consensus.cc:2272] T 02ea2318003a42fea9088b490db583f1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.178285 28250 tablet_replica.cc:333] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.178985 28250 raft_consensus.cc:2243] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.180253 28250 raft_consensus.cc:2272] T 91c368d56c234a6ea4e13263c724dbda P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.183005 28250 tablet_replica.cc:333] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.183754 28250 raft_consensus.cc:2243] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.184412 28250 raft_consensus.cc:2272] T 22f2621d025741fcb1f7e73ad1af2f4f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:09.187016 29435 consensus_peers.cc:597] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:09.187316 28250 tablet_replica.cc:333] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.188217 28250 raft_consensus.cc:2243] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.189415 28250 raft_consensus.cc:2272] T 29153e3fc529491aa91c830a4456d35a P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.191854 28250 tablet_replica.cc:333] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.192461 28250 raft_consensus.cc:2243] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.193079 28250 raft_consensus.cc:2272] T 2068d180d9904ad9abf956769d9a2f1d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.196002 28250 tablet_replica.cc:333] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.196839 28250 raft_consensus.cc:2243] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.197391 28250 raft_consensus.cc:2272] T 57af445de910412cb7903ef2bf682013 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:09.197801 29512 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:09.199755 28250 tablet_replica.cc:333] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.200455 28250 raft_consensus.cc:2243] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.201485 28250 raft_consensus.cc:2272] T ef663d2174234a11995ce0c886e35150 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.204337 28250 tablet_replica.cc:333] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.205057 28250 raft_consensus.cc:2243] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.205734 28250 raft_consensus.cc:2272] T 4e6fccf47ee14532860e20ec4b983155 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.208559 28250 tablet_replica.cc:333] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.209334 28250 raft_consensus.cc:2243] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.210776 28250 raft_consensus.cc:2272] T d03f148e37fd4109805d1d7b3b02b2fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.213280 28250 tablet_replica.cc:333] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.214058 28250 raft_consensus.cc:2243] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.214638 28250 raft_consensus.cc:2272] T 1f99e4a3e3c44d748842c65d1be7d08e P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.227691 28250 tablet_replica.cc:333] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.228966 28250 raft_consensus.cc:2243] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.230969 28250 raft_consensus.cc:2272] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.234802 28250 tablet_replica.cc:333] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.235743 28250 raft_consensus.cc:2243] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.239512 28250 raft_consensus.cc:2272] T 3890858f888845ec958c83aa9b1ccf5d P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.242606 28250 tablet_replica.cc:333] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.243395 28250 raft_consensus.cc:2243] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.244026 28250 raft_consensus.cc:2272] T 04f141f7950d4a72a8aac7ed37a423fd P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.249302 28250 tablet_replica.cc:333] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.250556 28250 raft_consensus.cc:2243] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:15:09.257524 29512 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:09.266868 29435 consensus_peers.cc:597] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:09.251806 28250 raft_consensus.cc:2272] T 133108182cae493ab908290bfa9179d1 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.273382 28250 tablet_replica.cc:333] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.274260 28250 raft_consensus.cc:2243] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.275847 28250 raft_consensus.cc:2272] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.278944 28250 tablet_replica.cc:333] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.279726 28250 raft_consensus.cc:2243] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:15:09.279778 29509 consensus_peers.cc:597] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:09.281957 28250 raft_consensus.cc:2272] T 930d24af7f0e45c19e80e2efaab717d7 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.285686 28250 tablet_replica.cc:333] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.292318 28250 raft_consensus.cc:2243] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.293022 28250 raft_consensus.cc:2272] T 6a79c5f3852446bd956bcf002f2bd78c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.296010 28250 tablet_replica.cc:333] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.296762 28250 raft_consensus.cc:2243] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.297909 28250 raft_consensus.cc:2272] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.300652 28250 tablet_replica.cc:333] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.301357 28250 raft_consensus.cc:2243] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.302733 28250 raft_consensus.cc:2272] T 6aa3c8fa6cf741bdafed124439764c9c P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.305800 28250 tablet_replica.cc:333] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.306699 28250 raft_consensus.cc:2243] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:09.308409 28250 raft_consensus.cc:2272] T 9f9e543a8422407185dcc0cc54131e92 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.311306 28250 tablet_replica.cc:333] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.312179 28250 raft_consensus.cc:2243] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.313206 28250 raft_consensus.cc:2272] T 0648129226444c81aef501f2bf17e434 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.316569 28250 tablet_replica.cc:333] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6: stopping tablet replica
I20260709 13:15:09.317539 28250 raft_consensus.cc:2243] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.318264 28250 raft_consensus.cc:2272] T 1016126be7f841c4acc0cd897e5df0c3 P 7ffbae1cdd164f7181ae5fbf7ecf65d6 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:09.334422 29512 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:09.339447 29509 consensus_peers.cc:597] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:09.438617 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:09.515928 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:09.673532 29509 consensus_peers.cc:597] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:09.745297 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:09.792349 29509 consensus_peers.cc:597] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:09.930097 29509 consensus_peers.cc:597] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:09.971983 30123 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:10.020159 30123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:42027, user_credentials={real_user=slave}} blocked reactor thread for 45150.1us
W20260709 13:15:10.033973 30123 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:10.218848 29509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111) [suppressed 477 similar messages]
I20260709 13:15:10.224845  3109 raft_consensus.cc:493] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.225625  3109 raft_consensus.cc:515] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:10.227963  3109 leader_election.cc:290] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:10.233281 30123 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:10.236819 29512 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
W20260709 13:15:10.237768 29509 leader_election.cc:336] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.238150 29509 leader_election.cc:304] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.238868  3116 raft_consensus.cc:2749] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:10.262162  3116 raft_consensus.cc:493] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.262804  3116 raft_consensus.cc:515] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:10.265774  3116 leader_election.cc:290] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:10.276079 29509 leader_election.cc:336] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:10.282995 29512 leader_election.cc:336] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.283489 29512 leader_election.cc:304] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.284343  3109 raft_consensus.cc:2749] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:10.285089  3102 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.285893  3102 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.288312  3102 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.290616 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:10.290673  3109 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.292002  3109 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.293102 30126 leader_election.cc:336] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.294791  3109 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:10.295336 30126 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.296486  3102 raft_consensus.cc:2749] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.304723 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:15:10.310663 30123 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:10.310804 29512 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.325872 29509 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:10.327452  3109 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:10.332901 29509 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:10.357517 29509 consensus_peers.cc:597] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:10.372208 29509 consensus_peers.cc:597] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:10.382027  3116 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.382781  3120 raft_consensus.cc:493] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.383471  3120 raft_consensus.cc:515] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:10.382668  3116 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.390636 29509 leader_election.cc:336] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:10.391374 29512 leader_election.cc:336] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.391983  3120 leader_election.cc:290] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:10.393682  3116 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:10.394536 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:10.396369 29509 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:10.397604  3116 raft_consensus.cc:2749] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:10.398964  3073 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.398111  3120 raft_consensus.cc:493] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.399528  3073 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.398110 29512 leader_election.cc:336] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.400427 29512 leader_election.cc:304] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.402297  3116 raft_consensus.cc:2749] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.400089  3120 raft_consensus.cc:515] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:10.405531  3120 leader_election.cc:290] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:10.408488 30126 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
W20260709 13:15:10.411586 29509 leader_election.cc:336] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.412196  3102 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.415521  3102 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.417670  3102 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:10.413600  3073 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:10.420149  3073 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.420631  3073 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.422420  3073 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:15:10.424454 30123 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.426716 30123 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.428560  3109 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.429006  3102 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.429139  3109 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.432092  3109 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:10.434300 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
W20260709 13:15:10.435249 29512 leader_election.cc:336] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.439579 29512 leader_election.cc:304] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:15:10.438386 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.437630  3120 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:15:10.440572 29509 leader_election.cc:336] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.441069  3120 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.441435 29509 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 88760af579b54a6393c6251aa3c6b870, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:10.444751  3109 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.445556  3109 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.446702  3120 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:10.449028  3120 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.442145  3116 raft_consensus.cc:2749] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.456296  3120 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.446029  3109 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.459172  3120 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:15:10.460644 29512 leader_election.cc:336] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.460742  3109 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:10.454465  3102 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.462913  3102 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.465837  3102 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.465893  3109 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.466614  3109 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.468710  3109 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:15:10.471493 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42971, user_credentials={real_user=slave}} blocked reactor thread for 51937us
W20260709 13:15:10.475668 29512 leader_election.cc:336] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.484025 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:10.484696 30158 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
W20260709 13:15:10.490047 30126 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.490567 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.491348  3073 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:10.491539 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.496407  3073 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.496881  3073 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.497905 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:10.498580 30153 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 11.
I20260709 13:15:10.498721 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:10.499675 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:10.501935  3073 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.502015  3122 raft_consensus.cc:493] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.507529  3122 raft_consensus.cc:515] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
W20260709 13:15:10.509375 29512 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.509905  3122 leader_election.cc:290] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:10.510017 29512 leader_election.cc:336] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.504894 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:10.510883 29543 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 7.
W20260709 13:15:10.510905 29512 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.502815 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:10.511934 29545 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:15:10.514868 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.516047 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.517724  3123 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:10.518110  3123 raft_consensus.cc:493] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.518492  3123 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.521966  3124 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:10.522531  3124 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.522985  3124 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:10.526964 29509 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:10.529587  3122 raft_consensus.cc:2749] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:10.527921  3123 raft_consensus.cc:515] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.532025 29509 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:10.532330  3123 leader_election.cc:290] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:15:10.532970 30126 leader_election.cc:336] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
W20260709 13:15:10.533025 29512 leader_election.cc:336] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.533653  3122 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.540441  3122 raft_consensus.cc:493] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.540556 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
W20260709 13:15:10.541216 29509 leader_election.cc:336] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.540987  3122 raft_consensus.cc:515] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:10.543325  3073 raft_consensus.cc:493] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.543896  3073 raft_consensus.cc:515] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.547282  3073 leader_election.cc:290] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.549503  3122 leader_election.cc:290] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:10.553519  3124 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.554224 30123 leader_election.cc:336] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:10.555181 29512 leader_election.cc:336] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
W20260709 13:15:10.558419 29512 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.558933 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29153e3fc529491aa91c830a4456d35a" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:15:10.559617 30152 raft_consensus.cc:3060] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.561447 30126 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.562357 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2992ae50b9804afb8a7cfe63feb5bf34" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:15:10.562788 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.563043 30151 raft_consensus.cc:3060] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:10.564311 29512 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.567211  3121 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:10.567628  3121 raft_consensus.cc:493] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.567992  3121 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:10.569365 30152 raft_consensus.cc:2468] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 13.
I20260709 13:15:10.569511  3073 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.570112  3073 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.571578 30126 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.575484  3121 raft_consensus.cc:515] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.577529  3121 leader_election.cc:290] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:15:10.579025 30126 leader_election.cc:336] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.579512 30126 leader_election.cc:304] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
W20260709 13:15:10.583259 30123 leader_election.cc:336] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.587081  3122 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.587620  3122 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.590236 30126 leader_election.cc:336] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.583815  3073 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:10.592046  3073 raft_consensus.cc:2749] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.592726  3122 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
W20260709 13:15:10.597877 29512 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.598704  3073 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:15:10.599161 30126 leader_election.cc:336] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.599234  3073 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.599761 30126 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.586565 30151 raft_consensus.cc:2468] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:15:10.602347  3125 raft_consensus.cc:2764] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:10.603112  3102 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:10.603102  3073 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:10.604919 30123 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:10.584813 29509 leader_election.cc:336] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.605551 29509 leader_election.cc:304] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.586014  3124 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:10.607439  3122 raft_consensus.cc:2749] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:10.610764 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:10.611459 29545 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:15:10.614126  3124 raft_consensus.cc:493] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.614729  3124 raft_consensus.cc:515] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:10.616287 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbba4289f149fa85b4f656897b6390" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:10.617044 29543 raft_consensus.cc:2468] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 12.
I20260709 13:15:10.618757  3121 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.619395  3121 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.621583  3121 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.622272 29543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07f0ebecfce24837b2bbdbea5b0b6b8f" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
W20260709 13:15:10.623979 30126 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.628281 29543 raft_consensus.cc:3060] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:10.629027 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" is_pre_election: true
I20260709 13:15:10.628440  3125 raft_consensus.cc:493] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.629637 30151 raft_consensus.cc:2468] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in term 12.
I20260709 13:15:10.630179  3125 raft_consensus.cc:515] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } attrs { replace: true } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.631080 29512 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.632473  3073 raft_consensus.cc:493] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.632969  3125 leader_election.cc:290] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.632953  3073 raft_consensus.cc:515] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } attrs { replace: true } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.628283 30126 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.634923  3125 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:10.637401  3125 raft_consensus.cc:493] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.637882  3125 raft_consensus.cc:515] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.639801  3125 leader_election.cc:290] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:10.637282 30126 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.638741  3073 leader_election.cc:290] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.641014  3124 leader_election.cc:290] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:10.642863 29509 leader_election.cc:304] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.643936  3123 raft_consensus.cc:2804] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:10.644464  3123 raft_consensus.cc:697] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
I20260709 13:15:10.645386  3123 consensus_queue.cc:237] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.645664 30123 leader_election.cc:336] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.649788 29509 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.641314  3121 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:10.650712  3122 raft_consensus.cc:2804] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:15:10.652966 30123 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.650480  3121 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
W20260709 13:15:10.653609 30123 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.654035  3121 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.654544  3122 raft_consensus.cc:697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Becoming Leader. State: Replica: 7c2e8d3e55c649e2b3acedef25d81e16, State: Running, Role: LEADER
W20260709 13:15:10.655320 30126 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.655813  3122 consensus_queue.cc:237] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.658535 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.659363  3120 raft_consensus.cc:2804] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:10.659770  3120 raft_consensus.cc:493] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.660121  3120 raft_consensus.cc:3060] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:10.660524 30126 leader_election.cc:336] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.661006 30126 leader_election.cc:304] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.661074 29540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930d24af7f0e45c19e80e2efaab717d7" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:10.661327 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
I20260709 13:15:10.661828  3125 raft_consensus.cc:2749] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.661864 29540 raft_consensus.cc:2468] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 11.
I20260709 13:15:10.662032 29541 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 14.
W20260709 13:15:10.668576 30126 leader_election.cc:336] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.669117 29543 raft_consensus.cc:2468] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 8.
I20260709 13:15:10.669142 30126 leader_election.cc:304] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.672452 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f148e37fd4109805d1d7b3b02b2fd" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" is_pre_election: true
W20260709 13:15:10.675781 30126 leader_election.cc:336] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.676249 30126 leader_election.cc:304] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.675805 29546 raft_consensus.cc:2468] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 10.
I20260709 13:15:10.676990  3125 raft_consensus.cc:2749] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:10.676730 29509 leader_election.cc:336] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.677839 29509 leader_election.cc:304] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.678465  3125 raft_consensus.cc:2749] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:10.678726  3124 raft_consensus.cc:2749] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:10.684974 29509 leader_election.cc:336] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.685427 29509 leader_election.cc:304] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.687135  3124 raft_consensus.cc:2749] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.690546  3120 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.693042  3120 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132:38609)
I20260709 13:15:10.695084  3121 raft_consensus.cc:515] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.698926 29512 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.700840 29290 catalog_manager.cc:5697] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 12 to 13, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 13 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.704447  3121 leader_election.cc:290] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:10.702260 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.705051 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c65265f20d7e42b6bfe314c5d109bdf7"
I20260709 13:15:10.705893 30151 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c2e8d3e55c649e2b3acedef25d81e16 in current term 13: Already voted for candidate c65265f20d7e42b6bfe314c5d109bdf7 in this term.
I20260709 13:15:10.706526 30126 leader_election.cc:304] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.707825  3073 raft_consensus.cc:2804] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:10.707024  3125 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:10.708954  3125 raft_consensus.cc:493] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.709362  3125 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.711266  3073 raft_consensus.cc:697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:15:10.712211  3073 consensus_queue.cc:237] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.722302  3120 raft_consensus.cc:493] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:10.722886  3120 raft_consensus.cc:515] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } }
I20260709 13:15:10.725062  3120 leader_election.cc:290] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:10.733392 30126 leader_election.cc:336] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
W20260709 13:15:10.739281 30123 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:10.740002 29512 leader_election.cc:336] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.743230 29295 catalog_manager.cc:5697] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 7 to 8, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 8 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.753180  3125 raft_consensus.cc:515] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:10.755204 29509 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, c65265f20d7e42b6bfe314c5d109bdf7
I20260709 13:15:10.756755  3120 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:15:10.758739 30123 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:10.761914 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133108182cae493ab908290bfa9179d1" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:15:10.762851 29541 raft_consensus.cc:2393] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c65265f20d7e42b6bfe314c5d109bdf7 in current term 13: Already voted for candidate 7c2e8d3e55c649e2b3acedef25d81e16 in this term.
I20260709 13:15:10.765681  3125 leader_election.cc:290] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 election: Requested vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
W20260709 13:15:10.766521 29509 consensus_peers.cc:597] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:10.770640 29541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc1ed542cbc3498ba13b3fe1f50b5d22" candidate_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c2e8d3e55c649e2b3acedef25d81e16"
I20260709 13:15:10.771175 29541 raft_consensus.cc:3060] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:10.772464 29509 leader_election.cc:336] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:10.772907 29509 leader_election.cc:304] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:10.773041 30126 leader_election.cc:304] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:10.773870  3073 raft_consensus.cc:2749] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.781745 29541 raft_consensus.cc:2468] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65265f20d7e42b6bfe314c5d109bdf7 in term 15.
I20260709 13:15:10.783535  3120 raft_consensus.cc:2749] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.784881 30126 leader_election.cc:304] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2e8d3e55c649e2b3acedef25d81e16, c65265f20d7e42b6bfe314c5d109bdf7; no voters: 
I20260709 13:15:10.785946  3073 raft_consensus.cc:2804] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:10.786542  3073 raft_consensus.cc:697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 LEADER]: Becoming Leader. State: Replica: c65265f20d7e42b6bfe314c5d109bdf7, State: Running, Role: LEADER
I20260709 13:15:10.788647  3073 consensus_queue.cc:237] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
W20260709 13:15:10.790004 30126 leader_election.cc:336] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:10.815775 29295 catalog_manager.cc:5697] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 reported cstate change: term changed from 11 to 12, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131). New cstate: current_term: 12 leader_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.817994 29290 catalog_manager.cc:5697] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 reported cstate change: term changed from 14 to 15, leader changed from 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130) to c65265f20d7e42b6bfe314c5d109bdf7 (127.27.150.132). New cstate: current_term: 15 leader_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.856602 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
W20260709 13:15:10.929833 30126 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:10.930824 30123 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:10.941625 29509 consensus_peers.cc:597] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:10.942238 29509 consensus_peers.cc:597] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:10.957773 30123 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:11.053828 29509 consensus_peers.cc:597] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:11.062587 29512 consensus_peers.cc:597] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.062668 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:15:11.062798 29509 consensus_peers.cc:597] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:11.070133 28250 tablet_replica.cc:333] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.072808 28250 raft_consensus.cc:2243] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.076308 28250 raft_consensus.cc:2272] T 1aeb2ba78c7749cb983fda41498f1bea P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:11.077152 30126 consensus_peers.cc:597] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:11.077948 30126 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:11.080389 30126 consensus_peers.cc:597] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:11.081094 30126 consensus_peers.cc:597] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:11.084571 30126 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.092010 28250 tablet_replica.cc:333] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.094630 28250 raft_consensus.cc:2243] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.097512 28250 raft_consensus.cc:2272] T 61f7f02fdc8243cd8806a09e7908831e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.101838 28250 tablet_replica.cc:333] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.104025 28250 raft_consensus.cc:2243] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.107036 28250 raft_consensus.cc:2272] T 4e6fccf47ee14532860e20ec4b983155 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.112111 28250 tablet_replica.cc:333] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.113041 28250 raft_consensus.cc:2243] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.115748 28250 raft_consensus.cc:2272] T 4a320582e5c548dd888eb981df817079 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.120524 28250 tablet_replica.cc:333] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.122095 28250 raft_consensus.cc:2243] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.125229 28250 raft_consensus.cc:2272] T 2068d180d9904ad9abf956769d9a2f1d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:11.125418 30123 consensus_peers.cc:597] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:11.129606 28250 tablet_replica.cc:333] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.131141 28250 raft_consensus.cc:2243] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:15:11.130527 30126 consensus_peers.cc:597] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.135185 28250 pending_rounds.cc:70] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Trying to abort 1 pending ops.
W20260709 13:15:11.135035 30123 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:11.135450 30126 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.135618 28250 pending_rounds.cc:77] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting op as it isn't in flight: id { term: 13 index: 12 } timestamp: 7305637522012794880 op_type: NO_OP noop_request { }
I20260709 13:15:11.136555 28250 raft_consensus.cc:2889] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:11.137111 28250 raft_consensus.cc:2272] T 29153e3fc529491aa91c830a4456d35a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:11.139305 30126 consensus_peers.cc:597] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.140934 28250 tablet_replica.cc:333] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.141719 28250 raft_consensus.cc:2243] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.143641 28250 pending_rounds.cc:70] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Trying to abort 1 pending ops.
I20260709 13:15:11.143882 28250 pending_rounds.cc:77] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16: Aborting op as it isn't in flight: id { term: 12 index: 12 } timestamp: 7305637522058235904 op_type: NO_OP noop_request { }
I20260709 13:15:11.144254 28250 raft_consensus.cc:2889] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:11.144636 28250 raft_consensus.cc:2272] T 2992ae50b9804afb8a7cfe63feb5bf34 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.147866 28250 tablet_replica.cc:333] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.148931 28250 raft_consensus.cc:2243] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.149726 28250 raft_consensus.cc:2272] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.152542 28250 tablet_replica.cc:333] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.153295 28250 raft_consensus.cc:2243] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.154417 28250 raft_consensus.cc:2272] T 1c6c0a7893ec49c19f3e702094ed4941 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.158329 28250 tablet_replica.cc:333] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.159299 28250 raft_consensus.cc:2243] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.160934 28250 raft_consensus.cc:2272] T 1820d3fb534c4bbeb79d583637982dfb P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.166955 28250 tablet_replica.cc:333] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
W20260709 13:15:11.167816 30126 consensus_peers.cc:597] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.168642 28250 raft_consensus.cc:2243] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.170370 28250 raft_consensus.cc:2272] T 0d0e544e6ea1421bb32b24408af01b22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.174054 28250 tablet_replica.cc:333] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.175423 28250 raft_consensus.cc:2243] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.178182 28250 raft_consensus.cc:2272] T 6c21d46fd7a440b09555995fc5c75ad3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.182942 28250 tablet_replica.cc:333] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.183990 28250 raft_consensus.cc:2243] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:15:11.185139 30126 consensus_peers.cc:597] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.186313 28250 raft_consensus.cc:2272] T 29e2fd913c0b414a81386c129004967f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:11.186645 30126 consensus_peers.cc:597] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:11.190310 28250 tablet_replica.cc:333] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
W20260709 13:15:11.190999 30126 consensus_peers.cc:597] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.191424 28250 raft_consensus.cc:2243] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.192811 28250 raft_consensus.cc:2272] T 8b624c2ca9f340c787fc611feea71f37 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.196175 28250 tablet_replica.cc:333] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.197531 28250 raft_consensus.cc:2243] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.198529 28250 raft_consensus.cc:2272] T d01483a998944f4386fc5dfa1f0fd51a P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.202015 28250 tablet_replica.cc:333] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.202940 28250 raft_consensus.cc:2243] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.205494 28250 raft_consensus.cc:2272] T 495c8d0b86f84e95b022820009da4795 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.208878 28250 tablet_replica.cc:333] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.209611 28250 raft_consensus.cc:2243] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.210807 28250 raft_consensus.cc:2272] T 2d6296aca66540dc81b696ae74a6fd42 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.213438 28250 tablet_replica.cc:333] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.214202 28250 raft_consensus.cc:2243] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.214999 28250 raft_consensus.cc:2272] T 5d3e26705f6f42428e0c9830d7dbedb6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.218365 28250 tablet_replica.cc:333] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.219121 28250 raft_consensus.cc:2243] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.220719 28250 raft_consensus.cc:2272] T bd61183c8c5845d289dedeb85f533fa0 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.223979 28250 tablet_replica.cc:333] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
W20260709 13:15:11.224431 29509 consensus_peers.cc:597] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:11.224963 28250 raft_consensus.cc:2243] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.226477 28250 raft_consensus.cc:2272] T 1a6fe7feab0c45ddb9198327b19a5bc5 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.230350 28250 tablet_replica.cc:333] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.231424 28250 raft_consensus.cc:2243] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.233481 28250 raft_consensus.cc:2272] T 04f141f7950d4a72a8aac7ed37a423fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.236460 28250 tablet_replica.cc:333] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.237128 28250 raft_consensus.cc:2243] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.237901 28250 raft_consensus.cc:2272] T 57af445de910412cb7903ef2bf682013 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.240617 28250 tablet_replica.cc:333] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.241320 28250 raft_consensus.cc:2243] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.242203 28250 raft_consensus.cc:2272] T ef663d2174234a11995ce0c886e35150 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.244899 28250 tablet_replica.cc:333] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.245689 28250 raft_consensus.cc:2243] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.246754 28250 raft_consensus.cc:2272] T 5c1f2ca19fef40e2aa07c8513a7bffbd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.250087 28250 tablet_replica.cc:333] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.251143 28250 raft_consensus.cc:2243] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.253250 28250 raft_consensus.cc:2272] T 1f99e4a3e3c44d748842c65d1be7d08e P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.257155 28250 tablet_replica.cc:333] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.258133 28250 raft_consensus.cc:2243] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.259627 28250 raft_consensus.cc:2272] T 0585fb6756aa496392b1ee0371aa9804 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.263173 28250 tablet_replica.cc:333] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
W20260709 13:15:11.263051 30126 consensus_peers.cc:597] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:11.264163 28250 raft_consensus.cc:2243] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.265599 28250 raft_consensus.cc:2272] T 59bfc5123acd4083b0f36af624300133 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.269007 28250 tablet_replica.cc:333] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.269981 28250 raft_consensus.cc:2243] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:11.272482 29512 consensus_peers.cc:597] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:11.272733 28250 raft_consensus.cc:2272] T 48cbba4289f149fa85b4f656897b6390 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.277261 28250 tablet_replica.cc:333] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.278216 28250 raft_consensus.cc:2243] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.279986 28250 raft_consensus.cc:2272] T 02ea2318003a42fea9088b490db583f1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.283851 28250 tablet_replica.cc:333] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
W20260709 13:15:11.284098 30123 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:11.284859 28250 raft_consensus.cc:2243] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.286604 28250 raft_consensus.cc:2272] T d03f148e37fd4109805d1d7b3b02b2fd P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.290060 28250 tablet_replica.cc:333] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.290936 28250 raft_consensus.cc:2243] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.293053 28250 raft_consensus.cc:2272] T 22f2621d025741fcb1f7e73ad1af2f4f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.296737 28250 tablet_replica.cc:333] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.297597 28250 raft_consensus.cc:2243] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.299141 28250 raft_consensus.cc:2272] T 133108182cae493ab908290bfa9179d1 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.302760 28250 tablet_replica.cc:333] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
W20260709 13:15:11.303090 30126 consensus_peers.cc:597] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.303735 28250 raft_consensus.cc:2243] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.306557 28250 raft_consensus.cc:2272] T 5c7e9523dd804c659b1f0d34ac3eefb3 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:11.307268 30126 consensus_peers.cc:597] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:11.308590 30126 consensus_peers.cc:597] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.310099 28250 tablet_replica.cc:333] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.310945 28250 raft_consensus.cc:2243] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:11.311381 30126 consensus_peers.cc:597] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:11.312970 28250 raft_consensus.cc:2272] T 07f0ebecfce24837b2bbdbea5b0b6b8f P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.315981 28250 tablet_replica.cc:333] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.316686 28250 raft_consensus.cc:2243] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.319413 28250 raft_consensus.cc:2272] T cbc3743d348b41f48617d0cb35c85353 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.323215 28250 tablet_replica.cc:333] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.324105 28250 raft_consensus.cc:2243] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.324923 28250 raft_consensus.cc:2272] T 225e23ac0b4c490cb213c4d4945ec334 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.329361 28250 tablet_replica.cc:333] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.330294 28250 raft_consensus.cc:2243] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.332252 28250 raft_consensus.cc:2272] T 930d24af7f0e45c19e80e2efaab717d7 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.336248 28250 tablet_replica.cc:333] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.337347 28250 raft_consensus.cc:2243] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.339427 28250 raft_consensus.cc:2272] T 5afd3c3bb2df4807a6bdcea59110dee6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.342983 28250 tablet_replica.cc:333] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.343761 28250 raft_consensus.cc:2243] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.344620 28250 raft_consensus.cc:2272] T 5c1e2c054c694186bc648342e40f4d3b P 7c2e8d3e55c649e2b3acedef25d81e16 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.347342 28250 tablet_replica.cc:333] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.347952 28250 raft_consensus.cc:2243] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.349090 28250 raft_consensus.cc:2272] T cf141daac9d14f459ccbaeee8764a9e6 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.351759 28250 tablet_replica.cc:333] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.352761 28250 raft_consensus.cc:2243] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.353608 28250 raft_consensus.cc:2272] T 6aa3c8fa6cf741bdafed124439764c9c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.356950 28250 tablet_replica.cc:333] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.357784 28250 raft_consensus.cc:2243] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.358770 28250 raft_consensus.cc:2272] T 268b94ce95ed4e5abc8be97084461e57 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.361182 28250 tablet_replica.cc:333] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.361742 28250 raft_consensus.cc:2243] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.362406 28250 raft_consensus.cc:2272] T bc1ed542cbc3498ba13b3fe1f50b5d22 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.365139 28250 tablet_replica.cc:333] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.365723 28250 raft_consensus.cc:2243] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.367452 28250 raft_consensus.cc:2272] T 5bfd9651b2124a8580054a3a43fff99d P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.370095 28250 tablet_replica.cc:333] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.370680 28250 raft_consensus.cc:2243] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.371515 28250 raft_consensus.cc:2272] T 71fb5043e48f4e1a86ec8d962d18b0b4 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.374388 28250 tablet_replica.cc:333] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.375213 28250 raft_consensus.cc:2243] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.376421 28250 raft_consensus.cc:2272] T 6a79c5f3852446bd956bcf002f2bd78c P 7c2e8d3e55c649e2b3acedef25d81e16 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.379516 28250 tablet_replica.cc:333] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16: stopping tablet replica
I20260709 13:15:11.380025 28250 raft_consensus.cc:2243] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:11.380785 28250 raft_consensus.cc:2272] T 36373f233812459591c31993a4959894 P 7c2e8d3e55c649e2b3acedef25d81e16 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:11.394654 30126 consensus_peers.cc:597] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:11.405313 30126 consensus_peers.cc:597] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.411839 30126 consensus_peers.cc:597] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Couldn't send request to peer 7c2e8d3e55c649e2b3acedef25d81e16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:11.451061 30126 consensus_peers.cc:597] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.454218 30126 consensus_peers.cc:597] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.504649 30123 consensus_peers.cc:597] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:11.554390 30126 consensus_peers.cc:597] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.578786 30126 consensus_peers.cc:597] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.589762 30126 consensus_peers.cc:597] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.617942 30126 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.708666 30126 consensus_peers.cc:597] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.761153 30126 consensus_peers.cc:597] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.763782 30123 consensus_peers.cc:597] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:11.802058 30126 consensus_peers.cc:597] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.829849 30126 consensus_peers.cc:597] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Couldn't send request to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:11.983853 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
I20260709 13:15:12.083092  3137 raft_consensus.cc:493] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:12.084143  3137 raft_consensus.cc:515] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.087122  3137 leader_election.cc:290] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:12.095690 30123 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:12.096266 30126 leader_election.cc:336] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:12.096720 30126 leader_election.cc:304] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:12.097596  3137 raft_consensus.cc:2749] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:12.128701  3137 raft_consensus.cc:493] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:12.129515  3137 raft_consensus.cc:515] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.130671  3136 raft_consensus.cc:493] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:12.131462  3136 raft_consensus.cc:515] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.132164  3137 leader_election.cc:290] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:12.134263  3137 raft_consensus.cc:493] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:12.134980  3137 raft_consensus.cc:515] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.137297  3137 leader_election.cc:290] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:12.139415  3136 leader_election.cc:290] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:12.142423 30123 leader_election.cc:336] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:12.143050 30123 leader_election.cc:336] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:12.147467 30123 leader_election.cc:336] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:12.148479 30126 leader_election.cc:336] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42971: connect: Connection refused (error 111)
I20260709 13:15:12.150223 30126 leader_election.cc:304] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:12.151117  3137 raft_consensus.cc:2749] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:12.152163 30126 leader_election.cc:336] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42971: connect: Connection refused (error 111)
I20260709 13:15:12.152637 30126 leader_election.cc:304] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:12.153826 28250 tablet_server.cc:179] TabletServer@127.27.150.132:0 shutting down...
I20260709 13:15:12.153771  3136 raft_consensus.cc:2749] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:12.157035 30126 leader_election.cc:336] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:12.157512 30126 leader_election.cc:304] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:12.158602  3136 raft_consensus.cc:2749] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:12.168607  3137 raft_consensus.cc:493] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:12.169173  3137 raft_consensus.cc:515] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.171602  3137 leader_election.cc:290] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
W20260709 13:15:12.178594 30123 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:12.180876 30126 leader_election.cc:336] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:12.181427 30126 leader_election.cc:304] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:12.182283  3137 raft_consensus.cc:2749] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:12.226766  3136 raft_consensus.cc:493] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ffbae1cdd164f7181ae5fbf7ecf65d6)
I20260709 13:15:12.227541  3136 raft_consensus.cc:515] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.230602  3136 leader_election.cc:290] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713)
I20260709 13:15:12.232198 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:12.233372 28250 tablet_replica.cc:333] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.234906 28250 raft_consensus.cc:2243] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.235999 28250 raft_consensus.cc:2272] T 48cbba4289f149fa85b4f656897b6390 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:12.235478 30123 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
W20260709 13:15:12.237946 30126 leader_election.cc:336] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:12.238339 30126 leader_election.cc:304] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7ffbae1cdd164f7181ae5fbf7ecf65d6, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:12.239065  3136 raft_consensus.cc:2749] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:12.240669 28250 tablet_replica.cc:333] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.241988 28250 raft_consensus.cc:2243] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.243297 28250 raft_consensus.cc:2272] T 29153e3fc529491aa91c830a4456d35a P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.247321 28250 tablet_replica.cc:333] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.248451 28250 raft_consensus.cc:2243] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.249387 28250 raft_consensus.cc:2272] T 930d24af7f0e45c19e80e2efaab717d7 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.253243 28250 tablet_replica.cc:333] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.254267 28250 raft_consensus.cc:2243] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.255703 28250 raft_consensus.cc:2272] T 5afd3c3bb2df4807a6bdcea59110dee6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.256366  3136 raft_consensus.cc:493] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:12.256944  3136 raft_consensus.cc:515] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.258555  3137 raft_consensus.cc:493] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.259527  3136 leader_election.cc:290] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:12.259296  3137 raft_consensus.cc:515] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.262084  3137 leader_election.cc:290] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:12.259891 28250 tablet_replica.cc:333] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.264482 28250 raft_consensus.cc:2243] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.265547 28250 raft_consensus.cc:2272] T 77e08f37d90645918ef0bee732dd4b98 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:12.267997 30123 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:12.269598 28250 tablet_replica.cc:333] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
W20260709 13:15:12.269793 30126 leader_election.cc:336] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42971: connect: Connection refused (error 111)
I20260709 13:15:12.270303 30126 leader_election.cc:304] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
W20260709 13:15:12.270582 30123 consensus_peers.cc:597] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:15:12.270911 28250 raft_consensus.cc:2243] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.271122  3137 raft_consensus.cc:2749] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:12.272203 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42971: connect: Connection refused (error 111)
I20260709 13:15:12.272487 28250 raft_consensus.cc:2272] T d01483a998944f4386fc5dfa1f0fd51a P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:12.272918 30126 leader_election.cc:336] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
I20260709 13:15:12.273358 30126 leader_election.cc:304] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:12.274116  3137 raft_consensus.cc:2749] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:12.276324 28250 tablet_replica.cc:333] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.277312 28250 raft_consensus.cc:2243] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.278544 28250 raft_consensus.cc:2272] T 495c8d0b86f84e95b022820009da4795 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.281656 28250 tablet_replica.cc:333] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.282315 28250 raft_consensus.cc:2243] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.283278 28250 raft_consensus.cc:2272] T cbc3743d348b41f48617d0cb35c85353 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.285868 28250 tablet_replica.cc:333] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.286573 28250 raft_consensus.cc:2243] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.287671 28250 raft_consensus.cc:2272] T 38fdcb033993416ca10b3d79544c9d59 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.290968 28250 tablet_replica.cc:333] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.291958 28250 raft_consensus.cc:2243] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.293228 28250 raft_consensus.cc:2272] T 8b624c2ca9f340c787fc611feea71f37 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.296644 28250 tablet_replica.cc:333] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.297600 28250 raft_consensus.cc:2243] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.298985 28250 pending_rounds.cc:70] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Trying to abort 1 pending ops.
I20260709 13:15:12.299239 28250 pending_rounds.cc:77] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7: Aborting op as it isn't in flight: id { term: 8 index: 9 } timestamp: 7305637522289950720 op_type: NO_OP noop_request { }
I20260709 13:15:12.299606 28250 raft_consensus.cc:2889] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:12.300062  3102 raft_consensus.cc:493] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:12.300060 28250 raft_consensus.cc:2272] T 07f0ebecfce24837b2bbdbea5b0b6b8f P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.300714  3102 raft_consensus.cc:515] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "88760af579b54a6393c6251aa3c6b870" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 42027 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.303435  3102 leader_election.cc:290] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:12.305408 28250 tablet_replica.cc:333] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.306365 28250 raft_consensus.cc:2243] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.307852 28250 raft_consensus.cc:2272] T 225e23ac0b4c490cb213c4d4945ec334 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:12.310747 30126 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42971: connect: Connection refused (error 111)
I20260709 13:15:12.311383 28250 tablet_replica.cc:333] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.312196 28250 raft_consensus.cc:2243] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:12.312300 30123 leader_election.cc:336] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:12.312901 28250 raft_consensus.cc:2272] T 3e8fc42a067a41aa89e5d120919426e3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.312829 30123 leader_election.cc:304] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 88760af579b54a6393c6251aa3c6b870
I20260709 13:15:12.313946  3102 raft_consensus.cc:2749] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:12.316299 28250 tablet_replica.cc:333] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.316998 28250 raft_consensus.cc:2243] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.318101 28250 raft_consensus.cc:2272] T a6194a4e996b4050bfb519664b72df1c P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.320412 28250 tablet_replica.cc:333] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.321105 28250 raft_consensus.cc:2243] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.322105 28250 raft_consensus.cc:2272] T 184cb00180cf42c7b6803577c868b1dd P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.324950 28250 tablet_replica.cc:333] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.325562 28250 raft_consensus.cc:2243] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.326730 28250 raft_consensus.cc:2272] T 57af445de910412cb7903ef2bf682013 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.328264  3102 raft_consensus.cc:493] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:12.328902  3102 raft_consensus.cc:515] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.329468 28250 tablet_replica.cc:333] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.330289 28250 raft_consensus.cc:2243] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.331516 28250 raft_consensus.cc:2272] T 5c7e9523dd804c659b1f0d34ac3eefb3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.331606  3102 leader_election.cc:290] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:12.336284 28250 tablet_replica.cc:333] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.337188 28250 raft_consensus.cc:2243] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:15:12.337366 30126 leader_election.cc:336] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
W20260709 13:15:12.338017 30126 leader_election.cc:336] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42971: connect: Connection refused (error 111)
I20260709 13:15:12.338496 28250 raft_consensus.cc:2272] T 8ad87ed6ec2e4df0b1a1f4bde07cb53e P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.338406 30126 leader_election.cc:304] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:12.339334  3102 raft_consensus.cc:2749] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:12.341588 28250 tablet_replica.cc:333] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.342483 28250 raft_consensus.cc:2243] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.343533 28250 raft_consensus.cc:2272] T 0585fb6756aa496392b1ee0371aa9804 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.346170 28250 tablet_replica.cc:333] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.346805 28250 raft_consensus.cc:2243] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.347400 28250 raft_consensus.cc:2272] T 5bfd9651b2124a8580054a3a43fff99d P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.349732 28250 tablet_replica.cc:333] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.350306 28250 raft_consensus.cc:2243] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.351433 28250 pending_rounds.cc:70] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Trying to abort 1 pending ops.
I20260709 13:15:12.351665 28250 pending_rounds.cc:77] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7: Aborting op as it isn't in flight: id { term: 15 index: 14 } timestamp: 7305637522607390720 op_type: NO_OP noop_request { }
I20260709 13:15:12.351985 28250 raft_consensus.cc:2889] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:12.352301 28250 raft_consensus.cc:2272] T bc1ed542cbc3498ba13b3fe1f50b5d22 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.354748 28250 tablet_replica.cc:333] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.355518 28250 raft_consensus.cc:2243] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.356834 28250 raft_consensus.cc:2272] T 268b94ce95ed4e5abc8be97084461e57 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.360020 28250 tablet_replica.cc:333] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.360961 28250 raft_consensus.cc:2243] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.362309 28250 raft_consensus.cc:2272] T 1016126be7f841c4acc0cd897e5df0c3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:12.362775 30123 consensus_peers.cc:597] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 -> Peer 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): Couldn't send request to peer 88760af579b54a6393c6251aa3c6b870. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:12.365283 28250 tablet_replica.cc:333] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.366014 28250 raft_consensus.cc:2243] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.367030 28250 raft_consensus.cc:2272] T 36373f233812459591c31993a4959894 P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.369498 28250 tablet_replica.cc:333] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.370124 28250 raft_consensus.cc:2243] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.371147 28250 raft_consensus.cc:2272] T 5d3e26705f6f42428e0c9830d7dbedb6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.373296 28250 tablet_replica.cc:333] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.374020 28250 raft_consensus.cc:2243] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.375142 28250 raft_consensus.cc:2272] T 2d6296aca66540dc81b696ae74a6fd42 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.378367 28250 tablet_replica.cc:333] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.379165 28250 raft_consensus.cc:2243] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.380105 28250 raft_consensus.cc:2272] T 02ea2318003a42fea9088b490db583f1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.382982 28250 tablet_replica.cc:333] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.383169  3102 raft_consensus.cc:493] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c2e8d3e55c649e2b3acedef25d81e16)
I20260709 13:15:12.383679 28250 raft_consensus.cc:2243] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.383790  3102 raft_consensus.cc:515] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ffbae1cdd164f7181ae5fbf7ecf65d6" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39713 } } peers { permanent_uuid: "7c2e8d3e55c649e2b3acedef25d81e16" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42971 } } peers { permanent_uuid: "c65265f20d7e42b6bfe314c5d109bdf7" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 38609 } attrs { promote: false } }
I20260709 13:15:12.384769 28250 raft_consensus.cc:2272] T d03f148e37fd4109805d1d7b3b02b2fd P c65265f20d7e42b6bfe314c5d109bdf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.386570  3102 leader_election.cc:290] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713), 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971)
I20260709 13:15:12.388219 28250 tablet_replica.cc:333] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.389127 28250 raft_consensus.cc:2243] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.390543 28250 raft_consensus.cc:2272] T cb7c51305cb0421f843fcf7f543b7163 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:12.391849 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ffbae1cdd164f7181ae5fbf7ecf65d6 (127.27.150.130:39713): Network error: Client connection negotiation failed: client connection to 127.27.150.130:39713: connect: Connection refused (error 111)
W20260709 13:15:12.392544 30126 leader_election.cc:336] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7c2e8d3e55c649e2b3acedef25d81e16 (127.27.150.131:42971): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42971: connect: Connection refused (error 111)
I20260709 13:15:12.392944 30126 leader_election.cc:304] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65265f20d7e42b6bfe314c5d109bdf7; no voters: 7c2e8d3e55c649e2b3acedef25d81e16, 7ffbae1cdd164f7181ae5fbf7ecf65d6
I20260709 13:15:12.393222 28250 tablet_replica.cc:333] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.393666  3102 raft_consensus.cc:2749] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:12.394260 28250 raft_consensus.cc:2243] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.395309 28250 raft_consensus.cc:2272] T 133108182cae493ab908290bfa9179d1 P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.398073 28250 tablet_replica.cc:333] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.398729 28250 raft_consensus.cc:2243] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.399297 28250 raft_consensus.cc:2272] T 2992ae50b9804afb8a7cfe63feb5bf34 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.401516 28250 tablet_replica.cc:333] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.402132 28250 raft_consensus.cc:2243] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.402736 28250 raft_consensus.cc:2272] T 91c368d56c234a6ea4e13263c724dbda P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.405126 28250 tablet_replica.cc:333] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.405731 28250 raft_consensus.cc:2243] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.406243 28250 raft_consensus.cc:2272] T 22f2621d025741fcb1f7e73ad1af2f4f P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.408810 28250 tablet_replica.cc:333] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.409377 28250 raft_consensus.cc:2243] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.410353 28250 raft_consensus.cc:2272] T 6a79c5f3852446bd956bcf002f2bd78c P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.412672 28250 tablet_replica.cc:333] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.413228 28250 raft_consensus.cc:2243] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.414227 28250 raft_consensus.cc:2272] T 59bfc5123acd4083b0f36af624300133 P c65265f20d7e42b6bfe314c5d109bdf7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.416586 28250 tablet_replica.cc:333] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.417199 28250 raft_consensus.cc:2243] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.418092 28250 raft_consensus.cc:2272] T 9f9e543a8422407185dcc0cc54131e92 P c65265f20d7e42b6bfe314c5d109bdf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.420982 28250 tablet_replica.cc:333] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.421518 28250 raft_consensus.cc:2243] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.422521 28250 raft_consensus.cc:2272] T 71fb5043e48f4e1a86ec8d962d18b0b4 P c65265f20d7e42b6bfe314c5d109bdf7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.424888 28250 tablet_replica.cc:333] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.425473 28250 raft_consensus.cc:2243] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.426884 28250 raft_consensus.cc:2272] T 0648129226444c81aef501f2bf17e434 P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.429113 28250 tablet_replica.cc:333] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.429673 28250 raft_consensus.cc:2243] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.430168 28250 raft_consensus.cc:2272] T 6c21d46fd7a440b09555995fc5c75ad3 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.432389 28250 tablet_replica.cc:333] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.432890 28250 raft_consensus.cc:2243] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.433950 28250 raft_consensus.cc:2272] T c40cc430e0bf4a5f946bc53291d0b771 P c65265f20d7e42b6bfe314c5d109bdf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.436399 28250 tablet_replica.cc:333] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.436988 28250 raft_consensus.cc:2243] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.437873 28250 raft_consensus.cc:2272] T 61f7f02fdc8243cd8806a09e7908831e P c65265f20d7e42b6bfe314c5d109bdf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.440646 28250 tablet_replica.cc:333] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.441167 28250 raft_consensus.cc:2243] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.441944 28250 raft_consensus.cc:2272] T 3890858f888845ec958c83aa9b1ccf5d P c65265f20d7e42b6bfe314c5d109bdf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.444096 28250 tablet_replica.cc:333] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.444624 28250 raft_consensus.cc:2243] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.445158 28250 raft_consensus.cc:2272] T cf141daac9d14f459ccbaeee8764a9e6 P c65265f20d7e42b6bfe314c5d109bdf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.447238 28250 tablet_replica.cc:333] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7: stopping tablet replica
I20260709 13:15:12.447729 28250 raft_consensus.cc:2243] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:12.448769 28250 raft_consensus.cc:2272] T 5c1e2c054c694186bc648342e40f4d3b P c65265f20d7e42b6bfe314c5d109bdf7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.835485 28250 tablet_server.cc:196] TabletServer@127.27.150.132:0 shutdown complete.
I20260709 13:15:12.951150 28250 master.cc:562] Master@127.27.150.190:35447 shutting down...
W20260709 13:15:13.007090 29343 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:15:13.007527 29343 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:15:13.007777 29343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:15:22.260655 29279 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111) [suppressed 302 similar messages]
W20260709 13:15:22.265137 29279 catalog_manager.cc:4755] TS 88760af579b54a6393c6251aa3c6b870 (127.27.150.129:42027): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 02ea2318003a42fea9088b490db583f1: Network error: Client connection negotiation failed: client connection to 127.27.150.129:42027: connect: Connection refused (error 111)
I20260709 13:15:23.912437 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:23.914402 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:23.914995 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P 41140e47adf040c7a76a599e7698358d: stopping tablet replica
I20260709 13:15:24.131181 28250 master.cc:584] Master@127.27.150.190:35447 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (229179 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:15:24.274170 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:35321
I20260709 13:15:24.275663 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:24.283026  3143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.283468  3142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.284289  3145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:24.285466 28250 server_base.cc:1061] running on GCE node
I20260709 13:15:24.289654 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:24.289880 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:24.290091 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602924290054 us; error 0 us; skew 500 ppm
I20260709 13:15:24.291301 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:24.294186 28250 webserver.cc:533] Webserver started at http://127.27.150.190:38251/ using document root <none> and password file <none>
I20260709 13:15:24.294802 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:24.295015 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:24.295356 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:24.296916 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "852795779ba14b01b0367d0ab7581152"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.302284 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:24.306579  3150 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.307394 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:24.307744 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "852795779ba14b01b0367d0ab7581152"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.308096 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:24.322984 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:24.324573 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:24.372690 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:35321
I20260709 13:15:24.372803  3201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:35321 every 8 connection(s)
I20260709 13:15:24.377803  3202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.392441  3202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152: Bootstrap starting.
I20260709 13:15:24.398877  3202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.404335  3202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152: No bootstrap required, opened a new log
I20260709 13:15:24.407181  3202 raft_consensus.cc:359] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852795779ba14b01b0367d0ab7581152" member_type: VOTER }
I20260709 13:15:24.407709  3202 raft_consensus.cc:385] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.407994  3202 raft_consensus.cc:740] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 852795779ba14b01b0367d0ab7581152, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.408679  3202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852795779ba14b01b0367d0ab7581152" member_type: VOTER }
I20260709 13:15:24.409185  3202 raft_consensus.cc:399] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:24.409458  3202 raft_consensus.cc:493] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:24.409830  3202 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.415877  3202 raft_consensus.cc:515] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852795779ba14b01b0367d0ab7581152" member_type: VOTER }
I20260709 13:15:24.416468  3202 leader_election.cc:304] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 852795779ba14b01b0367d0ab7581152; no voters: 
I20260709 13:15:24.417788  3202 leader_election.cc:290] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:24.418329  3205 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:24.420032  3205 raft_consensus.cc:697] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 1 LEADER]: Becoming Leader. State: Replica: 852795779ba14b01b0367d0ab7581152, State: Running, Role: LEADER
I20260709 13:15:24.420823  3205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852795779ba14b01b0367d0ab7581152" member_type: VOTER }
I20260709 13:15:24.421325  3202 sys_catalog.cc:565] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:24.427994  3206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "852795779ba14b01b0367d0ab7581152" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852795779ba14b01b0367d0ab7581152" member_type: VOTER } }
I20260709 13:15:24.428592  3206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:24.430301  3207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 852795779ba14b01b0367d0ab7581152. Latest consensus state: current_term: 1 leader_uuid: "852795779ba14b01b0367d0ab7581152" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852795779ba14b01b0367d0ab7581152" member_type: VOTER } }
I20260709 13:15:24.431113  3212 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:24.431106  3207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:24.437420  3212 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:24.440665 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:24.448382  3212 catalog_manager.cc:1383] Generated new cluster ID: 92811aad6de145508264d2b45f1794d6
I20260709 13:15:24.448669  3212 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:24.464327  3212 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:24.465909  3212 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:24.478533  3212 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152: Generated new TSK 0
I20260709 13:15:24.479171  3212 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:24.507699 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:24.515322  3223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.516386  3224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.518424  3226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:24.519886 28250 server_base.cc:1061] running on GCE node
I20260709 13:15:24.523576 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:24.523778 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:24.523918 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602924523906 us; error 0 us; skew 500 ppm
I20260709 13:15:24.524477 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:24.527042 28250 webserver.cc:533] Webserver started at http://127.27.150.129:45375/ using document root <none> and password file <none>
I20260709 13:15:24.527525 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:24.527693 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:24.527941 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:24.529300 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "9f99770bc87e426a893fc425299485cc"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.534554 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:15:24.538101  3231 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.539136 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:24.539528 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "9f99770bc87e426a893fc425299485cc"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.539958 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:24.558959 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:24.560262 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:24.561924 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:24.564641 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:24.564821 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.565145 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:24.565303 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.616586 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:40641
I20260709 13:15:24.616719  3293 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:40641 every 8 connection(s)
I20260709 13:15:24.622649 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:24.632856  3298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.633436  3299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.636970  3301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:24.638763 28250 server_base.cc:1061] running on GCE node
I20260709 13:15:24.642343 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:24.642668 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:24.642900 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602924642874 us; error 0 us; skew 500 ppm
I20260709 13:15:24.643607 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:24.645956  3294 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35321
I20260709 13:15:24.646417  3294 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:24.646924 28250 webserver.cc:533] Webserver started at http://127.27.150.130:45391/ using document root <none> and password file <none>
I20260709 13:15:24.647533 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:24.647471  3294 heartbeater.cc:507] Master 127.27.150.190:35321 requested a full tablet report, sending...
I20260709 13:15:24.647958 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:24.648329 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:24.650362 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "2fbbf37a29b6416eb787ce4c9238e743"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.650498  3167 ts_manager.cc:194] Registered new tserver with Master: 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:24.653551  3167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56456
I20260709 13:15:24.657327 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:24.661545  3306 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.662395 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:15:24.662766 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "2fbbf37a29b6416eb787ce4c9238e743"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.663069 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:24.680441 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:24.681843 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:24.683596 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:24.686594 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:24.686890 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.687214 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:24.687461 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.743436 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:38607
I20260709 13:15:24.743575  3368 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:38607 every 8 connection(s)
I20260709 13:15:24.749488 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:24.758709  3372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.759725  3373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:24.762419 28250 server_base.cc:1061] running on GCE node
W20260709 13:15:24.763520  3376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:24.764518  3369 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35321
I20260709 13:15:24.764780 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:24.765095  3369 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:24.766160  3369 heartbeater.cc:507] Master 127.27.150.190:35321 requested a full tablet report, sending...
W20260709 13:15:24.765127 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:24.766559 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602924766534 us; error 0 us; skew 500 ppm
I20260709 13:15:24.767216 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:24.768637  3167 ts_manager.cc:194] Registered new tserver with Master: 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:24.770017 28250 webserver.cc:533] Webserver started at http://127.27.150.131:38649/ using document root <none> and password file <none>
I20260709 13:15:24.770574  3167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56460
I20260709 13:15:24.770651 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:24.771077 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:24.771380 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:24.773213 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "680bff02deaf497e885eb83e37cca726"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.778187 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.005s
I20260709 13:15:24.782053  3380 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.782987 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:24.783290 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "680bff02deaf497e885eb83e37cca726"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.783567 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:24.811573 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:24.813000 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:24.814600 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:24.817128 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:24.817307 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.817617 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:24.817780 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.869530 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:42471
I20260709 13:15:24.869668  3442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:42471 every 8 connection(s)
I20260709 13:15:24.875555 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:24.885807  3447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.885831  3446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.890595  3449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:24.891682  3443 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35321
I20260709 13:15:24.892189  3443 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:24.892891 28250 server_base.cc:1061] running on GCE node
I20260709 13:15:24.893378  3443 heartbeater.cc:507] Master 127.27.150.190:35321 requested a full tablet report, sending...
I20260709 13:15:24.894057 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:24.894332 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:24.894593 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602924894562 us; error 0 us; skew 500 ppm
I20260709 13:15:24.895417 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:24.895882  3167 ts_manager.cc:194] Registered new tserver with Master: 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:24.897632  3167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56466
I20260709 13:15:24.898203 28250 webserver.cc:533] Webserver started at http://127.27.150.132:42655/ using document root <none> and password file <none>
I20260709 13:15:24.898964 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:24.899204 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:24.899499 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:24.900758 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-3-root/instance:
uuid: "6861cafc7c054539ab0c01ec4986d417"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.905514 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:24.909060  3454 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.910073 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:15:24.910375 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-3-root
uuid: "6861cafc7c054539ab0c01ec4986d417"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:24.910737 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:24.924610 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:24.926054 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:24.927819 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:24.930028 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:24.930260 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.930554 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:24.930825 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:24.982334 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.132:33967
I20260709 13:15:24.982543  3516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.132:33967 every 8 connection(s)
I20260709 13:15:24.999115  3517 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35321
I20260709 13:15:24.999616  3517 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:25.000411  3517 heartbeater.cc:507] Master 127.27.150.190:35321 requested a full tablet report, sending...
I20260709 13:15:25.002565  3167 ts_manager.cc:194] Registered new tserver with Master: 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:25.002686 28250 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016533267s
I20260709 13:15:25.004194  3167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56478
I20260709 13:15:25.034926  3167 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56494:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:15:25.312405  3479 tablet_service.cc:1511] Processing CreateTablet for tablet 56b367f1f6e54c6cb98054e8c63ba9da (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:25.312911  3481 tablet_service.cc:1511] Processing CreateTablet for tablet 87d9b8357182495897ba580d2a2949a3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:25.315409  3480 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee33bfcb9bb41ab90d52e8af1e38459 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:25.315732  3478 tablet_service.cc:1511] Processing CreateTablet for tablet 20da3e12c2504daa9c5864745baaa5fd (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:25.314265  3479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b367f1f6e54c6cb98054e8c63ba9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.317097  3480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee33bfcb9bb41ab90d52e8af1e38459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.318642  3477 tablet_service.cc:1511] Processing CreateTablet for tablet 2760edcad0614547b67102f65f6369fc (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:25.320289  3477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2760edcad0614547b67102f65f6369fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.319985  3482 tablet_service.cc:1511] Processing CreateTablet for tablet 40f35a48457c46878dc583515c065166 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:25.321595  3482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f35a48457c46878dc583515c065166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.322949  3478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20da3e12c2504daa9c5864745baaa5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.324774  3481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d9b8357182495897ba580d2a2949a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.327889  3476 tablet_service.cc:1511] Processing CreateTablet for tablet 9232f678266f497c8f5aa9b1c3334fd5 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:25.329491  3476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9232f678266f497c8f5aa9b1c3334fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.335942  3475 tablet_service.cc:1511] Processing CreateTablet for tablet 68a79b63b8204a21b06b365598657efb (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:25.337486  3475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a79b63b8204a21b06b365598657efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.339757  3474 tablet_service.cc:1511] Processing CreateTablet for tablet cac7eee9d52843488adb542293814e1e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:25.341288  3474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac7eee9d52843488adb542293814e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.348078  3473 tablet_service.cc:1511] Processing CreateTablet for tablet 856fc57094a04df1b76480bda9d496b4 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:25.350056  3473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856fc57094a04df1b76480bda9d496b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.391191  3537 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:25.403153  3479 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca8466f1d64370b2f629ed81d829b5 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:25.417378  3479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca8466f1d64370b2f629ed81d829b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.426383  3478 tablet_service.cc:1511] Processing CreateTablet for tablet 306de156a5b14b259e6a51aafedf1579 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:25.454679  3250 tablet_service.cc:1511] Processing CreateTablet for tablet 837d91f3e7d644c7913db4af9e912b7e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:25.430322  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 54eaf73806dc46cab15ec2140b557881 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:25.456060  3325 tablet_service.cc:1511] Processing CreateTablet for tablet 837d91f3e7d644c7913db4af9e912b7e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:25.454114  3326 tablet_service.cc:1511] Processing CreateTablet for tablet cac7eee9d52843488adb542293814e1e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:25.458420  3401 tablet_service.cc:1511] Processing CreateTablet for tablet 68a79b63b8204a21b06b365598657efb (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:25.464591  3401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a79b63b8204a21b06b365598657efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.438735  3329 tablet_service.cc:1511] Processing CreateTablet for tablet 2760edcad0614547b67102f65f6369fc (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:25.439121  3333 tablet_service.cc:1511] Processing CreateTablet for tablet 54eaf73806dc46cab15ec2140b557881 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:25.439399  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee33bfcb9bb41ab90d52e8af1e38459 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:25.440397  3332 tablet_service.cc:1511] Processing CreateTablet for tablet 87d9b8357182495897ba580d2a2949a3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:25.441722  3408 tablet_service.cc:1511] Processing CreateTablet for tablet 40f35a48457c46878dc583515c065166 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:25.442013  3256 tablet_service.cc:1511] Processing CreateTablet for tablet dcd4ae37bd2d49a0b6b94c695fdff604 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:25.472891  3408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f35a48457c46878dc583515c065166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.443078  3331 tablet_service.cc:1511] Processing CreateTablet for tablet dcd4ae37bd2d49a0b6b94c695fdff604 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
W20260709 13:15:25.437265  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:25.444263  3255 tablet_service.cc:1511] Processing CreateTablet for tablet 56b367f1f6e54c6cb98054e8c63ba9da (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:25.447163  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 44b0080a141145e687e0d361ecf150d3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:25.446180  3407 tablet_service.cc:1511] Processing CreateTablet for tablet 54eaf73806dc46cab15ec2140b557881 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:25.447485  3406 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee33bfcb9bb41ab90d52e8af1e38459 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:25.477417  3407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54eaf73806dc46cab15ec2140b557881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.478185  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee33bfcb9bb41ab90d52e8af1e38459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.448832  3405 tablet_service.cc:1511] Processing CreateTablet for tablet dcd4ae37bd2d49a0b6b94c695fdff604 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:25.479996  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd4ae37bd2d49a0b6b94c695fdff604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.449193  3327 tablet_service.cc:1511] Processing CreateTablet for tablet 9232f678266f497c8f5aa9b1c3334fd5 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:25.450183  3404 tablet_service.cc:1511] Processing CreateTablet for tablet 20da3e12c2504daa9c5864745baaa5fd (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:25.485289  3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20da3e12c2504daa9c5864745baaa5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.450678  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 9232f678266f497c8f5aa9b1c3334fd5 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:25.451486  3403 tablet_service.cc:1511] Processing CreateTablet for tablet 2760edcad0614547b67102f65f6369fc (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:25.434022  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 87d9b8357182495897ba580d2a2949a3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:25.458534  3478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306de156a5b14b259e6a51aafedf1579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.458539  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54eaf73806dc46cab15ec2140b557881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.489581  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2760edcad0614547b67102f65f6369fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.490878  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9232f678266f497c8f5aa9b1c3334fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.492668  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d9b8357182495897ba580d2a2949a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.459662  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837d91f3e7d644c7913db4af9e912b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.493911  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee33bfcb9bb41ab90d52e8af1e38459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.498823  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9232f678266f497c8f5aa9b1c3334fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.502804  3333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54eaf73806dc46cab15ec2140b557881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.427160  3473 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9a21fadcd94d04b664457da232b137 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:25.506803  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2760edcad0614547b67102f65f6369fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.510736  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d9b8357182495897ba580d2a2949a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.512707  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837d91f3e7d644c7913db4af9e912b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.460137  3400 tablet_service.cc:1511] Processing CreateTablet for tablet cac7eee9d52843488adb542293814e1e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:25.515954  3400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac7eee9d52843488adb542293814e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.518751  3473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9a21fadcd94d04b664457da232b137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.461709  3399 tablet_service.cc:1511] Processing CreateTablet for tablet 837d91f3e7d644c7913db4af9e912b7e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:25.520145  3399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837d91f3e7d644c7913db4af9e912b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.446761  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 20da3e12c2504daa9c5864745baaa5fd (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:25.523991  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20da3e12c2504daa9c5864745baaa5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.445751  3334 tablet_service.cc:1511] Processing CreateTablet for tablet 40f35a48457c46878dc583515c065166 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:25.452821  3402 tablet_service.cc:1511] Processing CreateTablet for tablet 44b0080a141145e687e0d361ecf150d3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:25.531765  3402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b0080a141145e687e0d361ecf150d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.452701  3251 tablet_service.cc:1511] Processing CreateTablet for tablet 68a79b63b8204a21b06b365598657efb (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:25.532635  3480 tablet_service.cc:1511] Processing CreateTablet for tablet ca9f3f51f57b4c42b5063ccb7f51ccda (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:25.444396  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 56b367f1f6e54c6cb98054e8c63ba9da (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:25.534039  3480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9f3f51f57b4c42b5063ccb7f51ccda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.448644  3253 tablet_service.cc:1511] Processing CreateTablet for tablet 44b0080a141145e687e0d361ecf150d3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:25.535423  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd4ae37bd2d49a0b6b94c695fdff604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.536221  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b367f1f6e54c6cb98054e8c63ba9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.536706  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd4ae37bd2d49a0b6b94c695fdff604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.538836  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac7eee9d52843488adb542293814e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.540079  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b0080a141145e687e0d361ecf150d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.542896  3334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f35a48457c46878dc583515c065166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.546809  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a79b63b8204a21b06b365598657efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.550345  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b367f1f6e54c6cb98054e8c63ba9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.554852  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b0080a141145e687e0d361ecf150d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.593000  3479 tablet_service.cc:1511] Processing CreateTablet for tablet 42f3659596894d8b8dc2937c11c2a8cb (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:25.597138  3478 tablet_service.cc:1511] Processing CreateTablet for tablet bad4a106ba3345e0abae4ec0677ecda1 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:25.612435  3477 tablet_service.cc:1511] Processing CreateTablet for tablet f7a27de7996546fa9774914ac585e53e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:25.615639  3474 tablet_service.cc:1511] Processing CreateTablet for tablet d1a51029dec74d1dbbf9385234e5cc62 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:25.616395  3475 tablet_service.cc:1511] Processing CreateTablet for tablet cd9e6e9c0bbf4380ac17aff9aafbbce0 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:25.635108  3478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad4a106ba3345e0abae4ec0677ecda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.638919  3474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a51029dec74d1dbbf9385234e5cc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.641247  3475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9e6e9c0bbf4380ac17aff9aafbbce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.646787  3477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a27de7996546fa9774914ac585e53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.657128  3294 heartbeater.cc:499] Master 127.27.150.190:35321 was elected leader, sending a full tablet report...
I20260709 13:15:25.660638  3537 tablet_bootstrap.cc:654] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.660392  3482 tablet_service.cc:1511] Processing CreateTablet for tablet 420c35c37a4c43428d913178a4e45696 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:25.661922  3482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420c35c37a4c43428d913178a4e45696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.671087  3481 tablet_service.cc:1511] Processing CreateTablet for tablet dba85e8b48b84b388c287165e85c21e3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:25.672534  3481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba85e8b48b84b388c287165e85c21e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.684098  3538 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:25.689188  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 856fc57094a04df1b76480bda9d496b4 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:25.690201  3473 tablet_service.cc:1511] Processing CreateTablet for tablet eee6f15e95d8479d8bf471ffeb68cdae (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:25.705598  3475 tablet_service.cc:1511] Processing CreateTablet for tablet e03783871be14ed0a80c20c2be3e1b73 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:25.728374  3254 tablet_service.cc:1511] Processing CreateTablet for tablet ca9f3f51f57b4c42b5063ccb7f51ccda (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:25.706873  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856fc57094a04df1b76480bda9d496b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.720333  3479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f3659596894d8b8dc2937c11c2a8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.729839  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9f3f51f57b4c42b5063ccb7f51ccda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.730584  3475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03783871be14ed0a80c20c2be3e1b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.736652  3538 tablet_bootstrap.cc:654] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.727818  3250 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9a21fadcd94d04b664457da232b137 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:25.733937  3406 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca8466f1d64370b2f629ed81d829b5 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:25.737831  3473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee6f15e95d8479d8bf471ffeb68cdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.738770  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca8466f1d64370b2f629ed81d829b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.739207  3399 tablet_service.cc:1511] Processing CreateTablet for tablet 306de156a5b14b259e6a51aafedf1579 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:25.740662  3399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306de156a5b14b259e6a51aafedf1579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.737843  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9a21fadcd94d04b664457da232b137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.746029  3333 tablet_service.cc:1511] Processing CreateTablet for tablet 856fc57094a04df1b76480bda9d496b4 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:25.747442  3333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856fc57094a04df1b76480bda9d496b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.753367  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca8466f1d64370b2f629ed81d829b5 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:25.754683  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca8466f1d64370b2f629ed81d829b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.759586  3539 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:25.767330  3476 tablet_service.cc:1511] Processing CreateTablet for tablet b15c7b44e85542b696746192c0ff0d5b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:25.779084  3476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15c7b44e85542b696746192c0ff0d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.783458  3405 tablet_service.cc:1511] Processing CreateTablet for tablet f240b1bc43564ebb9629430509c691e1 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:25.784880  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f240b1bc43564ebb9629430509c691e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.804293  3403 tablet_service.cc:1511] Processing CreateTablet for tablet f85294cffe3042d08d67fb88721fc72d (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:25.820809  3477 tablet_service.cc:1511] Processing CreateTablet for tablet cb4281e55873448583428fc3598636a6 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:25.808310  3369 heartbeater.cc:499] Master 127.27.150.190:35321 was elected leader, sending a full tablet report...
I20260709 13:15:25.840435  3252 tablet_service.cc:1511] Processing CreateTablet for tablet f240b1bc43564ebb9629430509c691e1 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:25.842998  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f240b1bc43564ebb9629430509c691e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.847666  3400 tablet_service.cc:1511] Processing CreateTablet for tablet ca9f3f51f57b4c42b5063ccb7f51ccda (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:25.848982  3258 tablet_service.cc:1511] Processing CreateTablet for tablet e57df44e281f46d2844b50c4302bc52c (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:25.850661  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85294cffe3042d08d67fb88721fc72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.853168  3332 tablet_service.cc:1511] Processing CreateTablet for tablet 306de156a5b14b259e6a51aafedf1579 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:25.854667  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306de156a5b14b259e6a51aafedf1579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.856307  3408 tablet_service.cc:1511] Processing CreateTablet for tablet 42f3659596894d8b8dc2937c11c2a8cb (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:25.857218  3477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4281e55873448583428fc3598636a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.857823  3408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f3659596894d8b8dc2937c11c2a8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.714210  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9a21fadcd94d04b664457da232b137 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:25.850308  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57df44e281f46d2844b50c4302bc52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.862610  3325 tablet_service.cc:1511] Processing CreateTablet for tablet 42f3659596894d8b8dc2937c11c2a8cb (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:25.887076  3540 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:25.891335  3407 tablet_service.cc:1511] Processing CreateTablet for tablet f7a27de7996546fa9774914ac585e53e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:25.879455  3400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9f3f51f57b4c42b5063ccb7f51ccda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.894559  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9a21fadcd94d04b664457da232b137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.900635  3443 heartbeater.cc:499] Master 127.27.150.190:35321 was elected leader, sending a full tablet report...
I20260709 13:15:25.908581  3407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a27de7996546fa9774914ac585e53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.911062  3474 tablet_service.cc:1511] Processing CreateTablet for tablet 107adc0bfe66488ca767649516d45327 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:25.862483  3255 tablet_service.cc:1511] Processing CreateTablet for tablet f85294cffe3042d08d67fb88721fc72d (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:25.912868  3474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107adc0bfe66488ca767649516d45327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.913300  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85294cffe3042d08d67fb88721fc72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.913136  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f3659596894d8b8dc2937c11c2a8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.919741  3478 tablet_service.cc:1511] Processing CreateTablet for tablet 521a8d971e3f46fba3f81a2410d8beea (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:25.921244  3478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521a8d971e3f46fba3f81a2410d8beea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.923141  3256 tablet_service.cc:1511] Processing CreateTablet for tablet bad4a106ba3345e0abae4ec0677ecda1 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:25.924918  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad4a106ba3345e0abae4ec0677ecda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.952105  3329 tablet_service.cc:1511] Processing CreateTablet for tablet f240b1bc43564ebb9629430509c691e1 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:25.953814  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f240b1bc43564ebb9629430509c691e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.954658  3540 tablet_bootstrap.cc:654] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.954785  3251 tablet_service.cc:1511] Processing CreateTablet for tablet cd9e6e9c0bbf4380ac17aff9aafbbce0 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:25.955253  3406 tablet_service.cc:1511] Processing CreateTablet for tablet d1a51029dec74d1dbbf9385234e5cc62 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:25.956259  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9e6e9c0bbf4380ac17aff9aafbbce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.956708  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a51029dec74d1dbbf9385234e5cc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.959213  3537 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:25.959736  3537 ts_tablet_manager.cc:1403] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.569s	user 0.034s	sys 0.045s
I20260709 13:15:25.960717  3480 tablet_service.cc:1511] Processing CreateTablet for tablet 9546f93765d34b7baa8dda85faad96ae (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:25.962059  3480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9546f93765d34b7baa8dda85faad96ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.967640  3538 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:25.968209  3538 ts_tablet_manager.cc:1403] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.285s	user 0.020s	sys 0.020s
W20260709 13:15:25.968891  3153 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 47256.2us
I20260709 13:15:25.977381  3253 tablet_service.cc:1511] Processing CreateTablet for tablet f7a27de7996546fa9774914ac585e53e (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:25.970672  3476 tablet_service.cc:1511] Processing CreateTablet for tablet 4742746a7270495f9cdbaef49775d3a8 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:25.986037  3539 tablet_bootstrap.cc:654] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.987191  3327 tablet_service.cc:1511] Processing CreateTablet for tablet f85294cffe3042d08d67fb88721fc72d (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:25.988929  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85294cffe3042d08d67fb88721fc72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.990832  3476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4742746a7270495f9cdbaef49775d3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.974156  3326 tablet_service.cc:1511] Processing CreateTablet for tablet bad4a106ba3345e0abae4ec0677ecda1 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:26.000337  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad4a106ba3345e0abae4ec0677ecda1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.004671  3331 tablet_service.cc:1511] Processing CreateTablet for tablet e57df44e281f46d2844b50c4302bc52c (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:26.006014  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57df44e281f46d2844b50c4302bc52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.007661  3517 heartbeater.cc:499] Master 127.27.150.190:35321 was elected leader, sending a full tablet report...
I20260709 13:15:26.012493  3333 tablet_service.cc:1511] Processing CreateTablet for tablet dba85e8b48b84b388c287165e85c21e3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:26.014001  3333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba85e8b48b84b388c287165e85c21e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.007463  3254 tablet_service.cc:1511] Processing CreateTablet for tablet d553a23383a04c1bb059fbe6980659f0 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:26.020468  3401 tablet_service.cc:1511] Processing CreateTablet for tablet dba85e8b48b84b388c287165e85c21e3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:26.021934  3401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba85e8b48b84b388c287165e85c21e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.023057  3538 raft_consensus.cc:359] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.023910  3538 raft_consensus.cc:385] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.024314  3538 raft_consensus.cc:740] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.025525  3538 consensus_queue.cc:260] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.020627  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 420c35c37a4c43428d913178a4e45696 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:26.033043  3402 tablet_service.cc:1511] Processing CreateTablet for tablet d553a23383a04c1bb059fbe6980659f0 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:26.038945  3402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d553a23383a04c1bb059fbe6980659f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.039601  3537 raft_consensus.cc:359] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:26.040530  3537 raft_consensus.cc:385] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.040855  3537 raft_consensus.cc:740] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
W20260709 13:15:26.047123  3151 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 70194.6us
I20260709 13:15:26.047900  3407 tablet_service.cc:1511] Processing CreateTablet for tablet 420c35c37a4c43428d913178a4e45696 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:26.049347  3407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420c35c37a4c43428d913178a4e45696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.983705  3404 tablet_service.cc:1511] Processing CreateTablet for tablet e57df44e281f46d2844b50c4302bc52c (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:26.050516  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a27de7996546fa9774914ac585e53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.051519  3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57df44e281f46d2844b50c4302bc52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.054776  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d553a23383a04c1bb059fbe6980659f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.055060  3330 tablet_service.cc:1511] Processing CreateTablet for tablet d1a51029dec74d1dbbf9385234e5cc62 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:26.012378  3334 tablet_service.cc:1511] Processing CreateTablet for tablet cd9e6e9c0bbf4380ac17aff9aafbbce0 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:26.056047  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420c35c37a4c43428d913178a4e45696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.056516  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a51029dec74d1dbbf9385234e5cc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.058789  3334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9e6e9c0bbf4380ac17aff9aafbbce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.067028  3403 tablet_service.cc:1511] Processing CreateTablet for tablet e03783871be14ed0a80c20c2be3e1b73 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:26.041941  3537 consensus_queue.cc:260] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:26.068221  3473 tablet_service.cc:1511] Processing CreateTablet for tablet ba4474dd7fb94cf5a48e9737228cd59b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:26.068917  3405 tablet_service.cc:1511] Processing CreateTablet for tablet b15c7b44e85542b696746192c0ff0d5b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:26.070411  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03783871be14ed0a80c20c2be3e1b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.073835  3328 tablet_service.cc:1511] Processing CreateTablet for tablet d553a23383a04c1bb059fbe6980659f0 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:26.099225  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d553a23383a04c1bb059fbe6980659f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.099753  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15c7b44e85542b696746192c0ff0d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.101332  3475 tablet_service.cc:1511] Processing CreateTablet for tablet b17eb79c9e1a4d8f8fa12dc17e6f4b12 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:26.099812  3257 tablet_service.cc:1511] Processing CreateTablet for tablet e03783871be14ed0a80c20c2be3e1b73 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:26.113431  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03783871be14ed0a80c20c2be3e1b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.096702  3479 tablet_service.cc:1511] Processing CreateTablet for tablet e629cf2e72494a84b27f79d2d660c379 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:26.129199  3481 tablet_service.cc:1511] Processing CreateTablet for tablet e1d5ccb77dd0428e957babbce39cf870 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:26.131631  3399 tablet_service.cc:1511] Processing CreateTablet for tablet 107adc0bfe66488ca767649516d45327 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:26.133085  3399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107adc0bfe66488ca767649516d45327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.085860  3473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4474dd7fb94cf5a48e9737228cd59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.154829  3475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17eb79c9e1a4d8f8fa12dc17e6f4b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.158282  3479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e629cf2e72494a84b27f79d2d660c379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.096527  3250 tablet_service.cc:1511] Processing CreateTablet for tablet eee6f15e95d8479d8bf471ffeb68cdae (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:26.163893  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee6f15e95d8479d8bf471ffeb68cdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.177093  3539 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:26.177765  3539 ts_tablet_manager.cc:1403] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.419s	user 0.015s	sys 0.004s
I20260709 13:15:26.181530  3539 raft_consensus.cc:359] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:26.183064  3540 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:26.183689  3540 ts_tablet_manager.cc:1403] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.308s	user 0.007s	sys 0.010s
I20260709 13:15:26.176599  3400 tablet_service.cc:1511] Processing CreateTablet for tablet 132c2352e9b64e8081d3c0d9baabce84 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:26.189409  3482 tablet_service.cc:1511] Processing CreateTablet for tablet 7e8ac5126c3a4c50bf54cabb0135a5ef (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:26.202989  3537 ts_tablet_manager.cc:1434] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.243s	user 0.013s	sys 0.002s
I20260709 13:15:26.182300  3539 raft_consensus.cc:385] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.207974  3539 raft_consensus.cc:740] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.208896  3539 consensus_queue.cc:260] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:26.189834  3477 tablet_service.cc:1511] Processing CreateTablet for tablet 2e470b894b5f4fe6933870e43f2eb8bc (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:26.223263  3537 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:26.225692  3254 tablet_service.cc:1511] Processing CreateTablet for tablet cb4281e55873448583428fc3598636a6 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:26.218255  3481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d5ccb77dd0428e957babbce39cf870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.227290  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4281e55873448583428fc3598636a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.227816  3333 tablet_service.cc:1511] Processing CreateTablet for tablet 132c2352e9b64e8081d3c0d9baabce84 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:26.228820  3327 tablet_service.cc:1511] Processing CreateTablet for tablet cb4281e55873448583428fc3598636a6 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:26.229354  3333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132c2352e9b64e8081d3c0d9baabce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.230252  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4281e55873448583428fc3598636a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.239709  3404 tablet_service.cc:1511] Processing CreateTablet for tablet e69861273e1047ef9f4772769b689e8a (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:26.240816  3332 tablet_service.cc:1511] Processing CreateTablet for tablet b15c7b44e85542b696746192c0ff0d5b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:26.241714  3408 tablet_service.cc:1511] Processing CreateTablet for tablet 4742746a7270495f9cdbaef49775d3a8 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:26.242750  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 132c2352e9b64e8081d3c0d9baabce84 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:26.243566  3406 tablet_service.cc:1511] Processing CreateTablet for tablet 521a8d971e3f46fba3f81a2410d8beea (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:26.218266  3400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132c2352e9b64e8081d3c0d9baabce84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:26.252697  3518 tablet.cc:2406] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:26.253389  3474 tablet_service.cc:1511] Processing CreateTablet for tablet aa6845d090104ffea526fc245bcd9e0d (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:26.258984  3540 raft_consensus.cc:359] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.259848  3540 raft_consensus.cc:385] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.260275  3540 raft_consensus.cc:740] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.261201  3540 consensus_queue.cc:260] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.265995  3478 tablet_service.cc:1511] Processing CreateTablet for tablet f99a38ce9bfc4c8896ba84328639b90b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:26.264348  3482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8ac5126c3a4c50bf54cabb0135a5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.259985  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132c2352e9b64e8081d3c0d9baabce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.278875  3329 tablet_service.cc:1511] Processing CreateTablet for tablet eee6f15e95d8479d8bf471ffeb68cdae (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:26.281371  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 107adc0bfe66488ca767649516d45327 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:26.283097  3475 tablet_service.cc:1511] Processing CreateTablet for tablet 0286901285774174994aca4647f28bd7 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:26.283349  3253 tablet_service.cc:1511] Processing CreateTablet for tablet e69861273e1047ef9f4772769b689e8a (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:26.287192  3402 tablet_service.cc:1511] Processing CreateTablet for tablet ba4474dd7fb94cf5a48e9737228cd59b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:26.288295  3538 ts_tablet_manager.cc:1434] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.320s	user 0.007s	sys 0.014s
I20260709 13:15:26.288952  3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69861273e1047ef9f4772769b689e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.288196  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 9546f93765d34b7baa8dda85faad96ae (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:26.289752  3545 raft_consensus.cc:493] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.287218  3478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99a38ce9bfc4c8896ba84328639b90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.290659  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15c7b44e85542b696746192c0ff0d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.306090  3326 tablet_service.cc:1511] Processing CreateTablet for tablet ba4474dd7fb94cf5a48e9737228cd59b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:26.306460  3545 raft_consensus.cc:515] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:26.307425  3474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6845d090104ffea526fc245bcd9e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.309358  3407 tablet_service.cc:1511] Processing CreateTablet for tablet 85997a2fc7b9454291059d6f4f427187 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:26.310179  3477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e470b894b5f4fe6933870e43f2eb8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.310683  3407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85997a2fc7b9454291059d6f4f427187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.313212  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 9546f93765d34b7baa8dda85faad96ae (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:26.315006  3475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0286901285774174994aca4647f28bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.314529  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107adc0bfe66488ca767649516d45327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.307500  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4474dd7fb94cf5a48e9737228cd59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.239771  3334 tablet_service.cc:1511] Processing CreateTablet for tablet 521a8d971e3f46fba3f81a2410d8beea (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:26.330775  3545 leader_election.cc:290] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:26.331333  3331 tablet_service.cc:1511] Processing CreateTablet for tablet e69861273e1047ef9f4772769b689e8a (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:26.249411  3476 tablet_service.cc:1511] Processing CreateTablet for tablet 3b67a8637f824de9911512eedc03ec43 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:26.334177  3476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b67a8637f824de9911512eedc03ec43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.334697  3408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4742746a7270495f9cdbaef49775d3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.338166  3479 tablet_service.cc:1511] Processing CreateTablet for tablet e4bf210b6f6b4a11a7bfbf815676b433 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:26.360486  3540 ts_tablet_manager.cc:1434] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.176s	user 0.013s	sys 0.007s
I20260709 13:15:26.375584  3251 tablet_service.cc:1511] Processing CreateTablet for tablet 4742746a7270495f9cdbaef49775d3a8 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:26.394956  3549 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.395615  3549 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.396839  3480 tablet_service.cc:1511] Processing CreateTablet for tablet b8adbc138e3a482086d6d658376baa14 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:26.399797  3479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bf210b6f6b4a11a7bfbf815676b433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.411185  3538 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:26.413161  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 85997a2fc7b9454291059d6f4f427187 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:26.380903  3402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4474dd7fb94cf5a48e9737228cd59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.398945  3481 tablet_service.cc:1511] Processing CreateTablet for tablet c143a12f1d074d6abf4f33d880d1c212 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:26.381253  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69861273e1047ef9f4772769b689e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.425613  3255 tablet_service.cc:1511] Processing CreateTablet for tablet e629cf2e72494a84b27f79d2d660c379 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:26.425796  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69861273e1047ef9f4772769b689e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.435504  3549 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:26.436468  3256 tablet_service.cc:1511] Processing CreateTablet for tablet b17eb79c9e1a4d8f8fa12dc17e6f4b12 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:26.447393  3546 raft_consensus.cc:493] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.448012  3546 raft_consensus.cc:515] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.450775  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17eb79c9e1a4d8f8fa12dc17e6f4b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.451985  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9546f93765d34b7baa8dda85faad96ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.443992  3480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8adbc138e3a482086d6d658376baa14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.454876  3540 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:26.457423  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521a8d971e3f46fba3f81a2410d8beea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.470561  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e629cf2e72494a84b27f79d2d660c379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.471542  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85997a2fc7b9454291059d6f4f427187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.462213  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9546f93765d34b7baa8dda85faad96ae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:26.482951  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:26.484516  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4742746a7270495f9cdbaef49775d3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.495157  3334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521a8d971e3f46fba3f81a2410d8beea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.501920  3473 tablet_service.cc:1511] Processing CreateTablet for tablet 62ae694390334d8583cdad82212fb301 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:26.490329  3539 ts_tablet_manager.cc:1434] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.312s	user 0.016s	sys 0.018s
I20260709 13:15:26.457239  3481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c143a12f1d074d6abf4f33d880d1c212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.438172  3325 tablet_service.cc:1511] Processing CreateTablet for tablet 85997a2fc7b9454291059d6f4f427187 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:26.489334  3401 tablet_service.cc:1511] Processing CreateTablet for tablet b17eb79c9e1a4d8f8fa12dc17e6f4b12 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:26.504905  3546 leader_election.cc:290] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:26.542976  3539 tablet_bootstrap.cc:492] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:26.529891  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee6f15e95d8479d8bf471ffeb68cdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.563943  3537 tablet_bootstrap.cc:654] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.572885  3540 tablet_bootstrap.cc:654] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.583866  3330 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 17) took 1108 ms. Trace:
I20260709 13:15:26.590773  3330 rpcz_store.cc:276] 0709 13:15:25.475379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.992439 (+517060us) service_pool.cc:224] Handling call
0709 13:15:26.055963 (+ 63524us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.056096 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.201092 (+144996us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.583200 (+382108us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.583781 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.594970  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85997a2fc7b9454291059d6f4f427187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.608083  3399 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 25) took 1040 ms. Trace:
I20260709 13:15:26.608623  3399 rpcz_store.cc:276] 0709 13:15:25.567536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.130626 (+563090us) service_pool.cc:224] Handling call
0709 13:15:26.132587 (+  1961us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.132695 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.411179 (+278484us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.537848 (+126669us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.607992 (+ 70144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.609352  3405 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 23) took 1057 ms. Trace:
I20260709 13:15:26.609774  3405 rpcz_store.cc:276] 0709 13:15:25.552167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.068004 (+515837us) service_pool.cc:224] Handling call
0709 13:15:26.094828 (+ 26824us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.095014 (+   186us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.375752 (+280738us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.608735 (+232983us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.609282 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.612138  3548 raft_consensus.cc:493] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.612721  3548 raft_consensus.cc:515] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:26.617708  3259 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 26) took 1006 ms. Trace:
I20260709 13:15:26.618286  3259 rpcz_store.cc:276] 0709 13:15:25.610833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.280452 (+669619us) service_pool.cc:224] Handling call
0709 13:15:26.282194 (+  1742us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.282297 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.405869 (+123572us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.616972 (+211103us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.617624 (+   652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.621025  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 41010ff5db384e30a704f7cfd15b5ee4 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:26.630769  3332 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 23) took 1081 ms. Trace:
I20260709 13:15:26.631477  3332 rpcz_store.cc:276] 0709 13:15:25.549848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.216394 (+666546us) service_pool.cc:224] Handling call
0709 13:15:26.271624 (+ 55230us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.290193 (+ 18569us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.379985 (+ 89792us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.630059 (+250074us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.630679 (+   620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.637830  3403 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 22) took 1093 ms. Trace:
I20260709 13:15:26.638403  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:26.630790  3538 tablet_bootstrap.cc:654] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.647233  3539 tablet_bootstrap.cc:654] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.597949  3477 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc0678dd7da4af08ae4454d8b3e9f32 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:26.652186  3540 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:26.663092  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:26.664122  3455 leader_election.cc:343] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.658135  3473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ae694390334d8583cdad82212fb301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.676108  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41010ff5db384e30a704f7cfd15b5ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.671869  3401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17eb79c9e1a4d8f8fa12dc17e6f4b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.658916  3256 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 32) took 1031 ms. Trace:
I20260709 13:15:26.685259  3540 ts_tablet_manager.cc:1403] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.231s	user 0.016s	sys 0.005s
I20260709 13:15:26.679875  3548 leader_election.cc:290] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:26.718844  3332 tablet_service.cc:1511] Processing CreateTablet for tablet e1d5ccb77dd0428e957babbce39cf870 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:26.687254  3254 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 25) took 1092 ms. Trace:
I20260709 13:15:26.727128  3477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc0678dd7da4af08ae4454d8b3e9f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.727615  3330 tablet_service.cc:1511] Processing CreateTablet for tablet e629cf2e72494a84b27f79d2d660c379 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:26.683773  3399 tablet_service.cc:1511] Processing CreateTablet for tablet e1d5ccb77dd0428e957babbce39cf870 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:26.737746  3399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d5ccb77dd0428e957babbce39cf870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.660331  3403 rpcz_store.cc:276] 0709 13:15:25.544597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.065969 (+521372us) service_pool.cc:224] Handling call
0709 13:15:26.069869 (+  3900us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.069980 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.452419 (+382439us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.637295 (+184876us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.637760 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:26.730423  3457 leader_election.cc:343] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.730960  3250 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 22) took 1135 ms. Trace:
I20260709 13:15:26.747977  3457 leader_election.cc:304] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:26.779573  3545 raft_consensus.cc:2749] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.790727  3258 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 24) took 1196 ms. Trace:
I20260709 13:15:26.791715  3251 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 29) took 1180 ms. Trace:
I20260709 13:15:26.792165  3251 rpcz_store.cc:276] 0709 13:15:25.611740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.285933 (+674193us) service_pool.cc:224] Handling call
0709 13:15:26.393218 (+107285us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.393330 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.649395 (+256065us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.790229 (+140834us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.791636 (+  1407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.791339  3258 rpcz_store.cc:276] 0709 13:15:25.593986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.217444 (+623458us) service_pool.cc:224] Handling call
0709 13:15:26.259450 (+ 42006us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.259559 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.580133 (+320574us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.790069 (+209936us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.790651 (+   582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.796773  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d5ccb77dd0428e957babbce39cf870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.732962  3254 rpcz_store.cc:276] 0709 13:15:25.594400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.224497 (+630097us) service_pool.cc:224] Handling call
0709 13:15:26.226753 (+  2256us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.226886 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.298059 (+ 71173us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.686591 (+388532us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.687171 (+   580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.796748  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 2e470b894b5f4fe6933870e43f2eb8bc (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:26.804330  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e470b894b5f4fe6933870e43f2eb8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.806214  3252 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 28) took 1194 ms. Trace:
I20260709 13:15:26.817327  3252 rpcz_store.cc:276] 0709 13:15:25.611461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.285629 (+674168us) service_pool.cc:224] Handling call
0709 13:15:26.334438 (+ 48809us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.366911 (+ 32473us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.380037 (+ 13126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.723767 (+343730us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.805679 (+ 81912us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.806145 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4907776}
I20260709 13:15:26.760866  3407 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 30) took 1142 ms. Trace:
I20260709 13:15:26.818781  3407 rpcz_store.cc:276] 0709 13:15:25.609989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.308376 (+698387us) service_pool.cc:224] Handling call
0709 13:15:26.310195 (+  1819us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.310296 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.553769 (+243473us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.742246 (+188477us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.752616 (+ 10370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.820869  3407 tablet_service.cc:1511] Processing CreateTablet for tablet 3b67a8637f824de9911512eedc03ec43 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:26.822219  3407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b67a8637f824de9911512eedc03ec43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.802491  3403 tablet_service.cc:1511] Processing CreateTablet for tablet 7e8ac5126c3a4c50bf54cabb0135a5ef (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:26.812017  3331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 27) took 1230 ms. Trace:
I20260709 13:15:26.813575  3328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 28) took 1223 ms. Trace:
I20260709 13:15:26.800444  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 7e8ac5126c3a4c50bf54cabb0135a5ef (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:26.815570  3251 tablet_service.cc:1511] Processing CreateTablet for tablet b3ad0659cde14de3b129b42d480176b3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:26.825433  3257 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 30) took 1213 ms. Trace:
I20260709 13:15:26.822810  3252 tablet_service.cc:1511] Processing CreateTablet for tablet aa6845d090104ffea526fc245bcd9e0d (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:26.807915  3255 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 31) took 1191 ms. Trace:
I20260709 13:15:26.716769  3256 rpcz_store.cc:276] 0709 13:15:25.624784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.435391 (+810607us) service_pool.cc:224] Handling call
0709 13:15:26.437334 (+  1943us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.437436 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.613103 (+175667us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.622038 (+  8935us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.656112 (+ 34074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.771260  3482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39886 (request call id 34) took 1123 ms. Trace:
I20260709 13:15:26.827282  3400 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 24) took 1227 ms. Trace:
I20260709 13:15:26.758646  3405 tablet_service.cc:1511] Processing CreateTablet for tablet 41010ff5db384e30a704f7cfd15b5ee4 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:26.837740  3255 rpcz_store.cc:276] 0709 13:15:25.616343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.416933 (+800590us) service_pool.cc:224] Handling call
0709 13:15:26.432626 (+ 15693us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.432737 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.665668 (+232931us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.807291 (+141623us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.807848 (+   557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.852315  3400 rpcz_store.cc:276] 0709 13:15:25.559651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.125510 (+565859us) service_pool.cc:224] Handling call
0709 13:15:26.186903 (+ 61393us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.187010 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.567505 (+380495us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.785953 (+218448us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.786553 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.854658  3333 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 24) took 1297 ms. Trace:
I20260709 13:15:26.855109  3333 rpcz_store.cc:276] 0709 13:15:25.557446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.226720 (+669274us) service_pool.cc:224] Handling call
0709 13:15:26.228795 (+  2075us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.228925 (+   130us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.591614 (+362689us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.854066 (+262452us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.854589 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.857267  3333 tablet_service.cc:1511] Processing CreateTablet for tablet 41010ff5db384e30a704f7cfd15b5ee4 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:26.841091  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e629cf2e72494a84b27f79d2d660c379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.844249  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6845d090104ffea526fc245bcd9e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.859582  3400 tablet_service.cc:1511] Processing CreateTablet for tablet b3ad0659cde14de3b129b42d480176b3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:26.860205  3256 tablet_service.cc:1511] Processing CreateTablet for tablet f99a38ce9bfc4c8896ba84328639b90b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:26.854257  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41010ff5db384e30a704f7cfd15b5ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.864535  3406 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 26) took 1289 ms. Trace:
I20260709 13:15:26.864923  3406 rpcz_store.cc:276] 0709 13:15:25.575642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.231363 (+655721us) service_pool.cc:224] Handling call
0709 13:15:26.284697 (+ 53334us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b58005ee398. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.291929 (+  7232us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.292052 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.725228 (+433176us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.848470 (+123242us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.864023 (+ 15553us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b58005ee398. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587d1a2 00007f61ee7bebb9 00007f61ed8efd88 00007f61ed9b6973 00007f61ed9b270f 00007f61ed9b2ecd 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82
0709 13:15:26.864463 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13334144}
I20260709 13:15:26.830626  3331 rpcz_store.cc:276] 0709 13:15:25.581424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.301375 (+719951us) service_pool.cc:224] Handling call
0709 13:15:26.332193 (+ 30818us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.332292 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.567834 (+235542us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.734927 (+167093us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.766698 (+ 31771us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b58001d8e98. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587d1a2 00007f61ee7bebb9 00007f61ed8efd88 00007f61ed9b6973 00007f61ed9b270f 00007f61ed9b2ecd 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82
0709 13:15:26.811943 (+ 45245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3179392}
I20260709 13:15:26.867990  3402 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 29) took 1266 ms. Trace:
I20260709 13:15:26.868503  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 2e470b894b5f4fe6933870e43f2eb8bc (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:26.868440  3402 rpcz_store.cc:276] 0709 13:15:25.601774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.286198 (+684424us) service_pool.cc:224] Handling call
0709 13:15:26.318459 (+ 32261us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.321964 (+  3505us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.649525 (+327561us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.867462 (+217937us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.867927 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.869943  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e470b894b5f4fe6933870e43f2eb8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.868466  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8ac5126c3a4c50bf54cabb0135a5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.836104  3257 rpcz_store.cc:276] 0709 13:15:25.612074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.412176 (+800102us) service_pool.cc:224] Handling call
0709 13:15:26.414069 (+  1893us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.414170 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.645823 (+231653us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.824856 (+179033us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.825365 (+   509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.873476  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7cbd198b1c458b9835725ccdb37439 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:26.833674  3328 rpcz_store.cc:276] 0709 13:15:25.590369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.312186 (+721817us) service_pool.cc:224] Handling call
0709 13:15:26.314079 (+  1893us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.314170 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.668315 (+354145us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.813022 (+144707us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.813505 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.750247  3250 rpcz_store.cc:276] 0709 13:15:25.593265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.062266 (+469001us) service_pool.cc:224] Handling call
0709 13:15:26.163265 (+100999us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.163459 (+   194us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.479157 (+315698us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.678393 (+199236us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.728914 (+ 50521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.877753  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 3b67a8637f824de9911512eedc03ec43 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:26.878067  3250 tablet_service.cc:1511] Processing CreateTablet for tablet c143a12f1d074d6abf4f33d880d1c212 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:26.844818  3480 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39886 (request call id 41) took 1109 ms. Trace:
I20260709 13:15:26.845351  3253 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 27) took 1234 ms. Trace:
I20260709 13:15:26.839224  3327 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 25) took 1274 ms. Trace:
W20260709 13:15:26.779856  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 51261.8us
I20260709 13:15:26.830088  3475 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39886 (request call id 38) took 1136 ms. Trace:
I20260709 13:15:26.882763  3400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ad0659cde14de3b129b42d480176b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.889020  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:26.882815  3255 tablet_service.cc:1511] Processing CreateTablet for tablet e4bf210b6f6b4a11a7bfbf815676b433 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:26.839797  3474 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39886 (request call id 36) took 1161 ms. Trace:
W20260709 13:15:26.899828  3309 leader_election.cc:343] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.900537  3475 rpcz_store.cc:276] 0709 13:15:25.692114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.282137 (+590023us) service_pool.cc:224] Handling call
0709 13:15:26.301111 (+ 18974us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.314624 (+ 13513us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.527641 (+213017us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.746760 (+219119us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.828625 (+ 81865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.840726  3482 rpcz_store.cc:276] 0709 13:15:25.647745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.188355 (+540610us) service_pool.cc:224] Handling call
0709 13:15:26.190399 (+  2044us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.210276 (+ 19877us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.468167 (+257891us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.760329 (+292162us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.771190 (+ 10861us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.903518  3404 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 27) took 1320 ms. Trace:
I20260709 13:15:26.892978  3327 rpcz_store.cc:276] 0709 13:15:25.565276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.227823 (+662547us) service_pool.cc:224] Handling call
0709 13:15:26.229733 (+  1910us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.229883 (+   150us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.593668 (+363785us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.805246 (+211578us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.835453 (+ 30207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.903976  3404 rpcz_store.cc:276] 0709 13:15:25.583587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.238676 (+655089us) service_pool.cc:224] Handling call
0709 13:15:26.273305 (+ 34629us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.288560 (+ 15255us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.680519 (+391959us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.902902 (+222383us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.903450 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.905392  3326 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 29) took 1305 ms. Trace:
I20260709 13:15:26.905628  3327 tablet_service.cc:1511] Processing CreateTablet for tablet b3ad0659cde14de3b129b42d480176b3 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:26.905824  3326 rpcz_store.cc:276] 0709 13:15:25.599684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.305140 (+705456us) service_pool.cc:224] Handling call
0709 13:15:26.306970 (+  1830us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.307097 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.642209 (+335112us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.857952 (+215743us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.905308 (+ 47356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.897666  3539 tablet_bootstrap.cc:492] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:26.907512  3539 ts_tablet_manager.cc:1403] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.373s	user 0.019s	sys 0.000s
I20260709 13:15:26.908558  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8ac5126c3a4c50bf54cabb0135a5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.899204  3474 rpcz_store.cc:276] 0709 13:15:25.675172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.252378 (+577206us) service_pool.cc:224] Handling call
0709 13:15:26.254251 (+  1873us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.254378 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.560371 (+305993us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.785653 (+225282us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.836558 (+ 50905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.911751  3540 raft_consensus.cc:359] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.912637  3540 raft_consensus.cc:385] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.914397  3540 raft_consensus.cc:740] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.915122  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b67a8637f824de9911512eedc03ec43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.913869  3334 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 26) took 1340 ms. Trace:
I20260709 13:15:26.933776  3334 rpcz_store.cc:276] 0709 13:15:25.573430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.238836 (+665406us) service_pool.cc:224] Handling call
0709 13:15:26.361607 (+122771us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.376300 (+ 14693us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.654104 (+277804us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.891398 (+237294us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.913797 (+ 22399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27654}
I20260709 13:15:26.915534  3479 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39886 (request call id 40) took 1198 ms. Trace:
I20260709 13:15:26.891625  3480 rpcz_store.cc:276] 0709 13:15:25.735210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.395727 (+660517us) service_pool.cc:224] Handling call
0709 13:15:26.397800 (+  2073us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.397908 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.652035 (+254127us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.844208 (+192173us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.844746 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.912762  3539 raft_consensus.cc:359] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:26.899708  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
W20260709 13:15:26.941386  3307 leader_election.cc:343] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.941885  3307 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:26.943504  3552 raft_consensus.cc:2749] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.891896  3253 rpcz_store.cc:276] 0709 13:15:25.611172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.282378 (+671206us) service_pool.cc:224] Handling call
0709 13:15:26.299926 (+ 17548us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.318865 (+ 18939us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.724375 (+405510us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.844783 (+120408us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.845285 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22272}
I20260709 13:15:26.921532  3402 tablet_service.cc:1511] Processing CreateTablet for tablet 0286901285774174994aca4647f28bd7 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:26.945587  3402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0286901285774174994aca4647f28bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.946843  3253 tablet_service.cc:1511] Processing CreateTablet for tablet 90df71c989bb49dda47f16aa67340ef6 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:26.947033  3540 consensus_queue.cc:260] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.947961  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:26.948704  3344 raft_consensus.cc:2468] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:26.949824  3537 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:26.951025  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:26.952960  3234 leader_election.cc:304] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:26.953962  3546 raft_consensus.cc:2804] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.954373  3546 raft_consensus.cc:493] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.954751  3546 raft_consensus.cc:3060] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.924314  3538 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:26.925463  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bf210b6f6b4a11a7bfbf815676b433. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:26.961664  3234 leader_election.cc:343] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.931689  3329 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 22) took 1389 ms. Trace:
I20260709 13:15:26.964313  3329 rpcz_store.cc:276] 0709 13:15:25.542275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.182019 (+639744us) service_pool.cc:224] Handling call
0709 13:15:26.297580 (+115561us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.301289 (+  3709us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.855830 (+554541us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.931141 (+ 75311us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.931624 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.961974  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90df71c989bb49dda47f16aa67340ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.966879  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ad0659cde14de3b129b42d480176b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.967423  3329 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7cbd198b1c458b9835725ccdb37439 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:26.968771  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7cbd198b1c458b9835725ccdb37439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.969933  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99a38ce9bfc4c8896ba84328639b90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.971882  3540 ts_tablet_manager.cc:1434] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.253s	user 0.004s	sys 0.004s
I20260709 13:15:26.972256  3546 raft_consensus.cc:515] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:26.908274  3326 tablet_service.cc:1511] Processing CreateTablet for tablet aa6845d090104ffea526fc245bcd9e0d (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:26.974769  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c143a12f1d074d6abf4f33d880d1c212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.975741  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6845d090104ffea526fc245bcd9e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.978245  3481 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39886 (request call id 39) took 1267 ms. Trace:
I20260709 13:15:26.978790  3481 rpcz_store.cc:276] 0709 13:15:25.711011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.353610 (+642599us) service_pool.cc:224] Handling call
0709 13:15:26.438487 (+ 84877us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.438589 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.865113 (+426524us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.977636 (+112523us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.978172 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.979863  3537 ts_tablet_manager.cc:1403] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.727s	user 0.023s	sys 0.022s
I20260709 13:15:26.983039  3404 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7cbd198b1c458b9835725ccdb37439 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:26.983744  3537 raft_consensus.cc:359] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:26.984611  3537 raft_consensus.cc:385] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.984673  3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7cbd198b1c458b9835725ccdb37439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.984999  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:26.987061  3384 leader_election.cc:343] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.978785  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ad0659cde14de3b129b42d480176b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.991180  3540 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:26.991489  3408 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 28) took 1399 ms. Trace:
I20260709 13:15:26.991945  3408 rpcz_store.cc:276] 0709 13:15:25.592459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.240751 (+648292us) service_pool.cc:224] Handling call
0709 13:15:26.288355 (+ 47604us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b58005ee398. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.291623 (+  3268us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.291728 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.718258 (+426530us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.990836 (+272578us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.991413 (+   577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9425792}
I20260709 13:15:26.936288  3325 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 30) took 1328 ms. Trace:
I20260709 13:15:26.995200  3333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41010ff5db384e30a704f7cfd15b5ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.996622  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:26.997291  3344 raft_consensus.cc:3060] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.984678  3399 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 32) took 1355 ms. Trace:
I20260709 13:15:26.937242  3479 rpcz_store.cc:276] 0709 13:15:25.717503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.336795 (+619292us) service_pool.cc:224] Handling call
0709 13:15:26.346025 (+  9230us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.360684 (+ 14659us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.645860 (+285176us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.850275 (+204415us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.915459 (+ 65184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.998934  3399 rpcz_store.cc:276] 0709 13:15:25.629115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.609746 (+980631us) service_pool.cc:224] Handling call
0709 13:15:26.737207 (+127461us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.737316 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.821511 (+ 84195us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.983939 (+162428us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.984604 (+   665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.939014  3539 raft_consensus.cc:385] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.939391  3334 tablet_service.cc:1511] Processing CreateTablet for tablet 0286901285774174994aca4647f28bd7 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:27.001248  3334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0286901285774174994aca4647f28bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.001905  3399 tablet_service.cc:1511] Processing CreateTablet for tablet b8adbc138e3a482086d6d658376baa14 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:27.003286  3399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8adbc138e3a482086d6d658376baa14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.006539  3539 raft_consensus.cc:740] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.008378  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:27.007665  3539 consensus_queue.cc:260] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:27.010180  3381 leader_election.cc:343] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.010378  3401 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 31) took 1389 ms. Trace:
I20260709 13:15:27.010715  3381 leader_election.cc:304] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:27.010843  3401 rpcz_store.cc:276] 0709 13:15:25.620755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.488320 (+867565us) service_pool.cc:224] Handling call
0709 13:15:26.538764 (+ 50444us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.601514 (+ 62750us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.826415 (+224901us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.009767 (+183352us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.010306 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.012171  3548 raft_consensus.cc:2749] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.012136  3344 raft_consensus.cc:2468] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:27.015671  3539 ts_tablet_manager.cc:1434] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 13:15:27.016825  3539 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:26.869488  3406 tablet_service.cc:1511] Processing CreateTablet for tablet f99a38ce9bfc4c8896ba84328639b90b (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:27.018829  3234 leader_election.cc:304] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:27.019332  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99a38ce9bfc4c8896ba84328639b90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.025509  3405 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 33) took 1388 ms. Trace:
I20260709 13:15:27.026875  3546 leader_election.cc:290] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.027577  3546 raft_consensus.cc:2804] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.028043  3546 raft_consensus.cc:697] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:27.029299  3332 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 32) took 1402 ms. Trace:
I20260709 13:15:26.994232  3408 tablet_service.cc:1511] Processing CreateTablet for tablet e4bf210b6f6b4a11a7bfbf815676b433 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:27.029819  3332 rpcz_store.cc:276] 0709 13:15:25.627080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.683551 (+1056471us) service_pool.cc:224] Handling call
0709 13:15:26.739402 (+ 55851us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.750350 (+ 10948us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.948710 (+198360us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.028687 (+ 79977us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.029209 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.030943  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7cbd198b1c458b9835725ccdb37439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.035319  3408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bf210b6f6b4a11a7bfbf815676b433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.035988  3258 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 34) took 1394 ms. Trace:
I20260709 13:15:27.036651  3258 rpcz_store.cc:276] 0709 13:15:25.641264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.795515 (+1154251us) service_pool.cc:224] Handling call
0709 13:15:26.803769 (+  8254us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.803894 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.932698 (+128804us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.032023 (+ 99325us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.035914 (+  3891us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2312}
I20260709 13:15:27.038942  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 62ae694390334d8583cdad82212fb301 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:27.044624  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ae694390334d8583cdad82212fb301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.045666  3403 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 34) took 1400 ms. Trace:
I20260709 13:15:27.028950  3546 consensus_queue.cc:237] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.049458  3330 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 31) took 1430 ms. Trace:
I20260709 13:15:27.041651  3537 raft_consensus.cc:740] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.072793  3258 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 43) took 1173 ms. Trace:
I20260709 13:15:27.073227  3258 rpcz_store.cc:276] 0709 13:15:25.899040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.037900 (+1138860us) service_pool.cc:224] Handling call
0709 13:15:27.044105 (+  6205us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.044212 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.065257 (+ 21045us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.072245 (+  6988us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.072723 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.074129  3253 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 42) took 1337 ms. Trace:
I20260709 13:15:27.025988  3405 rpcz_store.cc:276] 0709 13:15:25.637211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.738275 (+1101064us) service_pool.cc:224] Handling call
0709 13:15:26.853746 (+115471us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.853862 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.936208 (+ 82346us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.024949 (+ 88741us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.025433 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.994783  3325 rpcz_store.cc:276] 0709 13:15:25.607779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.437100 (+829321us) service_pool.cc:224] Handling call
0709 13:15:26.527142 (+ 90042us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.527279 (+   137us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.888903 (+361624us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:26.935710 (+ 46807us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:26.936207 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.041321  3540 tablet_bootstrap.cc:654] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.055258  3259 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 33) took 1422 ms. Trace:
I20260709 13:15:27.082000  3259 rpcz_store.cc:276] 0709 13:15:25.632894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.619692 (+986798us) service_pool.cc:224] Handling call
0709 13:15:26.622081 (+  2389us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.622210 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.958844 (+336634us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.054689 (+ 95845us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.055184 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21027}
I20260709 13:15:27.083055  3405 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc0678dd7da4af08ae4454d8b3e9f32 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:27.057766  3400 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 36) took 1384 ms. Trace:
I20260709 13:15:27.060120  3329 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 39) took 1352 ms. Trace:
I20260709 13:15:27.084416  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc0678dd7da4af08ae4454d8b3e9f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.036675  3332 tablet_service.cc:1511] Processing CreateTablet for tablet c143a12f1d074d6abf4f33d880d1c212 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:27.067281  3254 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 35) took 1415 ms. Trace:
I20260709 13:15:27.067349  3401 tablet_service.cc:1511] Processing CreateTablet for tablet 90df71c989bb49dda47f16aa67340ef6 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:27.046135  3403 rpcz_store.cc:276] 0709 13:15:25.645626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.765704 (+1120078us) service_pool.cc:224] Handling call
0709 13:15:26.836466 (+ 70762us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.852614 (+ 16148us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.958304 (+105690us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.045096 (+ 86792us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.045593 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.089749  3325 tablet_service.cc:1511] Processing CreateTablet for tablet b8adbc138e3a482086d6d658376baa14 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:27.084946  3400 rpcz_store.cc:276] 0709 13:15:25.672946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.855246 (+1182300us) service_pool.cc:224] Handling call
0709 13:15:26.860482 (+  5236us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.860576 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.991442 (+130866us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.057206 (+ 65764us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.057690 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.091147  3401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90df71c989bb49dda47f16aa67340ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.085994  3254 rpcz_store.cc:276] 0709 13:15:25.651979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.798873 (+1146894us) service_pool.cc:224] Handling call
0709 13:15:26.851961 (+ 53088us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.893033 (+ 41072us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.981252 (+ 88219us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.066673 (+ 85421us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.067207 (+   534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.084599  3329 rpcz_store.cc:276] 0709 13:15:25.707598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.966427 (+1258829us) service_pool.cc:224] Handling call
0709 13:15:26.968271 (+  1844us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.968382 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.052196 (+ 83814us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.059567 (+  7371us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.060049 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.093497  3329 tablet_service.cc:1511] Processing CreateTablet for tablet 90df71c989bb49dda47f16aa67340ef6 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:27.071913  3407 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 35) took 1415 ms. Trace:
I20260709 13:15:27.073451  3537 consensus_queue.cc:260] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.040650  3473 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39886 (request call id 42) took 1140 ms. Trace:
I20260709 13:15:27.039587  3252 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 37) took 1358 ms. Trace:
I20260709 13:15:27.097872  3252 rpcz_store.cc:276] 0709 13:15:25.676329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.820746 (+1144417us) service_pool.cc:224] Handling call
0709 13:15:26.843329 (+ 22583us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.843527 (+   198us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.843661 (+   134us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.926322 (+ 82661us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.033659 (+107337us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.034324 (+   665us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11233664}
I20260709 13:15:27.099263  3537 ts_tablet_manager.cc:1434] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.119s	user 0.005s	sys 0.003s
I20260709 13:15:27.100448  3537 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.099707  3473 rpcz_store.cc:276] 0709 13:15:25.900053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.500882 (+600829us) service_pool.cc:224] Handling call
0709 13:15:26.529666 (+ 28784us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.535446 (+  5780us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.968753 (+433307us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.040084 (+ 71331us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.040575 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.074951  3330 rpcz_store.cc:276] 0709 13:15:25.618629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.659362 (+1040733us) service_pool.cc:224] Handling call
0709 13:15:26.770535 (+111173us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.770677 (+   142us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.942479 (+171802us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.048854 (+106375us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.049383 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.076579  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc0678dd7da4af08ae4454d8b3e9f32 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:27.078903  3538 ts_tablet_manager.cc:1403] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.668s	user 0.017s	sys 0.022s
I20260709 13:15:27.089229  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c143a12f1d074d6abf4f33d880d1c212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.114262  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc0678dd7da4af08ae4454d8b3e9f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.118894  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90df71c989bb49dda47f16aa67340ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.120254  3538 raft_consensus.cc:359] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.121140  3538 raft_consensus.cc:385] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.121448  3538 raft_consensus.cc:740] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.123745  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 62ae694390334d8583cdad82212fb301 (DEFAULT_TABLE table=test-workload [id=cfba76fff4104abfa71554d9219e370a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:27.139998  3539 tablet_bootstrap.cc:654] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.143074  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8adbc138e3a482086d6d658376baa14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.122217  3538 consensus_queue.cc:260] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.111490  3407 rpcz_store.cc:276] 0709 13:15:25.656329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.819893 (+1163564us) service_pool.cc:224] Handling call
0709 13:15:26.821681 (+  1788us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.821789 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:26.945136 (+123347us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.071345 (+126209us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.071844 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.152662  3537 tablet_bootstrap.cc:654] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:27.124500  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 105788us
I20260709 13:15:27.080565  3253 rpcz_store.cc:276] 0709 13:15:25.736486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.945764 (+1209278us) service_pool.cc:224] Handling call
0709 13:15:26.947884 (+  2120us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.947982 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.041003 (+ 93021us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.073631 (+ 32628us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.074060 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.162596  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:27.162796  3548 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.164654  3548 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.165977  3328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 35) took 1511 ms. Trace:
I20260709 13:15:27.165500  3166 catalog_manager.cc:5697] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.167004  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ae694390334d8583cdad82212fb301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.179915  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.172763  3548 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:27.185731  3384 leader_election.cc:343] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.192035  3538 ts_tablet_manager.cc:1434] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.075s	user 0.012s	sys 0.001s
I20260709 13:15:27.193781  3538 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:27.170527  3234 leader_election.cc:343] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.196547  3255 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 41) took 1477 ms. Trace:
I20260709 13:15:27.198786  3399 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 41) took 1470 ms. Trace:
I20260709 13:15:27.201012  3334 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 38) took 1514 ms. Trace:
I20260709 13:15:27.203575  3540 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:27.216625  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.225389  3330 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 43) took 1255 ms. Trace:
I20260709 13:15:27.225605  3545 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.232170  3326 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 37) took 1553 ms. Trace:
I20260709 13:15:27.239069  3540 ts_tablet_manager.cc:1403] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.248s	user 0.019s	sys 0.006s
I20260709 13:15:27.244045  3538 tablet_bootstrap.cc:654] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.258872  3250 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 40) took 1545 ms. Trace:
I20260709 13:15:27.275758  3250 rpcz_store.cc:276] 0709 13:15:25.713549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.877131 (+1163582us) service_pool.cc:224] Handling call
0709 13:15:26.896818 (+ 19687us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.906680 (+  9862us) spinlock_profiling.cc:243] Waited 9.03 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ceee 0000000000375939 00007f61ed8f01e0 00007f61ed9d584c 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.925096 (+ 18416us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.925217 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.190905 (+265688us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.235402 (+ 44497us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.258781 (+ 23379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24276096}
I20260709 13:15:27.244098  3402 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 38) took 1554 ms. Trace:
I20260709 13:15:27.234831  3330 rpcz_store.cc:276] 0709 13:15:25.970394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.122803 (+1152409us) service_pool.cc:224] Handling call
0709 13:15:27.141516 (+ 18713us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.145934 (+  4418us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.190218 (+ 44284us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.224613 (+ 34395us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.225299 (+   686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.251911  3325 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 41) took 1525 ms. Trace:
I20260709 13:15:27.166414  3328 rpcz_store.cc:276] 0709 13:15:25.654160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.876810 (+1222650us) service_pool.cc:224] Handling call
0709 13:15:26.878592 (+  1782us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.878697 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.051183 (+172486us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.165389 (+114206us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.165899 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.283072  3332 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 40) took 1562 ms. Trace:
I20260709 13:15:27.281757  3540 raft_consensus.cc:359] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.282379  3257 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 39) took 1589 ms. Trace:
I20260709 13:15:27.304180  3540 raft_consensus.cc:385] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.304761  3540 raft_consensus.cc:740] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.304349  3257 rpcz_store.cc:276] 0709 13:15:25.693478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.871990 (+1178512us) service_pool.cc:224] Handling call
0709 13:15:26.924768 (+ 52778us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.925719 (+   951us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.925817 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.219022 (+293205us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.281833 (+ 62811us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.282312 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53322496}
I20260709 13:15:27.211141  3399 rpcz_store.cc:276] 0709 13:15:25.728436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.000933 (+1272497us) service_pool.cc:224] Handling call
0709 13:15:27.002789 (+  1856us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.002906 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.078705 (+ 75799us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.198141 (+119436us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.198714 (+   573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.285848  3329 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 42) took 1536 ms. Trace:
I20260709 13:15:27.280838  3327 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 36) took 1610 ms. Trace:
I20260709 13:15:27.259402  3251 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 36) took 1599 ms. Trace:
I20260709 13:15:27.242910  3333 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 33) took 1608 ms. Trace:
W20260709 13:15:27.241247  3383 leader_election.cc:343] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.292387  3406 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 37) took 1611 ms. Trace:
I20260709 13:15:27.238843  3545 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.308094  3329 rpcz_store.cc:276] 0709 13:15:25.749747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.092536 (+1342789us) service_pool.cc:224] Handling call
0709 13:15:27.094296 (+  1760us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.094389 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.255938 (+161549us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.285246 (+ 29308us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.285757 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.308177  3406 rpcz_store.cc:276] 0709 13:15:25.680699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.868543 (+1187844us) service_pool.cc:224] Handling call
0709 13:15:27.018779 (+150236us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.018900 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.120199 (+101299us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.285146 (+164947us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.292303 (+  7157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2750}
I20260709 13:15:27.308162  3383 leader_election.cc:304] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:27.312299  3548 raft_consensus.cc:2749] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.312871  3333 rpcz_store.cc:276] 0709 13:15:25.634975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.856211 (+1221236us) service_pool.cc:224] Handling call
0709 13:15:26.858082 (+  1871us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.858177 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.142559 (+284382us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.242339 (+ 99780us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.242838 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.313778  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.314251  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:27.212339  3255 rpcz_store.cc:276] 0709 13:15:25.718734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.881775 (+1163041us) service_pool.cc:224] Handling call
0709 13:15:26.924916 (+ 43141us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.925049 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.067957 (+142908us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.195925 (+127968us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.196462 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.315448  3457 leader_election.cc:343] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.291354  3332 rpcz_store.cc:276] 0709 13:15:25.720310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.034786 (+1314476us) service_pool.cc:224] Handling call
0709 13:15:27.088700 (+ 53914us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.088807 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.206371 (+117564us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.282373 (+ 76002us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.282984 (+   611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.315693  3540 consensus_queue.cc:260] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:27.316620  3455 leader_election.cc:343] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.317685  3538 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:27.318295  3538 ts_tablet_manager.cc:1403] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.125s	user 0.028s	sys 0.020s
I20260709 13:15:27.320386  3455 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:27.320966  3256 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 38) took 1636 ms. Trace:
I20260709 13:15:27.321447  3256 rpcz_store.cc:276] 0709 13:15:25.684261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.859204 (+1174943us) service_pool.cc:224] Handling call
0709 13:15:26.910658 (+ 51454us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.925854 (+ 15196us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.925962 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.234654 (+308692us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.320418 (+ 85764us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.320895 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28029824}
I20260709 13:15:27.322117  3538 raft_consensus.cc:359] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.237963  3326 rpcz_store.cc:276] 0709 13:15:25.678524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.907074 (+1228550us) service_pool.cc:224] Handling call
0709 13:15:26.975243 (+ 68169us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.975378 (+   135us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.061508 (+ 86130us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.231382 (+169874us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.232079 (+   697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.289460  3402 rpcz_store.cc:276] 0709 13:15:25.689894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.869653 (+1179759us) service_pool.cc:224] Handling call
0709 13:15:26.945040 (+ 75387us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.945166 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.042939 (+ 97773us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.243506 (+200567us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.243998 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.323020  3538 raft_consensus.cc:385] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.323439  3538 raft_consensus.cc:740] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.301581  3404 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 39) took 1591 ms. Trace:
I20260709 13:15:27.213665  3334 rpcz_store.cc:276] 0709 13:15:25.686669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.937276 (+1250607us) service_pool.cc:224] Handling call
0709 13:15:27.000750 (+ 63474us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.000871 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.075594 (+ 74723us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.200482 (+124888us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.200941 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.324079  3579 raft_consensus.cc:2749] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.323891  3404 rpcz_store.cc:276] 0709 13:15:25.710080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.905078 (+1194998us) service_pool.cc:224] Handling call
0709 13:15:26.984100 (+ 79022us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.984210 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.089136 (+104926us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.237186 (+148050us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.291049 (+ 53863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.303422  3408 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 40) took 1582 ms. Trace:
I20260709 13:15:27.307224  3327 rpcz_store.cc:276] 0709 13:15:25.670741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.904403 (+1233662us) service_pool.cc:224] Handling call
0709 13:15:26.906815 (+  2412us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.906910 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.165586 (+258676us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.280256 (+114670us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.280769 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.327220  3408 rpcz_store.cc:276] 0709 13:15:25.720753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.993209 (+1272456us) service_pool.cc:224] Handling call
0709 13:15:27.034762 (+ 41553us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.034879 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.101300 (+ 66421us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.302703 (+201403us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.303337 (+   634us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.312199  3383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 71160.4us
I20260709 13:15:27.297189  3405 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 43) took 1242 ms. Trace:
I20260709 13:15:27.329007  3538 consensus_queue.cc:260] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.329201  3405 rpcz_store.cc:276] 0709 13:15:26.054895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.081932 (+1027037us) service_pool.cc:224] Handling call
0709 13:15:27.083882 (+  1950us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.083988 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.110112 (+ 26124us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.296400 (+186288us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.297097 (+   697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.301168  3537 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.330716  3537 ts_tablet_manager.cc:1403] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.231s	user 0.015s	sys 0.015s
I20260709 13:15:27.331746  3538 ts_tablet_manager.cc:1434] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:15:27.293519  3401 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37104 (request call id 42) took 1454 ms. Trace:
I20260709 13:15:27.332911  3538 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:27.332782  3401 rpcz_store.cc:276] 0709 13:15:25.838989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.011976 (+1172987us) service_pool.cc:224] Handling call
0709 13:15:27.090651 (+ 78675us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.090751 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.239016 (+148265us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.261870 (+ 22854us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.293443 (+ 31573us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4677}
I20260709 13:15:27.334885  3545 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:27.334235  3537 raft_consensus.cc:359] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.335726  3537 raft_consensus.cc:385] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.336117  3537 raft_consensus.cc:740] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.335386  3251 rpcz_store.cc:276] 0709 13:15:25.660425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.814328 (+1153903us) service_pool.cc:224] Handling call
0709 13:15:26.875028 (+ 60700us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587cb71 00007f61e587ca22 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.907221 (+ 32193us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5800000998. stack: 00007f61e5882343 00007f61e5882240 00007f61e52111d4 00007f61eef4f304 00007f61eef4f299 00007f61e573cdb1 00007f61e587ce9c 00007f61e587ca5b 00007f61ee795c09 00007f61ed8efee0 00007f61ed9d5831 00007f61ed9b2ac3 00007f61ed961400 00007f61e6de6af4 00007f61e6de6a82 00007f61e6de69b1
0709 13:15:26.925437 (+ 18216us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.925551 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.227995 (+302444us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.252383 (+ 24388us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.259323 (+  6940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6230,"spinlock_wait_cycles":6262400}
I20260709 13:15:27.337225  3537 consensus_queue.cc:260] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.343451  3537 ts_tablet_manager.cc:1434] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 13:15:27.344310  3538 tablet_bootstrap.cc:654] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.344106  3579 raft_consensus.cc:493] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.344698  3537 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.345011  3579 raft_consensus.cc:515] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.348892  3540 ts_tablet_manager.cc:1434] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:15:27.350271  3540 tablet_bootstrap.cc:492] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:27.356743  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
W20260709 13:15:27.359130  3455 leader_election.cc:343] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.351096  3579 leader_election.cc:290] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:27.353404  3325 rpcz_store.cc:276] 0709 13:15:25.726270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.088746 (+1362476us) service_pool.cc:224] Handling call
0709 13:15:27.090702 (+  1956us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.090804 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.223059 (+132255us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.251323 (+ 28264us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.251839 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.369045  3258 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56564 (request call id 44) took 1284 ms. Trace:
I20260709 13:15:27.374745  3331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37922 (request call id 34) took 1731 ms. Trace:
I20260709 13:15:27.376106  3540 tablet_bootstrap.cc:654] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.372036  3258 rpcz_store.cc:276] 0709 13:15:26.084223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.075569 (+991346us) service_pool.cc:224] Handling call
0709 13:15:27.113683 (+ 38114us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:27.113811 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.276176 (+162365us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.368137 (+ 91961us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.368943 (+   806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.382622  3538 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:27.383215  3538 ts_tablet_manager.cc:1403] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.015s
I20260709 13:15:27.386404  3573 raft_consensus.cc:493] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.386853  3539 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.387328  3573 raft_consensus.cc:515] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.393141  3539 ts_tablet_manager.cc:1403] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.377s	user 0.028s	sys 0.056s
I20260709 13:15:27.379703  3331 rpcz_store.cc:276] 0709 13:15:25.643398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.867551 (+1224153us) service_pool.cc:224] Handling call
0709 13:15:26.869433 (+  1882us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:26.869530 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:27.114140 (+244610us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:27.374127 (+259987us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:27.374674 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.386981  3538 raft_consensus.cc:359] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.408260  3538 raft_consensus.cc:385] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.393579  3537 tablet_bootstrap.cc:654] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.408648  3538 raft_consensus.cc:740] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.397312  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.399415  3539 raft_consensus.cc:359] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.409433  3539 raft_consensus.cc:385] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.409740  3539 raft_consensus.cc:740] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.410601  3539 consensus_queue.cc:260] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:27.412104  3234 leader_election.cc:343] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.416862  3539 ts_tablet_manager.cc:1434] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:15:27.408399  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.406875  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
W20260709 13:15:27.419798  3235 leader_election.cc:343] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.420377  3539 tablet_bootstrap.cc:492] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:27.420469  3235 leader_election.cc:304] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:27.422073  3570 raft_consensus.cc:2749] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:27.419804  3457 leader_election.cc:343] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.423617  3457 leader_election.cc:304] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:27.395879  3573 leader_election.cc:290] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:27.409758  3538 consensus_queue.cc:260] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.425325  3579 raft_consensus.cc:2749] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.417495  3540 tablet_bootstrap.cc:492] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:27.426656  3538 ts_tablet_manager.cc:1434] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.003s
I20260709 13:15:27.427081  3570 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.427830  3538 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:27.427790  3570 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.432025  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.432940  3344 raft_consensus.cc:2468] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:27.434423  3234 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:27.434696  3570 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.435418  3570 raft_consensus.cc:2804] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.435829  3570 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.436225  3570 raft_consensus.cc:3060] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.436444  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
W20260709 13:15:27.438186  3234 leader_election.cc:343] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.438817  3539 tablet_bootstrap.cc:654] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.442782  3540 ts_tablet_manager.cc:1403] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.010s
I20260709 13:15:27.443864  3538 tablet_bootstrap.cc:654] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.444687  3570 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.445431  3537 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.446041  3537 ts_tablet_manager.cc:1403] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.018s
I20260709 13:15:27.446846  3570 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.448035  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:27.448680  3344 raft_consensus.cc:3060] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.448349  3540 raft_consensus.cc:359] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.449163  3540 raft_consensus.cc:385] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.449465  3540 raft_consensus.cc:740] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.449729  3537 raft_consensus.cc:359] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.450290  3540 consensus_queue.cc:260] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.450831  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:27.452960  3540 ts_tablet_manager.cc:1434] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
W20260709 13:15:27.452890  3234 leader_election.cc:343] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.455017  3570 raft_consensus.cc:493] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.455564  3570 raft_consensus.cc:515] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.457369  3540 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:27.458767  3570 leader_election.cc:290] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:27.450747  3537 raft_consensus.cc:385] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.458796  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.460378  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.466846  3492 raft_consensus.cc:2468] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
W20260709 13:15:27.467552  3234 leader_election.cc:343] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.468168  3537 raft_consensus.cc:740] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.468362  3540 tablet_bootstrap.cc:654] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.468345  3235 leader_election.cc:304] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:27.469856  3570 raft_consensus.cc:2804] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.470341  3538 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:27.470292  3570 raft_consensus.cc:493] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.470887  3570 raft_consensus.cc:3060] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.471053  3538 ts_tablet_manager.cc:1403] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.003s
I20260709 13:15:27.474593  3538 raft_consensus.cc:359] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.475301  3538 raft_consensus.cc:385] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.475596  3538 raft_consensus.cc:740] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.478058  3537 consensus_queue.cc:260] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.479615  3539 tablet_bootstrap.cc:492] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.480360  3539 ts_tablet_manager.cc:1403] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.019s
I20260709 13:15:27.480633  3537 ts_tablet_manager.cc:1434] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:15:27.481962  3537 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.484473  3539 raft_consensus.cc:359] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.485538  3539 raft_consensus.cc:385] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.485899  3539 raft_consensus.cc:740] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.486835  3538 consensus_queue.cc:260] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.486963  3539 consensus_queue.cc:260] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.487854  3573 raft_consensus.cc:493] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:27.488271  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:27.488325  3573 raft_consensus.cc:515] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.493367  3573 leader_election.cc:290] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:27.495443  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.496201  3492 raft_consensus.cc:2468] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:27.497972  3537 tablet_bootstrap.cc:654] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.498203  3235 leader_election.cc:304] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:27.499213  3546 raft_consensus.cc:2804] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.499090  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.499779  3546 raft_consensus.cc:493] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.500241  3546 raft_consensus.cc:3060] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:27.501427  3234 consensus_peers.cc:597] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:27.502985  3234 leader_election.cc:343] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.508186  3539 ts_tablet_manager.cc:1434] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:15:27.509773  3539 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:27.465955  3344 raft_consensus.cc:2468] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:27.531629  3234 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:27.532208  3570 raft_consensus.cc:515] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.533324  3573 raft_consensus.cc:2804] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.530035  3546 raft_consensus.cc:515] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.536520  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
W20260709 13:15:27.538837  3234 leader_election.cc:343] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.538954  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:27.539781  3492 raft_consensus.cc:3060] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.545908  3539 tablet_bootstrap.cc:654] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.552903  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:27.553850  3491 raft_consensus.cc:3060] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.557428  3538 ts_tablet_manager.cc:1434] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.009s
I20260709 13:15:27.557253  3573 raft_consensus.cc:697] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:27.558779  3538 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:27.558744  3573 consensus_queue.cc:237] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.562906  3491 raft_consensus.cc:2468] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:27.568184  3539 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.568763  3537 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.566614  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:27.567121  3546 leader_election.cc:290] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:27.568974  3539 ts_tablet_manager.cc:1403] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
I20260709 13:15:27.564275  3570 leader_election.cc:290] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:27.568462  3235 leader_election.cc:304] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:27.570029  3537 ts_tablet_manager.cc:1403] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.088s	user 0.031s	sys 0.023s
I20260709 13:15:27.575536  3492 raft_consensus.cc:2468] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
W20260709 13:15:27.570225  3234 leader_election.cc:343] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.573663  3538 tablet_bootstrap.cc:654] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.573812  3539 raft_consensus.cc:359] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.577860  3539 raft_consensus.cc:385] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.578189  3539 raft_consensus.cc:740] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.579025  3539 consensus_queue.cc:260] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.579066  3537 raft_consensus.cc:359] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.582348  3537 raft_consensus.cc:385] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.582726  3537 raft_consensus.cc:740] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.583298  3235 leader_election.cc:304] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:27.583657  3537 consensus_queue.cc:260] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.581913  3546 raft_consensus.cc:2804] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.585067  3570 raft_consensus.cc:2804] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.585148  3546 raft_consensus.cc:697] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:27.585942  3570 raft_consensus.cc:697] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:27.586490  3546 consensus_queue.cc:237] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.587037  3570 consensus_queue.cc:237] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.590204  3540 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:27.592139  3540 ts_tablet_manager.cc:1403] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.135s	user 0.053s	sys 0.063s
I20260709 13:15:27.594375  3539 ts_tablet_manager.cc:1434] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:15:27.596724  3537 ts_tablet_manager.cc:1434] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:15:27.602656  3540 raft_consensus.cc:359] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.603462  3540 raft_consensus.cc:385] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.603807  3540 raft_consensus.cc:740] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.603911  3165 catalog_manager.cc:5697] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.606736  3539 tablet_bootstrap.cc:492] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:27.606381  3540 consensus_queue.cc:260] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.609328  3537 tablet_bootstrap.cc:492] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.614512  3538 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:27.615192  3538 ts_tablet_manager.cc:1403] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.003s
I20260709 13:15:27.621906  3540 ts_tablet_manager.cc:1434] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:15:27.624089  3538 raft_consensus.cc:359] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.625485  3538 raft_consensus.cc:385] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.625959  3538 raft_consensus.cc:740] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.626092  3540 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:27.626968  3538 consensus_queue.cc:260] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.624699  3539 tablet_bootstrap.cc:654] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.629938  3538 ts_tablet_manager.cc:1434] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 13:15:27.631114  3579 raft_consensus.cc:493] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.631702  3579 raft_consensus.cc:515] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.634804  3540 tablet_bootstrap.cc:654] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.635463  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.635722  3546 consensus_queue.cc:1048] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.636161  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:27.636291  3418 raft_consensus.cc:2468] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:27.636981  3579 leader_election.cc:290] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.638305  3457 leader_election.cc:304] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:27.639647  3579 raft_consensus.cc:2804] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.640269  3579 raft_consensus.cc:493] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.640884  3579 raft_consensus.cc:3060] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.639987  3165 catalog_manager.cc:5697] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.641971  3537 tablet_bootstrap.cc:654] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.644142  3538 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:27.647092  3455 leader_election.cc:343] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.649585  3552 raft_consensus.cc:493] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.650242  3552 raft_consensus.cc:515] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.651083  3165 catalog_manager.cc:5697] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.653236  3552 leader_election.cc:290] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:27.661988  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
W20260709 13:15:27.664736  3307 leader_election.cc:343] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.669886  3539 tablet_bootstrap.cc:492] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.670500  3539 ts_tablet_manager.cc:1403] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.005s
I20260709 13:15:27.671993  3579 raft_consensus.cc:515] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.675870  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:27.676002  3539 raft_consensus.cc:359] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.676905  3539 raft_consensus.cc:385] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.677250  3539 raft_consensus.cc:740] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
W20260709 13:15:27.678397  3455 leader_election.cc:343] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.678174  3539 consensus_queue.cc:260] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.680912  3552 raft_consensus.cc:493] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.681571  3552 raft_consensus.cc:515] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.683175  3539 ts_tablet_manager.cc:1434] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:27.684027  3552 leader_election.cc:290] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.684532  3539 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:27.685345  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.688369  3537 tablet_bootstrap.cc:492] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.688129  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:27.688998  3537 ts_tablet_manager.cc:1403] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.010s
I20260709 13:15:27.697598  3579 leader_election.cc:290] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.697820  3538 tablet_bootstrap.cc:654] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.700141  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:27.700886  3418 raft_consensus.cc:3060] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.703316  3537 raft_consensus.cc:359] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:27.704203  3309 leader_election.cc:343] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.704479  3540 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
W20260709 13:15:27.704893  3307 leader_election.cc:343] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.705102  3540 ts_tablet_manager.cc:1403] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.026s
I20260709 13:15:27.706074  3307 leader_election.cc:304] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:27.709164  3552 raft_consensus.cc:2749] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.704793  3538 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:27.711105  3539 tablet_bootstrap.cc:654] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.704224  3537 raft_consensus.cc:385] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.711275  3538 ts_tablet_manager.cc:1403] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.008s
I20260709 13:15:27.713905  3552 raft_consensus.cc:493] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.714176  3418 raft_consensus.cc:2468] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:27.714511  3552 raft_consensus.cc:515] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.715404  3538 raft_consensus.cc:359] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.716104  3538 raft_consensus.cc:385] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.715975  3457 leader_election.cc:304] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:27.717818  3537 raft_consensus.cc:740] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.716549  3538 raft_consensus.cc:740] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.718282  3552 leader_election.cc:290] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:27.723817  3540 raft_consensus.cc:359] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.724601  3540 raft_consensus.cc:385] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.719771  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2760edcad0614547b67102f65f6369fc" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.719340  3537 consensus_queue.cc:260] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.725793  3417 raft_consensus.cc:2468] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:27.727487  3309 leader_election.cc:304] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:27.719036  3579 raft_consensus.cc:2804] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.728565  3537 ts_tablet_manager.cc:1434] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.007s
I20260709 13:15:27.728888  3579 raft_consensus.cc:697] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:27.729754  3537 tablet_bootstrap.cc:492] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.730126  3552 raft_consensus.cc:2804] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.730552  3552 raft_consensus.cc:493] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.730887  3552 raft_consensus.cc:3060] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.729787  3539 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.729801  3579 consensus_queue.cc:237] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.721654  3538 consensus_queue.cc:260] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.735910  3538 ts_tablet_manager.cc:1434] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:15:27.737048  3538 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:27.732610  3539 ts_tablet_manager.cc:1403] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.004s
I20260709 13:15:27.742355  3539 raft_consensus.cc:359] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.743495  3539 raft_consensus.cc:385] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.743970  3539 raft_consensus.cc:740] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.745085  3539 consensus_queue.cc:260] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.749580  3552 raft_consensus.cc:515] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.752709  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2760edcad0614547b67102f65f6369fc" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:27.753254  3537 tablet_bootstrap.cc:654] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.753315  3417 raft_consensus.cc:3060] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.753899  3539 ts_tablet_manager.cc:1434] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:15:27.755698  3539 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:27.761727  3538 tablet_bootstrap.cc:654] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.767259  3417 raft_consensus.cc:2468] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:27.770969  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.771692  3537 tablet_bootstrap.cc:492] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.771487  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2760edcad0614547b67102f65f6369fc" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.773286  3309 leader_election.cc:304] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
W20260709 13:15:27.775106  3310 leader_election.cc:343] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.775635  3310 leader_election.cc:304] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:27.781260  3166 catalog_manager.cc:5697] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.783547  3539 tablet_bootstrap.cc:654] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.784896  3537 ts_tablet_manager.cc:1403] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.010s
I20260709 13:15:27.789197  3537 raft_consensus.cc:359] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.790122  3537 raft_consensus.cc:385] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.724893  3540 raft_consensus.cc:740] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.792867  3609 raft_consensus.cc:2804] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.794373  3538 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:27.795194  3609 raft_consensus.cc:697] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:27.795562  3538 ts_tablet_manager.cc:1403] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.007s
I20260709 13:15:27.796192  3609 consensus_queue.cc:237] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.800251  3538 raft_consensus.cc:359] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.801302  3538 raft_consensus.cc:385] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.794852  3537 raft_consensus.cc:740] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.801537  3540 consensus_queue.cc:260] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.802968  3537 consensus_queue.cc:260] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.805250  3609 raft_consensus.cc:2749] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.807080  3579 raft_consensus.cc:493] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.807206  3538 raft_consensus.cc:740] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.809527  3579 raft_consensus.cc:515] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.812389  3579 leader_election.cc:290] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.807106  3537 ts_tablet_manager.cc:1434] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:15:27.813238  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.814237  3537 tablet_bootstrap.cc:492] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.811604  3538 consensus_queue.cc:260] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:27.815091  3165 catalog_manager.cc:5697] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.817896  3540 ts_tablet_manager.cc:1434] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.003s
I20260709 13:15:27.818084  3538 ts_tablet_manager.cc:1434] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
W20260709 13:15:27.815099  3457 leader_election.cc:343] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.819218  3540 tablet_bootstrap.cc:492] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:27.819573  3538 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:27.832804  3538 tablet_bootstrap.cc:654] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.821164  3552 leader_election.cc:290] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
W20260709 13:15:27.822253  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 49109us
I20260709 13:15:27.834022  3579 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.834715  3579 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.836755  3539 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.837297  3539 ts_tablet_manager.cc:1403] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.082s	user 0.036s	sys 0.012s
I20260709 13:15:27.837538  3579 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:27.840058  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:27.840641  3539 raft_consensus.cc:359] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.841353  3539 raft_consensus.cc:385] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.841693  3539 raft_consensus.cc:740] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
W20260709 13:15:27.842535  3455 leader_election.cc:343] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.842705  3539 consensus_queue.cc:260] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.845104  3539 ts_tablet_manager.cc:1434] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:27.846228  3539 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:27.846669  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.849951  3573 raft_consensus.cc:493] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.850557  3573 raft_consensus.cc:515] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.852742  3539 tablet_bootstrap.cc:654] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:27.853430  3457 leader_election.cc:343] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.854226  3457 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:27.854894  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.856035  3579 raft_consensus.cc:2749] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:27.856914  3234 leader_election.cc:343] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.858207  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.859128  3418 raft_consensus.cc:2468] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:27.860873  3234 leader_election.cc:304] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:27.861999  3570 raft_consensus.cc:2804] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.862772  3570 raft_consensus.cc:493] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.863189  3570 raft_consensus.cc:3060] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:27.819923  3310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 45032us
I20260709 13:15:27.852780  3573 leader_election.cc:290] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
W20260709 13:15:27.866999  3310 leader_election.cc:343] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.826299  3537 tablet_bootstrap.cc:654] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.875341  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2760edcad0614547b67102f65f6369fc" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:27.876121  3491 raft_consensus.cc:3060] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.880486  3570 raft_consensus.cc:515] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.882423  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.883946  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
W20260709 13:15:27.884495  3457 leader_election.cc:343] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.885468  3457 leader_election.cc:304] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
W20260709 13:15:27.885627  3234 leader_election.cc:343] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.886927  3579 raft_consensus.cc:2749] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.888464  3540 tablet_bootstrap.cc:654] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.889214  3539 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.889917  3539 ts_tablet_manager.cc:1403] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.020s
I20260709 13:15:27.890368  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:27.890798  3573 raft_consensus.cc:493] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.891111  3417 raft_consensus.cc:3060] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.891587  3573 raft_consensus.cc:515] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.892998  3537 tablet_bootstrap.cc:492] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.890837  3491 raft_consensus.cc:2468] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:27.894954  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:27.895861  3418 raft_consensus.cc:2393] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f99770bc87e426a893fc425299485cc in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:27.897465  3537 ts_tablet_manager.cc:1403] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.006s
I20260709 13:15:27.897239  3539 raft_consensus.cc:359] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.898017  3539 raft_consensus.cc:385] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.898313  3539 raft_consensus.cc:740] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.899302  3539 consensus_queue.cc:260] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.900203  3573 leader_election.cc:290] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:27.889102  3570 leader_election.cc:290] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:27.901521  3417 raft_consensus.cc:2468] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:27.901190  3537 raft_consensus.cc:359] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.902947  3234 leader_election.cc:304] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:27.902966  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.902273  3537 raft_consensus.cc:385] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.904789  3537 raft_consensus.cc:740] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.907955  3537 consensus_queue.cc:260] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.905745  3570 raft_consensus.cc:2804] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.909961  3539 ts_tablet_manager.cc:1434] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:15:27.911387  3539 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:27.910821  3570 raft_consensus.cc:697] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:27.913404  3538 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:27.914109  3538 ts_tablet_manager.cc:1403] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.095s	user 0.029s	sys 0.013s
I20260709 13:15:27.911132  3235 leader_election.cc:304] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:27.912997  3570 consensus_queue.cc:237] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.915233  3573 raft_consensus.cc:3060] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.922102  3537 ts_tablet_manager.cc:1434] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:15:27.923547  3537 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.929124  3573 raft_consensus.cc:2749] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.931121  3537 tablet_bootstrap.cc:654] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.943356  3540 tablet_bootstrap.cc:492] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:27.943884  3540 ts_tablet_manager.cc:1403] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.009s
I20260709 13:15:27.946296  3539 tablet_bootstrap.cc:654] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.947265  3540 raft_consensus.cc:359] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.947690  3548 raft_consensus.cc:493] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.948271  3548 raft_consensus.cc:515] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.948772  3538 raft_consensus.cc:359] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.949481  3538 raft_consensus.cc:385] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.949733  3538 raft_consensus.cc:740] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.950171  3165 catalog_manager.cc:5697] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.952131  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac7eee9d52843488adb542293814e1e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:27.952996  3548 leader_election.cc:290] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:27.954613  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac7eee9d52843488adb542293814e1e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:27.955468  3491 raft_consensus.cc:2468] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:27.957104  3384 leader_election.cc:304] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:27.957360  3537 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.957906  3537 ts_tablet_manager.cc:1403] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.004s
I20260709 13:15:27.958245  3548 raft_consensus.cc:493] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.958796  3548 raft_consensus.cc:515] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.960777  3548 leader_election.cc:290] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:27.961289  3548 raft_consensus.cc:2804] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.961664  3548 raft_consensus.cc:493] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.962090  3548 raft_consensus.cc:3060] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.961715  3537 raft_consensus.cc:359] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.962723  3537 raft_consensus.cc:385] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.965687  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:27.961294  3540 raft_consensus.cc:385] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.967115  3540 raft_consensus.cc:740] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.963095  3537 raft_consensus.cc:740] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.967919  3540 consensus_queue.cc:260] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:27.968955  3344 raft_consensus.cc:2468] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:27.968962  3537 consensus_queue.cc:260] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.973742  3537 ts_tablet_manager.cc:1434] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
W20260709 13:15:27.975355  3381 leader_election.cc:343] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.976321  3537 tablet_bootstrap.cc:492] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:27.975916  3538 consensus_queue.cc:260] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:27.968191  3417 raft_consensus.cc:3060] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.983345  3537 tablet_bootstrap.cc:654] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.983858  3540 ts_tablet_manager.cc:1434] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:15:27.985133  3540 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:27.978291  3538 ts_tablet_manager.cc:1434] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.000s
I20260709 13:15:27.989905  3538 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:27.988463  3539 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:27.994818  3539 ts_tablet_manager.cc:1403] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.011s
I20260709 13:15:27.995682  3537 tablet_bootstrap.cc:492] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:27.996229  3537 ts_tablet_manager.cc:1403] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:15:27.999198  3570 consensus_queue.cc:1048] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.999516  3537 raft_consensus.cc:359] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.000540  3537 raft_consensus.cc:385] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:28.000737  3384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 43740.1us
I20260709 13:15:28.000903  3537 raft_consensus.cc:740] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.001842  3537 consensus_queue.cc:260] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.002502  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:28.004355  3384 leader_election.cc:343] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.004594  3537 ts_tablet_manager.cc:1434] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:28.005064  3384 leader_election.cc:304] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:28.005872  3537 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:28.008790  3548 raft_consensus.cc:515] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:28.010809  3622 raft_consensus.cc:2749] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.011525  3622 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.012039  3622 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:27.998044  3539 raft_consensus.cc:359] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.014416  3622 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.015159  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:28.025633  3548 leader_election.cc:290] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:28.016495  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:28.026422  3552 raft_consensus.cc:493] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.021577  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac7eee9d52843488adb542293814e1e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:28.027231  3552 raft_consensus.cc:515] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.027916  3342 raft_consensus.cc:3060] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.031090  3383 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:28.031694  3552 leader_election.cc:290] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:28.032537  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:28.033649  3548 raft_consensus.cc:2749] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.022333  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac7eee9d52843488adb542293814e1e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:28.027159  3538 tablet_bootstrap.cc:654] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.018906  3539 raft_consensus.cc:385] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:28.034300  3310 leader_election.cc:343] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.034863  3539 raft_consensus.cc:740] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.035917  3539 consensus_queue.cc:260] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.036706  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:28.037727  3269 raft_consensus.cc:2468] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:28.025231  3540 tablet_bootstrap.cc:654] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.017072  3570 consensus_queue.cc:1048] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:28.039870  3307 leader_election.cc:304] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:28.034937  3491 raft_consensus.cc:3060] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.038187  3539 ts_tablet_manager.cc:1434] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:15:28.046209  3539 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:28.047070  3552 raft_consensus.cc:2804] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.047662  3552 raft_consensus.cc:493] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.048166  3552 raft_consensus.cc:3060] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.054351  3573 raft_consensus.cc:493] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.055177  3573 raft_consensus.cc:515] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:15:28.061683  3234 consensus_peers.cc:597] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.024441  3537 tablet_bootstrap.cc:654] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.084640  3539 tablet_bootstrap.cc:654] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.093978  3537 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:28.094774  3537 ts_tablet_manager.cc:1403] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 13:15:28.091102  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a79b63b8204a21b06b365598657efb" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:28.099139  3490 raft_consensus.cc:2468] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:28.100498  3579 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.088985  3342 raft_consensus.cc:2468] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:28.101531  3579 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.102767  3383 leader_election.cc:304] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:28.103916  3548 raft_consensus.cc:2804] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.104530  3548 raft_consensus.cc:697] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:28.104817  3235 leader_election.cc:304] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.105644  3548 consensus_queue.cc:237] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:28.106869  3570 raft_consensus.cc:2804] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.107306  3570 raft_consensus.cc:493] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.107673  3570 raft_consensus.cc:3060] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.108047  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:28.108759  3418 raft_consensus.cc:2468] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:28.109894  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:28.113336  3539 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
W20260709 13:15:28.113533  3457 leader_election.cc:343] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.115319  3539 ts_tablet_manager.cc:1403] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.000s
I20260709 13:15:28.115487  3457 leader_election.cc:304] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:28.117264  3545 raft_consensus.cc:2804] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.117791  3545 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.118273  3545 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.120726  3570 raft_consensus.cc:515] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.114202  3579 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.125147  3622 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.125876  3622 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.129460  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:28.130247  3490 raft_consensus.cc:2468] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:28.130713  3622 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:28.130625  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:28.131834  3384 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:28.132436  3539 raft_consensus.cc:359] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.147358  3539 raft_consensus.cc:385] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.147681  3539 raft_consensus.cc:740] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.137710  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a79b63b8204a21b06b365598657efb" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:28.148798  3490 raft_consensus.cc:3060] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.132833  3622 raft_consensus.cc:2804] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.149501  3622 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.149868  3622 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:28.132819  3381 leader_election.cc:343] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.091238  3573 leader_election.cc:290] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:28.148392  3539 consensus_queue.cc:260] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.162775  3539 ts_tablet_manager.cc:1434] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:15:28.163089  3546 consensus_queue.cc:1048] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.163801  3539 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:28.166437  3418 raft_consensus.cc:3060] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.146678  3537 raft_consensus.cc:359] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.167299  3537 raft_consensus.cc:385] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.167645  3537 raft_consensus.cc:740] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.170691  3570 leader_election.cc:290] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:28.172081  3537 consensus_queue.cc:260] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.157788  3490 raft_consensus.cc:2468] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:28.179018  3537 ts_tablet_manager.cc:1434] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.001s
I20260709 13:15:28.088690  3491 raft_consensus.cc:2468] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:28.180015  3235 leader_election.cc:304] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.181003  3570 raft_consensus.cc:2804] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.179147  3418 raft_consensus.cc:3060] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.182466  3570 raft_consensus.cc:697] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:28.183456  3570 consensus_queue.cc:237] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.183943  3622 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.186292  3546 raft_consensus.cc:493] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.204386  3546 raft_consensus.cc:515] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.212569  3546 leader_election.cc:290] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.213168  3546 consensus_queue.cc:1048] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.189647  3537 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:28.191180  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a79b63b8204a21b06b365598657efb" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:28.215304  3416 raft_consensus.cc:2468] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:28.197932  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a79b63b8204a21b06b365598657efb" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:28.216418  3415 raft_consensus.cc:3060] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.218669  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:28.219481  3344 raft_consensus.cc:2468] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:28.221890  3234 leader_election.cc:304] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.197847  3552 raft_consensus.cc:515] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.201035  3545 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.228144  3538 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:28.228765  3538 ts_tablet_manager.cc:1403] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.239s	user 0.025s	sys 0.014s
I20260709 13:15:28.229061  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
W20260709 13:15:28.232105  3310 leader_election.cc:343] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.236040  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:28.239328  3492 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.243415  3635 raft_consensus.cc:2804] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.243902  3635 raft_consensus.cc:493] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.244292  3635 raft_consensus.cc:3060] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.232462  3540 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:28.246032  3540 ts_tablet_manager.cc:1403] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.261s	user 0.020s	sys 0.022s
I20260709 13:15:28.237922  3622 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:28.239956  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:28.248188  3416 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.250316  3610 consensus_queue.cc:1048] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.251603  3573 consensus_queue.cc:1048] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.237614  3539 tablet_bootstrap.cc:654] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.255793  3538 raft_consensus.cc:359] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.256640  3538 raft_consensus.cc:385] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.256994  3538 raft_consensus.cc:740] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.258140  3545 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.260392  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
W20260709 13:15:28.262892  3457 leader_election.cc:343] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.263796  3540 raft_consensus.cc:359] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.264559  3540 raft_consensus.cc:385] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.264890  3540 raft_consensus.cc:740] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.267051  3610 consensus_queue.cc:1048] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.268532  3415 raft_consensus.cc:2468] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:28.276015  3538 consensus_queue.cc:260] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.278743  3552 leader_election.cc:290] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:15:28.280122  3235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 78349.7us
I20260709 13:15:28.280450  3538 ts_tablet_manager.cc:1434] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:15:28.287035  3579 consensus_queue.cc:1048] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.287747  3538 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:28.288949  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:28.291803  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:28.292521  3489 raft_consensus.cc:2468] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:28.294401  3165 catalog_manager.cc:5697] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.296078  3492 raft_consensus.cc:2468] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:28.296715  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:28.297479  3269 raft_consensus.cc:3060] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.297966  3537 tablet_bootstrap.cc:654] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.302011  3635 raft_consensus.cc:515] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.304340  3635 leader_election.cc:290] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:28.305964  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 55183.4us
I20260709 13:15:28.311519  3384 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:28.313987  3625 raft_consensus.cc:2804] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.314666  3625 raft_consensus.cc:697] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:28.315753  3625 consensus_queue.cc:237] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.324186  3538 tablet_bootstrap.cc:654] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.327010  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:28.327947  3344 raft_consensus.cc:3060] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.328441  3539 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:28.329191  3539 ts_tablet_manager.cc:1403] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.000s
I20260709 13:15:28.334867  3540 consensus_queue.cc:260] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.338169  3579 consensus_queue.cc:1048] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.341353  3416 raft_consensus.cc:2468] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:28.341180  3164 catalog_manager.cc:5697] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.345155  3540 ts_tablet_manager.cc:1434] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.000s
I20260709 13:15:28.352871  3457 leader_election.cc:304] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:28.360782  3579 raft_consensus.cc:2804] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.361595  3579 raft_consensus.cc:697] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:28.362912  3579 consensus_queue.cc:237] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.373899  3540 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
W20260709 13:15:28.374384  3381 leader_election.cc:343] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.377192  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:28.378028  3491 raft_consensus.cc:3060] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.393105  3639 consensus_queue.cc:1048] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.410702  3342 raft_consensus.cc:3060] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.418028  3539 raft_consensus.cc:359] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.418910  3539 raft_consensus.cc:385] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.419194  3539 raft_consensus.cc:740] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.431658  3269 raft_consensus.cc:2468] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:28.447527  3307 leader_election.cc:304] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:28.448545  3552 raft_consensus.cc:2804] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.449084  3552 raft_consensus.cc:697] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:28.449998  3552 consensus_queue.cc:237] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.432650  3537 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:28.454964  3537 ts_tablet_manager.cc:1403] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.266s	user 0.021s	sys 0.000s
I20260709 13:15:28.458930  3344 raft_consensus.cc:2468] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:28.457890  3491 raft_consensus.cc:2468] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:28.461167  3235 leader_election.cc:304] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.462144  3635 raft_consensus.cc:2804] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.462808  3635 raft_consensus.cc:697] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:28.463063  3537 raft_consensus.cc:359] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.463842  3537 raft_consensus.cc:385] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.464222  3537 raft_consensus.cc:740] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.463728  3635 consensus_queue.cc:237] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.464998  3537 consensus_queue.cc:260] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.467546  3537 ts_tablet_manager.cc:1434] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:28.469403  3537 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:28.471544  3164 catalog_manager.cc:5697] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.476874  3639 raft_consensus.cc:493] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.477645  3537 tablet_bootstrap.cc:654] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.477383  3639 raft_consensus.cc:515] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.435004  3539 consensus_queue.cc:260] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.479609  3639 leader_election.cc:290] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
W20260709 13:15:28.437124  3234 consensus_peers.cc:597] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.480597  3539 ts_tablet_manager.cc:1434] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.151s	user 0.010s	sys 0.000s
W20260709 13:15:28.435072  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 82301.2us
I20260709 13:15:28.482141  3538 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:28.485572  3538 ts_tablet_manager.cc:1403] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.198s	user 0.043s	sys 0.063s
I20260709 13:15:28.486829  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:28.487511  3165 catalog_manager.cc:5697] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.487534  3342 raft_consensus.cc:2468] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
W20260709 13:15:28.491600  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:28.491933  3234 leader_election.cc:304] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.492712  3539 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:28.492331  3538 raft_consensus.cc:359] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.493077  3538 raft_consensus.cc:385] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.493304  3573 raft_consensus.cc:2804] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.493350  3538 raft_consensus.cc:740] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.494756  3573 raft_consensus.cc:493] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.495174  3573 raft_consensus.cc:3060] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.495405  3538 consensus_queue.cc:260] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.498106  3538 ts_tablet_manager.cc:1434] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:28.500473  3539 tablet_bootstrap.cc:654] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.501012  3538 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:28.478289  3540 tablet_bootstrap.cc:654] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.508721  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:28.509431  3414 raft_consensus.cc:2468] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:28.509668  3538 tablet_bootstrap.cc:654] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.514555  3573 raft_consensus.cc:515] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.517556  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:28.518208  3342 raft_consensus.cc:3060] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.517302  3163 catalog_manager.cc:5697] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.518592  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:28.519255  3414 raft_consensus.cc:3060] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.526407  3342 raft_consensus.cc:2468] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:28.526618  3573 leader_election.cc:290] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:28.527833  3234 leader_election.cc:304] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.528800  3573 raft_consensus.cc:2804] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.529292  3573 raft_consensus.cc:697] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:28.530208  3573 consensus_queue.cc:237] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.531700  3414 raft_consensus.cc:2468] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:28.535708  3537 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:28.536291  3537 ts_tablet_manager.cc:1403] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.009s
I20260709 13:15:28.540068  3537 raft_consensus.cc:359] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.540937  3537 raft_consensus.cc:385] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.541277  3537 raft_consensus.cc:740] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.541391  3538 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:28.542088  3538 ts_tablet_manager.cc:1403] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.006s
I20260709 13:15:28.543731  3537 consensus_queue.cc:260] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.545378  3538 raft_consensus.cc:359] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.547173  3538 raft_consensus.cc:385] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.547551  3538 raft_consensus.cc:740] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.548352  3538 consensus_queue.cc:260] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.546500  3540 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:28.549748  3540 ts_tablet_manager.cc:1403] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.203s	user 0.011s	sys 0.006s
I20260709 13:15:28.550985  3538 ts_tablet_manager.cc:1434] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:15:28.553467  3540 raft_consensus.cc:359] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.553926  3538 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:28.554188  3540 raft_consensus.cc:385] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.554522  3540 raft_consensus.cc:740] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.548799  3539 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:28.555498  3539 ts_tablet_manager.cc:1403] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.003s
I20260709 13:15:28.552867  3537 ts_tablet_manager.cc:1434] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:28.558682  3537 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:28.562021  3538 tablet_bootstrap.cc:654] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.573747  3537 tablet_bootstrap.cc:654] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.579185  3539 raft_consensus.cc:359] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.579407  3540 consensus_queue.cc:260] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.580014  3539 raft_consensus.cc:385] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.580334  3539 raft_consensus.cc:740] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.581280  3539 consensus_queue.cc:260] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.582311  3540 ts_tablet_manager.cc:1434] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 13:15:28.584012  3539 ts_tablet_manager.cc:1434] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:15:28.585345  3538 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:28.585891  3538 ts_tablet_manager.cc:1403] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.012s
I20260709 13:15:28.585958  3539 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:28.588757  3540 tablet_bootstrap.cc:492] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:28.589179  3538 raft_consensus.cc:359] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.589890  3538 raft_consensus.cc:385] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.590158  3538 raft_consensus.cc:740] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.590989  3538 consensus_queue.cc:260] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.593299  3538 ts_tablet_manager.cc:1434] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:28.593034  3635 consensus_queue.cc:1048] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.594383  3538 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:28.580097  3164 catalog_manager.cc:5697] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.607532  3538 tablet_bootstrap.cc:654] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.627003  3539 tablet_bootstrap.cc:654] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.630779  3165 catalog_manager.cc:5697] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.638988  3540 tablet_bootstrap.cc:654] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.643553  3539 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:28.644253  3539 ts_tablet_manager.cc:1403] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.002s
I20260709 13:15:28.645315  3537 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:28.645933  3537 ts_tablet_manager.cc:1403] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.022s
I20260709 13:15:28.648712  3537 raft_consensus.cc:359] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.649410  3537 raft_consensus.cc:385] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.649683  3537 raft_consensus.cc:740] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.652066  3537 consensus_queue.cc:260] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.654320  3537 ts_tablet_manager.cc:1434] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:15:28.655452  3537 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:28.645368  3538 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:28.660916  3538 ts_tablet_manager.cc:1403] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.030s
I20260709 13:15:28.661986  3573 consensus_queue.cc:1048] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.663926  3538 raft_consensus.cc:359] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.664670  3538 raft_consensus.cc:385] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.664958  3538 raft_consensus.cc:740] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.665709  3538 consensus_queue.cc:260] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.667856  3538 ts_tablet_manager.cc:1434] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:28.669729  3537 tablet_bootstrap.cc:654] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.669176  3625 consensus_queue.cc:1048] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.671355  3538 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:28.680979  3539 raft_consensus.cc:359] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.681716  3539 raft_consensus.cc:385] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.682080  3539 raft_consensus.cc:740] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.682899  3539 consensus_queue.cc:260] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.695396  3545 raft_consensus.cc:493] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.696089  3545 raft_consensus.cc:515] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.699151  3545 leader_election.cc:290] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.701144  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:28.703007  3539 ts_tablet_manager.cc:1434] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:15:28.704278  3539 tablet_bootstrap.cc:492] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:28.708134  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:28.709321  3269 raft_consensus.cc:2393] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 1: Already voted for candidate 2fbbf37a29b6416eb787ce4c9238e743 in this term.
I20260709 13:15:28.715040  3625 consensus_queue.cc:1048] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.719193  3573 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.719787  3573 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.726788  3573 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:28.727576  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:28.728427  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:28.729265  3492 raft_consensus.cc:2393] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f99770bc87e426a893fc425299485cc in current term 1: Already voted for candidate 680bff02deaf497e885eb83e37cca726 in this term.
I20260709 13:15:28.724995  3538 tablet_bootstrap.cc:654] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.734628  3455 leader_election.cc:304] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:28.736320  3235 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:28.736924  3653 raft_consensus.cc:3060] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.738569  3635 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.749704  3653 raft_consensus.cc:2749] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.757119  3540 tablet_bootstrap.cc:492] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:28.757771  3540 ts_tablet_manager.cc:1403] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.169s	user 0.036s	sys 0.022s
I20260709 13:15:28.761221  3540 raft_consensus.cc:359] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.761929  3540 raft_consensus.cc:385] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.762212  3540 raft_consensus.cc:740] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.766000  3539 tablet_bootstrap.cc:654] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.764993  3540 consensus_queue.cc:260] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.773957  3537 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:28.774842  3537 ts_tablet_manager.cc:1403] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.120s	user 0.007s	sys 0.020s
I20260709 13:15:28.778756  3537 raft_consensus.cc:359] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.779779  3537 raft_consensus.cc:385] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.780218  3537 raft_consensus.cc:740] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.781404  3537 consensus_queue.cc:260] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.784432  3537 ts_tablet_manager.cc:1434] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:28.763585  3653 raft_consensus.cc:493] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.798804  3653 raft_consensus.cc:515] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.802382  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:28.803356  3269 raft_consensus.cc:2468] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:28.795322  3625 consensus_queue.cc:1048] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.806618  3455 leader_election.cc:304] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.798121  3537 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:28.803576  3540 ts_tablet_manager.cc:1434] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.007s
I20260709 13:15:28.807564  3545 raft_consensus.cc:2804] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.808115  3545 raft_consensus.cc:493] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.808557  3545 raft_consensus.cc:3060] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.808831  3540 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:28.816206  3552 raft_consensus.cc:493] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.816892  3552 raft_consensus.cc:515] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.819682  3573 raft_consensus.cc:493] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.820650  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:28.820431  3573 raft_consensus.cc:515] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:28.829056  3625 raft_consensus.cc:493] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.830601  3552 leader_election.cc:290] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:28.831629  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:28.834501  3309 leader_election.cc:304] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:28.835502  3540 tablet_bootstrap.cc:654] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.839265  3537 tablet_bootstrap.cc:654] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.840019  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:28.842214  3610 raft_consensus.cc:2749] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:28.842509  3235 leader_election.cc:343] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.843478  3573 leader_election.cc:290] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:28.829830  3625 raft_consensus.cc:515] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.848076  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:28.851670  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:28.853806  3383 leader_election.cc:343] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:28.855389  3381 leader_election.cc:343] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.855990  3381 leader_election.cc:304] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:28.857177  3622 raft_consensus.cc:2749] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.858613  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
W20260709 13:15:28.860510  3234 leader_election.cc:343] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.861142  3234 leader_election.cc:304] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:28.863763  3639 raft_consensus.cc:2749] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.879712  3625 leader_election.cc:290] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.789048  3635 raft_consensus.cc:2749] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.898625  3610 consensus_queue.cc:1048] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.901667  3625 consensus_queue.cc:1048] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.902365  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:28.904700  3539 tablet_bootstrap.cc:492] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:28.905441  3539 ts_tablet_manager.cc:1403] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.000s
I20260709 13:15:28.914391  3637 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.915050  3637 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:28.917491  3637 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.917169  3539 raft_consensus.cc:359] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:28.919020  3539 raft_consensus.cc:385] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.919349  3539 raft_consensus.cc:740] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.889245  3653 leader_election.cc:290] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:28.926532  3539 consensus_queue.cc:260] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:28.927843  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:28.928869  3489 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:28.929821  3539 ts_tablet_manager.cc:1434] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:15:28.930212  3235 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:28.931833  3539 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
W20260709 13:15:28.927814  3457 leader_election.cc:343] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.939977  3635 raft_consensus.cc:2804] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.931682  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:28.949770  3538 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:28.950270  3538 ts_tablet_manager.cc:1403] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.279s	user 0.046s	sys 0.073s
I20260709 13:15:28.945320  3635 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.953619  3635 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.963943  3540 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:28.964496  3540 ts_tablet_manager.cc:1403] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.010s
I20260709 13:15:28.973033  3538 raft_consensus.cc:359] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:28.973904  3538 raft_consensus.cc:385] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.977502  3344 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.979795  3539 tablet_bootstrap.cc:654] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.974294  3538 raft_consensus.cc:740] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.967902  3653 raft_consensus.cc:493] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.991024  3537 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:28.991611  3537 ts_tablet_manager.cc:1403] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.194s	user 0.015s	sys 0.011s
W20260709 13:15:28.998020  3234 leader_election.cc:343] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.000818  3545 raft_consensus.cc:515] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.001773  3653 raft_consensus.cc:515] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.019170  3538 consensus_queue.cc:260] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.020732  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.022949  3653 leader_election.cc:290] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:29.026629  3455 leader_election.cc:343] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.027661  3573 consensus_queue.cc:1048] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.035735  3537 raft_consensus.cc:359] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.036309  3537 raft_consensus.cc:385] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.036552  3537 raft_consensus.cc:740] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.045389  3537 consensus_queue.cc:260] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.046835  3343 raft_consensus.cc:3060] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.046567  3636 raft_consensus.cc:493] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.033879  3653 consensus_queue.cc:1048] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:29.052021  3610 consensus_queue.cc:1048] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.053262  3636 raft_consensus.cc:515] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.055864  3636 leader_election.cc:290] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:29.044831  3552 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.057586  3552 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.060571  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
W20260709 13:15:29.064989  3457 leader_election.cc:343] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.065786  3622 raft_consensus.cc:493] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.066596  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.066969  3552 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:29.067445  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.068104  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.068194  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.068229  3418 raft_consensus.cc:2468] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:29.066391  3622 raft_consensus.cc:515] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.070281  3309 leader_election.cc:304] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:29.071693  3622 leader_election.cc:290] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:29.071983  3540 raft_consensus.cc:359] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.073112  3540 raft_consensus.cc:385] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.073531  3540 raft_consensus.cc:740] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.074024  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.074589  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.074877  3540 consensus_queue.cc:260] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:29.075791  3383 leader_election.cc:343] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.082077  3381 leader_election.cc:343] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.044159  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.083177  3381 leader_election.cc:304] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.076643  3552 raft_consensus.cc:2804] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:29.078583  3538 ts_tablet_manager.cc:1434] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.128s	user 0.009s	sys 0.000s
I20260709 13:15:29.085772  3538 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:29.087285  3457 leader_election.cc:343] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.087809  3457 leader_election.cc:304] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.089308  3656 raft_consensus.cc:2749] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.090799  3656 consensus_queue.cc:1048] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.092638  3680 raft_consensus.cc:2749] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.093526  3636 consensus_queue.cc:1048] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.079149  3545 leader_election.cc:290] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:29.079815  3234 leader_election.cc:343] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.084514  3552 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.097676  3552 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.097256  3540 ts_tablet_manager.cc:1434] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.129s	user 0.010s	sys 0.000s
W20260709 13:15:29.098260  3234 leader_election.cc:343] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.098795  3234 leader_election.cc:304] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:29.100113  3540 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:29.100211  3573 raft_consensus.cc:2749] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.118242  3545 raft_consensus.cc:493] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.118969  3545 raft_consensus.cc:515] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.123057  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.124028  3573 consensus_queue.cc:1048] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:29.124850  3455 leader_election.cc:343] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.125499  3540 tablet_bootstrap.cc:654] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.102313  3635 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.139271  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.104755  3538 tablet_bootstrap.cc:654] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.140139  3417 raft_consensus.cc:2468] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:29.140568  3635 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:29.102931  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:29.142921  3545 leader_election.cc:290] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:29.143021  3610 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.150765  3610 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.148624  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:29.154660  3489 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.156792  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:29.157402  3342 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.160387  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.166529  3267 raft_consensus.cc:2393] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 9f99770bc87e426a893fc425299485cc in this term.
I20260709 13:15:29.171036  3489 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:29.173254  3235 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:29.174220  3457 leader_election.cc:304] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.176270  3682 raft_consensus.cc:2804] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.176828  3682 raft_consensus.cc:493] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.177241  3682 raft_consensus.cc:3060] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.160043  3610 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:29.179816  3552 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.181046  3341 raft_consensus.cc:1240] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Rejecting Update request from peer 6861cafc7c054539ab0c01ec4986d417 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:29.147639  3269 raft_consensus.cc:3060] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.128046  3537 ts_tablet_manager.cc:1434] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.001s
I20260709 13:15:29.128535  3573 consensus_queue.cc:1048] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.130328  3539 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:29.186497  3539 ts_tablet_manager.cc:1403] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.256s	user 0.027s	sys 0.044s
I20260709 13:15:29.186656  3636 raft_consensus.cc:2804] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.187261  3636 raft_consensus.cc:697] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:29.187822  3537 tablet_bootstrap.cc:492] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:29.188110  3636 consensus_queue.cc:237] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.190384  3539 raft_consensus.cc:359] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.191810  3539 raft_consensus.cc:385] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.192232  3539 raft_consensus.cc:740] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.193185  3539 consensus_queue.cc:260] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.192009  3653 consensus_queue.cc:1059] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:29.195549  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:29.195832  3653 raft_consensus.cc:3055] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.196260  3653 raft_consensus.cc:740] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:29.185731  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.198951  3489 raft_consensus.cc:2393] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 9f99770bc87e426a893fc425299485cc in this term.
I20260709 13:15:29.197085  3653 consensus_queue.cc:260] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.196715  3538 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:29.199843  3653 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.197845  3682 raft_consensus.cc:515] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.201305  3538 ts_tablet_manager.cc:1403] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.002s
I20260709 13:15:29.196513  3539 ts_tablet_manager.cc:1434] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:29.199903  3342 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:29.207309  3552 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:29.208628  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:29.210547  3309 leader_election.cc:304] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:29.215793  3552 raft_consensus.cc:2749] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:29.222715  3539 tablet_bootstrap.cc:492] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:29.250327  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
W20260709 13:15:29.256515  3455 leader_election.cc:343] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.263172  3682 leader_election.cc:290] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:29.206373  3538 raft_consensus.cc:359] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.300376  3538 raft_consensus.cc:385] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.300827  3538 raft_consensus.cc:740] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.311193  3537 tablet_bootstrap.cc:654] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.319330  3538 consensus_queue.cc:260] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.320417  3539 tablet_bootstrap.cc:654] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.326400  3310 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.328370  3552 raft_consensus.cc:2749] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.329276  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:29.329821  3418 raft_consensus.cc:3060] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.343490  3418 raft_consensus.cc:2468] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:29.345353  3457 leader_election.cc:304] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.346557  3653 raft_consensus.cc:2804] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.347106  3653 raft_consensus.cc:697] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:29.348260  3653 consensus_queue.cc:237] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.370085  3269 raft_consensus.cc:2468] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:29.372566  3540 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:29.373334  3540 ts_tablet_manager.cc:1403] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.274s	user 0.085s	sys 0.063s
I20260709 13:15:29.377995  3538 ts_tablet_manager.cc:1434] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.176s	user 0.011s	sys 0.000s
I20260709 13:15:29.367937  3680 raft_consensus.cc:493] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.379405  3538 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:29.382321  3680 raft_consensus.cc:515] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.386240  3680 leader_election.cc:290] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.386358  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.386965  3538 tablet_bootstrap.cc:654] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.387221  3489 raft_consensus.cc:2468] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:29.388497  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:29.390223  3383 leader_election.cc:343] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.392346  3455 leader_election.cc:304] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:29.393622  3682 raft_consensus.cc:2804] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.394317  3682 raft_consensus.cc:697] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:29.394547  3384 leader_election.cc:304] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:29.395610  3682 consensus_queue.cc:237] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.399192  3680 raft_consensus.cc:2804] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.399652  3680 raft_consensus.cc:493] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.400014  3680 raft_consensus.cc:3060] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.405897  3540 raft_consensus.cc:359] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.407563  3540 raft_consensus.cc:385] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.407903  3540 raft_consensus.cc:740] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.408708  3540 consensus_queue.cc:260] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.411552  3540 ts_tablet_manager.cc:1434] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:15:29.412786  3540 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:29.415894  3680 raft_consensus.cc:515] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.419324  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:29.420993  3540 tablet_bootstrap.cc:654] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:29.420975  3383 leader_election.cc:343] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.427250  3537 tablet_bootstrap.cc:492] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:29.428036  3537 ts_tablet_manager.cc:1403] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.240s	user 0.014s	sys 0.015s
I20260709 13:15:29.432248  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:29.433125  3489 raft_consensus.cc:3060] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.436667  3539 tablet_bootstrap.cc:492] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:29.437217  3539 ts_tablet_manager.cc:1403] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.235s	user 0.014s	sys 0.009s
I20260709 13:15:29.440004  3165 catalog_manager.cc:5697] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.448848  3680 leader_election.cc:290] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.440014  3537 raft_consensus.cc:359] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.451529  3537 raft_consensus.cc:385] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.451948  3537 raft_consensus.cc:740] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.453003  3537 consensus_queue.cc:260] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.453997  3680 raft_consensus.cc:493] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.454689  3680 raft_consensus.cc:515] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.456750  3537 ts_tablet_manager.cc:1434] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:15:29.457459  3680 leader_election.cc:290] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:29.460981  3537 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:29.445247  3489 raft_consensus.cc:2468] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:29.463718  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.464871  3384 leader_election.cc:304] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:29.464931  3166 catalog_manager.cc:5697] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.466841  3680 raft_consensus.cc:2804] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.467391  3680 raft_consensus.cc:697] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:29.468348  3680 consensus_queue.cc:237] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.472976  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.473888  3269 raft_consensus.cc:2468] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:29.462821  3539 raft_consensus.cc:359] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.476881  3539 raft_consensus.cc:385] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.477245  3539 raft_consensus.cc:740] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.478188  3539 consensus_queue.cc:260] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.481213  3381 leader_election.cc:304] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:29.485306  3538 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:29.486114  3538 ts_tablet_manager.cc:1403] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.107s	user 0.039s	sys 0.031s
I20260709 13:15:29.489374  3540 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:29.489895  3625 raft_consensus.cc:2804] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.490305  3625 raft_consensus.cc:493] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.490139  3540 ts_tablet_manager.cc:1403] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.013s
I20260709 13:15:29.482949  3539 ts_tablet_manager.cc:1434] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.002s
I20260709 13:15:29.491142  3625 raft_consensus.cc:3060] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.492117  3539 tablet_bootstrap.cc:492] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:29.494650  3540 raft_consensus.cc:359] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.489287  3538 raft_consensus.cc:359] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.495321  3540 raft_consensus.cc:385] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.495589  3538 raft_consensus.cc:385] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.495893  3538 raft_consensus.cc:740] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.495767  3540 raft_consensus.cc:740] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.496687  3538 consensus_queue.cc:260] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.496963  3540 consensus_queue.cc:260] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.498059  3538 ts_tablet_manager.cc:1434] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:15:29.499428  3538 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:29.499456  3540 ts_tablet_manager.cc:1434] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:15:29.500681  3540 tablet_bootstrap.cc:492] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
W20260709 13:15:29.486140  3384 leader_election.cc:343] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.507002  3538 tablet_bootstrap.cc:654] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.507200  3540 tablet_bootstrap.cc:654] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.520289  3539 tablet_bootstrap.cc:654] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.521624  3636 raft_consensus.cc:493] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.522702  3636 raft_consensus.cc:515] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.525067  3636 leader_election.cc:290] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:29.526813  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.528119  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.529004  3537 tablet_bootstrap.cc:654] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:29.528301  3234 leader_election.cc:343] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.531097  3234 leader_election.cc:343] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.531481  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:29.531587  3234 leader_election.cc:304] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:29.533695  3625 raft_consensus.cc:515] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.535112  3538 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:29.535645  3538 ts_tablet_manager.cc:1403] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.005s
I20260709 13:15:29.535754  3636 raft_consensus.cc:2749] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.534240  3680 raft_consensus.cc:493] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.537201  3680 raft_consensus.cc:515] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.537497  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:29.539134  3538 raft_consensus.cc:359] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.541817  3680 leader_election.cc:290] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.541018  3682 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.542901  3538 raft_consensus.cc:385] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.543231  3538 raft_consensus.cc:740] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.543262  3682 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.544139  3538 consensus_queue.cc:260] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.546005  3682 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:29.546648  3538 ts_tablet_manager.cc:1434] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:15:29.541313  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.547748  3538 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:29.549500  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:29.551182  3383 leader_election.cc:343] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.552251  3457 leader_election.cc:343] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.539392  3384 leader_election.cc:343] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.554855  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.555455  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.556360  3491 raft_consensus.cc:2468] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
W20260709 13:15:29.556476  3455 leader_election.cc:343] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.558107  3455 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.558682  3384 leader_election.cc:304] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:29.559640  3680 raft_consensus.cc:2804] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.559696  3682 raft_consensus.cc:2749] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.560144  3680 raft_consensus.cc:493] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.560590  3680 raft_consensus.cc:3060] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.560868  3537 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:29.561388  3537 ts_tablet_manager.cc:1403] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.002s
I20260709 13:15:29.564348  3537 raft_consensus.cc:359] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.565086  3537 raft_consensus.cc:385] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.565164  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:29.565412  3537 raft_consensus.cc:740] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.565851  3269 raft_consensus.cc:3060] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.566258  3537 consensus_queue.cc:260] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.568066  3539 tablet_bootstrap.cc:492] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:29.568681  3539 ts_tablet_manager.cc:1403] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.006s
I20260709 13:15:29.569048  3537 ts_tablet_manager.cc:1434] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:29.570113  3537 tablet_bootstrap.cc:492] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:29.572543  3680 raft_consensus.cc:515] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.573755  3538 tablet_bootstrap.cc:654] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.575560  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:29.576926  3539 raft_consensus.cc:359] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.577476  3537 tablet_bootstrap.cc:654] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:29.577400  3383 leader_election.cc:343] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.579164  3539 raft_consensus.cc:385] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.580232  3539 raft_consensus.cc:740] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.580363  3269 raft_consensus.cc:2468] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:29.580863  3625 leader_election.cc:290] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:29.579809  3540 tablet_bootstrap.cc:492] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:29.584378  3540 ts_tablet_manager.cc:1403] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.005s
I20260709 13:15:29.581575  3680 leader_election.cc:290] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.581665  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:29.588501  3491 raft_consensus.cc:3060] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.589664  3381 leader_election.cc:304] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:29.591946  3680 raft_consensus.cc:2804] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.592445  3680 raft_consensus.cc:697] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:29.593315  3680 consensus_queue.cc:237] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.597657  3573 consensus_queue.cc:1048] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.585011  3539 consensus_queue.cc:260] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.599539  3491 raft_consensus.cc:2468] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:29.600203  3539 ts_tablet_manager.cc:1434] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:15:29.601248  3539 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:29.603236  3538 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:29.603749  3538 ts_tablet_manager.cc:1403] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.001s
I20260709 13:15:29.609390  3538 raft_consensus.cc:359] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.610049  3538 raft_consensus.cc:385] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.610320  3538 raft_consensus.cc:740] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.612829  3166 catalog_manager.cc:5697] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.617219  3538 consensus_queue.cc:260] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.618050  3625 raft_consensus.cc:493] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.618597  3625 raft_consensus.cc:515] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.587853  3540 raft_consensus.cc:359] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.621675  3540 raft_consensus.cc:385] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.622191  3540 raft_consensus.cc:740] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.621609  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.623020  3540 consensus_queue.cc:260] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.624312  3573 raft_consensus.cc:493] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:29.624751  3383 leader_election.cc:343] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.625049  3540 ts_tablet_manager.cc:1434] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:15:29.624828  3573 raft_consensus.cc:515] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.625386  3537 tablet_bootstrap.cc:492] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:29.622845  3384 leader_election.cc:304] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:29.626421  3540 tablet_bootstrap.cc:492] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:29.626559  3622 raft_consensus.cc:2804] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.627202  3573 leader_election.cc:290] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:29.628711  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.629492  3414 raft_consensus.cc:2468] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:29.619971  3538 ts_tablet_manager.cc:1434] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:29.631141  3538 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:29.631757  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.632419  3340 raft_consensus.cc:2468] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:29.630975  3234 leader_election.cc:304] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:29.634009  3540 tablet_bootstrap.cc:654] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.637506  3539 tablet_bootstrap.cc:654] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.639382  3537 ts_tablet_manager.cc:1403] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.001s
I20260709 13:15:29.638502  3573 raft_consensus.cc:2804] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.640551  3573 raft_consensus.cc:493] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.640985  3573 raft_consensus.cc:3060] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.649912  3538 tablet_bootstrap.cc:654] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.651096  3537 raft_consensus.cc:359] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.652114  3537 raft_consensus.cc:385] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.652273  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.652530  3537 raft_consensus.cc:740] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
W20260709 13:15:29.653941  3384 leader_election.cc:343] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.654469  3384 leader_election.cc:304] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:29.651577  3625 leader_election.cc:290] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.653517  3537 consensus_queue.cc:260] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.670516  3637 raft_consensus.cc:493] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.671092  3637 raft_consensus.cc:515] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.673339  3637 leader_election.cc:290] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.675122  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.675990  3414 raft_consensus.cc:2393] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f99770bc87e426a893fc425299485cc in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:29.679370  3537 ts_tablet_manager.cc:1434] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:15:29.682127  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.683041  3537 tablet_bootstrap.cc:492] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:29.677695  3573 raft_consensus.cc:515] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.663290  3625 raft_consensus.cc:2749] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.685122  3235 leader_election.cc:304] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:29.692646  3637 raft_consensus.cc:3060] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.701884  3537 tablet_bootstrap.cc:654] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.690403  3622 raft_consensus.cc:697] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:29.714480  3573 leader_election.cc:290] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:29.715550  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:29.716718  3540 tablet_bootstrap.cc:492] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:29.717242  3540 ts_tablet_manager.cc:1403] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.003s
I20260709 13:15:29.719200  3539 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:29.719904  3539 ts_tablet_manager.cc:1403] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.119s	user 0.032s	sys 0.010s
I20260709 13:15:29.719938  3165 catalog_manager.cc:5697] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.721885  3165 catalog_manager.cc:5697] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.716230  3414 raft_consensus.cc:3060] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.719491  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:29.725013  3343 raft_consensus.cc:3060] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.729522  3538 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:29.730082  3538 ts_tablet_manager.cc:1403] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.099s	user 0.006s	sys 0.015s
I20260709 13:15:29.732731  3414 raft_consensus.cc:2468] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:29.733271  3538 raft_consensus.cc:359] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.734063  3234 leader_election.cc:304] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:29.738965  3538 raft_consensus.cc:385] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.739355  3538 raft_consensus.cc:740] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.739576  3622 consensus_queue.cc:237] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.740129  3538 consensus_queue.cc:260] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.727792  3539 raft_consensus.cc:359] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.741629  3539 raft_consensus.cc:385] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.741994  3539 raft_consensus.cc:740] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.742869  3539 consensus_queue.cc:260] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.743844  3573 raft_consensus.cc:2804] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.744385  3573 raft_consensus.cc:697] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:29.744457  3540 raft_consensus.cc:359] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.745252  3540 raft_consensus.cc:385] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.745574  3540 raft_consensus.cc:740] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.745471  3635 consensus_queue.cc:1048] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.745345  3573 consensus_queue.cc:237] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.746632  3540 consensus_queue.cc:260] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.746040  3682 raft_consensus.cc:493] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.747932  3682 raft_consensus.cc:515] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.749048  3540 ts_tablet_manager.cc:1434] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:15:29.750195  3540 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:29.750223  3682 leader_election.cc:290] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:29.752295  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.753178  3269 raft_consensus.cc:2393] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 1: Already voted for candidate 680bff02deaf497e885eb83e37cca726 in this term.
I20260709 13:15:29.754992  3538 ts_tablet_manager.cc:1434] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.003s
I20260709 13:15:29.758880  3539 ts_tablet_manager.cc:1434] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:15:29.759865  3539 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:29.759534  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9f3f51f57b4c42b5063ccb7f51ccda" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.761324  3457 leader_election.cc:304] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.768132  3538 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:29.771646  3682 raft_consensus.cc:3060] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.777817  3539 tablet_bootstrap.cc:654] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.770942  3637 raft_consensus.cc:2749] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.797780  3540 tablet_bootstrap.cc:654] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.791536  3343 raft_consensus.cc:2468] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:29.802392  3552 raft_consensus.cc:493] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.804116  3552 raft_consensus.cc:515] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.814845  3653 consensus_queue.cc:1048] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:29.816784  3343 raft_consensus.cc:3060] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.827414  3552 leader_election.cc:290] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:29.828097  3552 raft_consensus.cc:493] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.828197  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.828713  3165 catalog_manager.cc:5697] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.829698  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.830524  3269 raft_consensus.cc:2393] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:29.830215  3552 raft_consensus.cc:515] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.831894  3307 leader_election.cc:304] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:29.832397  3552 leader_election.cc:290] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.833518  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba85e8b48b84b388c287165e85c21e3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:29.835137  3310 leader_election.cc:343] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.840617  3537 tablet_bootstrap.cc:492] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:29.841394  3537 ts_tablet_manager.cc:1403] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.159s	user 0.010s	sys 0.020s
I20260709 13:15:29.843551  3538 tablet_bootstrap.cc:654] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.846695  3682 raft_consensus.cc:2749] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:29.853268  3455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 47187us
I20260709 13:15:29.854592  3719 raft_consensus.cc:493] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.855837  3719 raft_consensus.cc:515] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.857812  3539 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:29.858400  3539 ts_tablet_manager.cc:1403] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.002s
I20260709 13:15:29.858188  3719 leader_election.cc:290] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:29.867661  3682 consensus_queue.cc:1048] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.860634  3552 raft_consensus.cc:2749] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.876240  3537 raft_consensus.cc:359] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.879042  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.880873  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba85e8b48b84b388c287165e85c21e3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.884191  3537 raft_consensus.cc:385] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.884567  3537 raft_consensus.cc:740] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.884779  3269 raft_consensus.cc:2468] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:29.885440  3537 consensus_queue.cc:260] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:29.885823  3309 leader_election.cc:343] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.886365  3381 leader_election.cc:304] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:29.887074  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:29.887612  3716 raft_consensus.cc:2804] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.887650  3309 leader_election.cc:304] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:29.888172  3716 raft_consensus.cc:493] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.888585  3716 raft_consensus.cc:3060] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:29.888904  3383 leader_election.cc:343] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.892369  3637 raft_consensus.cc:493] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.892905  3637 raft_consensus.cc:515] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:29.900955  3540 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:29.901574  3540 ts_tablet_manager.cc:1403] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.017s
I20260709 13:15:29.901926  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.903399  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:29.903533  3234 leader_election.cc:343] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.901958  3637 leader_election.cc:290] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.905154  3540 raft_consensus.cc:359] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.906401  3540 raft_consensus.cc:385] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.906840  3540 raft_consensus.cc:740] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.907794  3540 consensus_queue.cc:260] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.910425  3540 ts_tablet_manager.cc:1434] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:15:29.911383  3726 consensus_queue.cc:1048] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:29.905859  3235 leader_election.cc:343] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.914340  3537 ts_tablet_manager.cc:1434] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 13:15:29.915403  3540 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:29.886140  3539 raft_consensus.cc:359] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.919482  3539 raft_consensus.cc:385] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.919885  3539 raft_consensus.cc:740] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.920884  3539 consensus_queue.cc:260] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.922516  3727 raft_consensus.cc:2749] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.924347  3235 leader_election.cc:304] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:29.925977  3637 raft_consensus.cc:2749] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.926920  3716 raft_consensus.cc:515] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.928788  3540 tablet_bootstrap.cc:654] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.930038  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:29.930778  3268 raft_consensus.cc:3060] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.940739  3268 raft_consensus.cc:2468] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:29.943039  3552 raft_consensus.cc:493] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.943590  3552 raft_consensus.cc:515] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:29.943743  3381 leader_election.cc:304] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:29.945047  3719 raft_consensus.cc:2804] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.945677  3719 raft_consensus.cc:697] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:29.946851  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:29.946789  3719 consensus_queue.cc:237] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.947739  3491 raft_consensus.cc:2393] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 680bff02deaf497e885eb83e37cca726 in this term.
I20260709 13:15:29.915726  3537 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:29.956174  3552 leader_election.cc:290] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:29.957381  3540 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:29.958030  3540 ts_tablet_manager.cc:1403] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 13:15:29.957634  3165 catalog_manager.cc:5697] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.961620  3540 raft_consensus.cc:359] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.964387  3539 ts_tablet_manager.cc:1434] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 13:15:29.966971  3539 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:29.970247  3538 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:29.971104  3538 ts_tablet_manager.cc:1403] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.209s	user 0.029s	sys 0.016s
I20260709 13:15:29.972311  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
W20260709 13:15:29.973875  3383 leader_election.cc:343] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.974232  3538 raft_consensus.cc:359] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.974997  3538 raft_consensus.cc:385] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.975281  3538 raft_consensus.cc:740] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.962329  3540 raft_consensus.cc:385] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.976004  3540 raft_consensus.cc:740] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.976966  3540 consensus_queue.cc:260] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:29.979105  3716 leader_election.cc:290] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:29.980986  3727 raft_consensus.cc:493] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.983433  3727 raft_consensus.cc:515] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.984750  3537 tablet_bootstrap.cc:654] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:29.968487  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 82713.4us
I20260709 13:15:29.980618  3540 ts_tablet_manager.cc:1434] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:29.987113  3540 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:29.981601  3538 consensus_queue.cc:260] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:29.989486  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306de156a5b14b259e6a51aafedf1579" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:29.991227  3309 leader_election.cc:304] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:29.991256  3163 catalog_manager.cc:5697] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.993701  3552 raft_consensus.cc:3060] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.995138  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:29.995879  3268 raft_consensus.cc:2468] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:30.000463  3726 consensus_queue.cc:1048] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.002944  3540 tablet_bootstrap.cc:654] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.004563  3637 raft_consensus.cc:493] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.005155  3637 raft_consensus.cc:515] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.007143  3539 tablet_bootstrap.cc:654] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.009784  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.010720  3491 raft_consensus.cc:2468] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:30.012998  3235 leader_election.cc:304] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:30.014066  3635 raft_consensus.cc:2804] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.014523  3635 raft_consensus.cc:493] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.005470  3552 raft_consensus.cc:2749] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.014844  3637 leader_election.cc:290] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.014876  3635 raft_consensus.cc:3060] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.030296  3307 leader_election.cc:304] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:30.030469  3622 consensus_queue.cc:1048] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.032421  3538 ts_tablet_manager.cc:1434] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:15:30.034811  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.035571  3418 raft_consensus.cc:2468] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:30.031476  3719 consensus_queue.cc:1048] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:30.041721  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.034197  3552 raft_consensus.cc:2804] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.042425  3343 raft_consensus.cc:2468] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:30.048202  3635 raft_consensus.cc:515] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.032859  3727 leader_election.cc:290] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:30.043146  3552 raft_consensus.cc:493] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.060307  3538 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:30.071264  3719 consensus_queue.cc:1048] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:30.085047  3635 leader_election.cc:290] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.087109  3552 raft_consensus.cc:3060] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.092408  3682 raft_consensus.cc:493] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.096477  3682 raft_consensus.cc:515] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.101274  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:30.102181  3343 raft_consensus.cc:3060] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.102783  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:30.103658  3492 raft_consensus.cc:3060] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.111220  3682 leader_election.cc:290] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:30.113955  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.114987  3418 raft_consensus.cc:2468] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:30.117491  3457 leader_election.cc:304] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:30.120224  3719 consensus_queue.cc:1048] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.125658  3540 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:30.126225  3540 ts_tablet_manager.cc:1403] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.139s	user 0.040s	sys 0.082s
I20260709 13:15:30.129964  3538 tablet_bootstrap.cc:654] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.132884  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.140934  3726 raft_consensus.cc:2804] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.160872  3537 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:30.161666  3537 ts_tablet_manager.cc:1403] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.246s	user 0.024s	sys 0.038s
I20260709 13:15:30.143812  3622 raft_consensus.cc:493] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.145687  3457 leader_election.cc:343] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.138266  3552 raft_consensus.cc:515] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.159025  3726 raft_consensus.cc:493] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.176808  3540 raft_consensus.cc:359] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.177594  3540 raft_consensus.cc:385] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.177860  3540 raft_consensus.cc:740] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.178040  3539 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:30.179039  3539 ts_tablet_manager.cc:1403] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.212s	user 0.010s	sys 0.008s
I20260709 13:15:30.178987  3540 consensus_queue.cc:260] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.178597  3653 raft_consensus.cc:493] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.172832  3726 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.187569  3540 ts_tablet_manager.cc:1434] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.002s
I20260709 13:15:30.188910  3540 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:30.191432  3343 raft_consensus.cc:2468] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:30.191779  3653 raft_consensus.cc:515] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.194036  3653 leader_election.cc:290] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:30.167419  3622 raft_consensus.cc:515] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.203958  3622 leader_election.cc:290] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.204679  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:30.207042  3492 raft_consensus.cc:2468] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:30.218994  3537 raft_consensus.cc:359] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.219695  3537 raft_consensus.cc:385] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.219887  3537 raft_consensus.cc:740] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.221971  3540 tablet_bootstrap.cc:654] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.212671  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15c7b44e85542b696746192c0ff0d5b" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.211251  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15c7b44e85542b696746192c0ff0d5b" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.212378  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.207073  3267 raft_consensus.cc:2468] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:30.250111  3537 consensus_queue.cc:260] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:30.220515  3383 consensus_peers.cc:597] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.256349  3234 leader_election.cc:304] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:30.260221  3539 raft_consensus.cc:359] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.265074  3552 leader_election.cc:290] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:30.269222  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:30.269822  3726 raft_consensus.cc:515] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.274123  3539 raft_consensus.cc:385] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:30.273936  3383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 55829.2us
W20260709 13:15:30.277897  3457 leader_election.cc:343] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:30.280020  3383 leader_election.cc:343] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.277073  3539 raft_consensus.cc:740] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
W20260709 13:15:30.280053  3457 leader_election.cc:343] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.282269  3457 leader_election.cc:304] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:30.287786  3573 raft_consensus.cc:2804] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.288214  3537 ts_tablet_manager.cc:1434] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.002s
I20260709 13:15:30.288604  3573 raft_consensus.cc:697] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:30.288831  3539 consensus_queue.cc:260] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.289896  3573 consensus_queue.cc:237] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.289462  3537 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:30.285813  3653 raft_consensus.cc:2749] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.294023  3539 ts_tablet_manager.cc:1434] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.114s	user 0.011s	sys 0.001s
I20260709 13:15:30.280872  3268 raft_consensus.cc:3060] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.300732  3726 leader_election.cc:290] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:30.302389  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:30.302506  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:30.303198  3414 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.298313  3539 tablet_bootstrap.cc:492] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:30.281024  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
W20260709 13:15:30.310932  3457 leader_election.cc:343] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.309631  3418 raft_consensus.cc:3060] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.317878  3414 raft_consensus.cc:2468] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:30.318809  3268 raft_consensus.cc:2468] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:30.319700  3726 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.320217  3726 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.321236  3381 leader_election.cc:304] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:30.322227  3716 raft_consensus.cc:2804] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.322669  3716 raft_consensus.cc:493] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.323028  3716 raft_consensus.cc:3060] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.323182  3457 leader_election.cc:304] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
W20260709 13:15:30.299079  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 75169.8us
I20260709 13:15:30.338855  3538 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:30.339391  3538 ts_tablet_manager.cc:1403] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.306s	user 0.027s	sys 0.014s
I20260709 13:15:30.339529  3682 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.340241  3682 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.342435  3538 raft_consensus.cc:359] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.343204  3538 raft_consensus.cc:385] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.343466  3538 raft_consensus.cc:740] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.344092  3538 consensus_queue.cc:260] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.346794  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:30.334586  3653 raft_consensus.cc:2804] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.349500  3653 raft_consensus.cc:697] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:30.350642  3719 consensus_queue.cc:1048] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.354266  3538 ts_tablet_manager.cc:1434] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:15:30.355263  3682 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.356382  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.357105  3340 raft_consensus.cc:2468] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:30.358371  3418 raft_consensus.cc:2468] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:30.358467  3457 leader_election.cc:304] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:30.364444  3307 leader_election.cc:304] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
W20260709 13:15:30.367931  3455 leader_election.cc:343] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.369350  3552 raft_consensus.cc:2804] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.369906  3552 raft_consensus.cc:697] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:30.370623  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.370886  3552 consensus_queue.cc:237] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.367004  3635 consensus_queue.cc:1048] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.330228  3726 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.350365  3653 consensus_queue.cc:237] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:30.387213  3457 leader_election.cc:343] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.387770  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.388100  3726 raft_consensus.cc:2804] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:30.388669  3726 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.389063  3726 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.387693  3457 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:30.364354  3538 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:30.378121  3166 catalog_manager.cc:5697] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.395539  3539 tablet_bootstrap.cc:654] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.449067  3163 catalog_manager.cc:5697] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.401443  3682 raft_consensus.cc:2749] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.453104  3538 tablet_bootstrap.cc:654] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.402473  3719 consensus_queue.cc:1048] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260709 13:15:30.409416  3540 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:30.426640  3727 raft_consensus.cc:493] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.456564  3540 ts_tablet_manager.cc:1403] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.268s	user 0.035s	sys 0.035s
I20260709 13:15:30.456840  3727 raft_consensus.cc:515] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.458361  3716 raft_consensus.cc:515] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.459357  3727 leader_election.cc:290] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:30.441970  3622 raft_consensus.cc:493] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.460366  3622 raft_consensus.cc:515] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.460738  3716 leader_election.cc:290] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.461671  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:30.434985  3635 consensus_queue.cc:1048] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:15:30.463410  3540 raft_consensus.cc:359] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.464088  3540 raft_consensus.cc:385] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.464149  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.464752  3622 leader_election.cc:290] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:30.464463  3540 raft_consensus.cc:740] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.466220  3540 consensus_queue.cc:260] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.466810  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:30.467582  3269 raft_consensus.cc:2468] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:30.432837  3726 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:30.468931  3384 leader_election.cc:343] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.469213  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:30.469925  3268 raft_consensus.cc:3060] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.472154  3342 raft_consensus.cc:3060] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.472575  3381 leader_election.cc:304] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:30.473855  3622 raft_consensus.cc:2804] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.474241  3622 raft_consensus.cc:493] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.474957  3622 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.478946  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:30.479681  3341 raft_consensus.cc:3060] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.468994  3540 ts_tablet_manager.cc:1434] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:15:30.486016  3540 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:30.484560  3537 tablet_bootstrap.cc:654] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.493225  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:30.497566  3538 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:30.498097  3538 ts_tablet_manager.cc:1403] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.134s	user 0.005s	sys 0.009s
I20260709 13:15:30.502717  3622 raft_consensus.cc:515] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.504009  3680 consensus_queue.cc:1048] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.505946  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
W20260709 13:15:30.507315  3384 leader_election.cc:343] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.506573  3166 catalog_manager.cc:5697] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.511780  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57df44e281f46d2844b50c4302bc52c" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.511198  3726 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.514945  3341 raft_consensus.cc:2468] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:30.526690  3537 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:30.514753  3538 raft_consensus.cc:359] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.527191  3538 raft_consensus.cc:385] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.519869  3540 tablet_bootstrap.cc:654] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.527704  3538 raft_consensus.cc:740] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.523221  3309 leader_election.cc:304] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:30.529994  3538 consensus_queue.cc:260] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.532135  3727 raft_consensus.cc:2749] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.525938  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:30.540313  3340 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.525816  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:30.544305  3538 ts_tablet_manager.cc:1434] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:15:30.545825  3538 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:30.517014  3539 tablet_bootstrap.cc:492] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:30.553328  3539 ts_tablet_manager.cc:1403] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.255s	user 0.020s	sys 0.000s
I20260709 13:15:30.523510  3622 leader_election.cc:290] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:30.521409  3268 raft_consensus.cc:2468] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:30.544356  3269 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.528985  3383 leader_election.cc:304] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:30.558486  3757 raft_consensus.cc:2804] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.559105  3757 raft_consensus.cc:697] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:30.560060  3757 consensus_queue.cc:237] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:30.562732  3538 tablet_bootstrap.cc:654] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.566771  3269 raft_consensus.cc:2468] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:30.566856  3539 raft_consensus.cc:359] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.567947  3539 raft_consensus.cc:385] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.568094  3381 leader_election.cc:304] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:30.569757  3622 raft_consensus.cc:2804] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.568310  3539 raft_consensus.cc:740] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.570502  3622 raft_consensus.cc:697] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:30.571110  3539 consensus_queue.cc:260] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.571395  3622 consensus_queue.cc:237] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.527273  3537 ts_tablet_manager.cc:1403] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.238s	user 0.031s	sys 0.013s
I20260709 13:15:30.574456  3539 ts_tablet_manager.cc:1434] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:15:30.575534  3539 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:30.578143  3537 raft_consensus.cc:359] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.578904  3537 raft_consensus.cc:385] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.579209  3537 raft_consensus.cc:740] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.580008  3537 consensus_queue.cc:260] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.572904  3540 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:30.583146  3540 ts_tablet_manager.cc:1403] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.003s
I20260709 13:15:30.586522  3540 raft_consensus.cc:359] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.587193  3540 raft_consensus.cc:385] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.587507  3540 raft_consensus.cc:740] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.588244  3540 consensus_queue.cc:260] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.591902  3538 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:30.592507  3538 ts_tablet_manager.cc:1403] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.005s
I20260709 13:15:30.552482  3340 raft_consensus.cc:2468] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 3.
I20260709 13:15:30.595853  3457 leader_election.cc:304] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:30.597198  3726 raft_consensus.cc:2804] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:30.596910  3538 raft_consensus.cc:359] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.597747  3726 raft_consensus.cc:697] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 3 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:30.598084  3539 tablet_bootstrap.cc:654] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.598773  3726 consensus_queue.cc:237] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.597803  3538 raft_consensus.cc:385] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.601199  3538 raft_consensus.cc:740] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.602090  3538 consensus_queue.cc:260] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.602702  3757 raft_consensus.cc:493] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6861cafc7c054539ab0c01ec4986d417)
I20260709 13:15:30.603288  3757 raft_consensus.cc:515] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.605067  3538 ts_tablet_manager.cc:1434] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:15:30.606069  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:30.607430  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.609325  3538 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:30.609421  3757 leader_election.cc:290] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.582397  3537 ts_tablet_manager.cc:1434] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 13:15:30.610338  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f35a48457c46878dc583515c065166" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.610864  3537 tablet_bootstrap.cc:492] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:30.613159  3540 ts_tablet_manager.cc:1434] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:15:30.614197  3540 tablet_bootstrap.cc:492] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:30.616199  3340 raft_consensus.cc:2368] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 for earlier term 2. Current term is 3.
I20260709 13:15:30.617652  3383 leader_election.cc:400] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607) with higher term. Message: Invalid argument: T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 for earlier term 2. Current term is 3.
I20260709 13:15:30.618016  3383 leader_election.cc:403] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:30.619035  3757 raft_consensus.cc:3060] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.620139  3539 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:30.620662  3540 tablet_bootstrap.cc:654] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.620764  3539 ts_tablet_manager.cc:1403] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.000s
I20260709 13:15:30.625231  3538 tablet_bootstrap.cc:654] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.627739  3537 tablet_bootstrap.cc:654] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.626880  3539 raft_consensus.cc:359] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.628196  3539 raft_consensus.cc:385] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.628571  3539 raft_consensus.cc:740] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.631103  3539 consensus_queue.cc:260] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.629839  3757 raft_consensus.cc:2749] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607) with higher term. Message: Invalid argument: T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 for earlier term 2. Current term is 3.
I20260709 13:15:30.634160  3539 ts_tablet_manager.cc:1434] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:30.637243  3539 tablet_bootstrap.cc:492] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:30.644826  3537 tablet_bootstrap.cc:492] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:30.645620  3537 ts_tablet_manager.cc:1403] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260709 13:15:30.649735  3537 raft_consensus.cc:359] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.650694  3537 raft_consensus.cc:385] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.651074  3537 raft_consensus.cc:740] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.652097  3537 consensus_queue.cc:260] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.655383  3537 ts_tablet_manager.cc:1434] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.004s
I20260709 13:15:30.656836  3537 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:30.673235  3539 tablet_bootstrap.cc:654] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.673516  3538 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:30.676679  3538 ts_tablet_manager.cc:1403] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.031s
I20260709 13:15:30.679674  3537 tablet_bootstrap.cc:654] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.680125  3538 raft_consensus.cc:359] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.684104  3538 raft_consensus.cc:385] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.684617  3538 raft_consensus.cc:740] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.685667  3538 consensus_queue.cc:260] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.688949  3538 ts_tablet_manager.cc:1434] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:30.690394  3538 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:30.711229  3538 tablet_bootstrap.cc:654] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.724478  3538 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:30.726887  3538 ts_tablet_manager.cc:1403] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 13:15:30.730767  3635 consensus_queue.cc:1048] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.731382  3538 raft_consensus.cc:359] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.737390  3538 raft_consensus.cc:385] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.738410  3538 raft_consensus.cc:740] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.740029  3538 consensus_queue.cc:260] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.744741  3538 ts_tablet_manager.cc:1434] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:15:30.748754  3538 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:30.767546  3538 tablet_bootstrap.cc:654] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.770916  3167 catalog_manager.cc:5697] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.773428  3167 catalog_manager.cc:5697] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.781410  3726 consensus_queue.cc:1048] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.781780  3539 tablet_bootstrap.cc:492] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:30.782660  3539 ts_tablet_manager.cc:1403] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.146s	user 0.020s	sys 0.035s
I20260709 13:15:30.784147  3540 tablet_bootstrap.cc:492] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:30.784758  3540 ts_tablet_manager.cc:1403] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.171s	user 0.062s	sys 0.073s
I20260709 13:15:30.789407  3538 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:30.790113  3538 ts_tablet_manager.cc:1403] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.001s
I20260709 13:15:30.794278  3538 raft_consensus.cc:359] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.795254  3538 raft_consensus.cc:385] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.795625  3538 raft_consensus.cc:740] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.796514  3538 consensus_queue.cc:260] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.797917  3540 raft_consensus.cc:359] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.798066  3539 raft_consensus.cc:359] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.801260  3539 raft_consensus.cc:385] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.801632  3539 raft_consensus.cc:740] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.802490  3540 raft_consensus.cc:385] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.806913  3540 raft_consensus.cc:740] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.802631  3539 consensus_queue.cc:260] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.809392  3539 ts_tablet_manager.cc:1434] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:15:30.810511  3539 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:30.810351  3540 consensus_queue.cc:260] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.813033  3540 ts_tablet_manager.cc:1434] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:15:30.814198  3540 tablet_bootstrap.cc:492] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:30.817883  3539 tablet_bootstrap.cc:654] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.817080  3573 consensus_queue.cc:1048] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:30.818876  3165 catalog_manager.cc:5697] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.820933  3540 tablet_bootstrap.cc:654] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.805526  3537 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:30.805572  3748 raft_consensus.cc:493] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.822954  3748 raft_consensus.cc:515] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.825958  3748 leader_election.cc:290] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:30.800808  3538 ts_tablet_manager.cc:1434] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:30.827744  3538 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:30.827997  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03783871be14ed0a80c20c2be3e1b73" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.836205  3538 tablet_bootstrap.cc:654] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.837229  3552 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.837811  3552 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:30.839942  3234 leader_election.cc:343] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.845237  3727 consensus_queue.cc:1048] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.853132  3340 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.854293  3537 ts_tablet_manager.cc:1403] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.198s	user 0.072s	sys 0.048s
I20260709 13:15:30.857990  3537 raft_consensus.cc:359] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.858801  3537 raft_consensus.cc:385] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.859189  3537 raft_consensus.cc:740] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.859333  3573 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.859903  3573 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.860270  3537 consensus_queue.cc:260] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.863198  3537 ts_tablet_manager.cc:1434] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:30.864043  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.864424  3537 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:30.867877  3552 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:30.867563  3682 consensus_queue.cc:1048] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.868577  3342 raft_consensus.cc:2468] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:30.872629  3637 raft_consensus.cc:493] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.873960  3637 raft_consensus.cc:515] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:30.875566  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.876468  3637 leader_election.cc:290] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.876901  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:30.878613  3269 raft_consensus.cc:2468] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:30.876500  3489 raft_consensus.cc:2468] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:30.872937  3234 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:30.881927  3726 raft_consensus.cc:493] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.882179  3637 raft_consensus.cc:2804] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.882885  3637 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.882688  3726 raft_consensus.cc:515] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.883433  3637 raft_consensus.cc:3060] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.885625  3726 leader_election.cc:290] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:30.862174  3573 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:30.887665  3307 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:30.888886  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.892905  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba85e8b48b84b388c287165e85c21e3" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.894644  3343 raft_consensus.cc:2468] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:30.894840  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba85e8b48b84b388c287165e85c21e3" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.895643  3414 raft_consensus.cc:2468] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:30.893925  3552 raft_consensus.cc:2804] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.896461  3552 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.896848  3552 raft_consensus.cc:3060] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.898128  3757 raft_consensus.cc:493] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.898053  3234 leader_election.cc:343] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.898798  3757 raft_consensus.cc:515] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.909550  3537 tablet_bootstrap.cc:654] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.915918  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.916692  3492 raft_consensus.cc:2468] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:30.920109  3622 raft_consensus.cc:493] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.920640  3622 raft_consensus.cc:515] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:30.924026  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15c7b44e85542b696746192c0ff0d5b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:30.928547  3757 leader_election.cc:290] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:30.908594  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03783871be14ed0a80c20c2be3e1b73" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.929452  3489 raft_consensus.cc:2468] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
W20260709 13:15:30.931111  3383 leader_election.cc:343] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.934176  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.937577  3235 leader_election.cc:304] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:30.966557  3573 raft_consensus.cc:493] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.967733  3749 raft_consensus.cc:2804] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.967342  3573 raft_consensus.cc:515] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:30.970289  3573 leader_election.cc:290] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:30.968218  3749 raft_consensus.cc:493] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.906978  3457 leader_election.cc:304] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:30.973853  3749 raft_consensus.cc:3060] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.981305  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:30.996842  3726 raft_consensus.cc:2804] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.020218  3726 raft_consensus.cc:493] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.019861  3552 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.006858  3637 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.013234  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:30.998929  3622 leader_election.cc:290] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
W20260709 13:15:30.995709  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 91529.6us
I20260709 13:15:31.025683  3637 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:30.984710  3384 leader_election.cc:343] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.020673  3726 raft_consensus.cc:3060] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.026068  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:31.035517  3538 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:31.035450  3268 raft_consensus.cc:2468] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:31.036242  3538 ts_tablet_manager.cc:1403] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.209s	user 0.051s	sys 0.072s
I20260709 13:15:31.036319  3540 tablet_bootstrap.cc:492] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:31.037534  3540 ts_tablet_manager.cc:1403] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.224s	user 0.025s	sys 0.000s
I20260709 13:15:31.039590  3538 raft_consensus.cc:359] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:31.040295  3538 raft_consensus.cc:385] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.040575  3538 raft_consensus.cc:740] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.026602  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:31.041818  3540 raft_consensus.cc:359] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.041244  3538 consensus_queue.cc:260] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:31.042774  3540 raft_consensus.cc:385] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.042833  3340 raft_consensus.cc:2393] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f99770bc87e426a893fc425299485cc in current term 1: Already voted for candidate 2fbbf37a29b6416eb787ce4c9238e743 in this term.
I20260709 13:15:31.043294  3540 raft_consensus.cc:740] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.044523  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:31.044297  3540 consensus_queue.cc:260] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.045380  3489 raft_consensus.cc:3060] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:31.032876  3384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 49994.8us
I20260709 13:15:31.050848  3540 ts_tablet_manager.cc:1434] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:15:31.055002  3539 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:31.055655  3539 ts_tablet_manager.cc:1403] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.245s	user 0.037s	sys 0.037s
I20260709 13:15:31.055760  3540 tablet_bootstrap.cc:492] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:31.055990  3538 ts_tablet_manager.cc:1434] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:15:31.058754  3538 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:31.071400  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15c7b44e85542b696746192c0ff0d5b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:31.071966  3381 leader_election.cc:304] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:31.072206  3492 raft_consensus.cc:2468] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:31.073297  3716 raft_consensus.cc:2804] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.073733  3716 raft_consensus.cc:493] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.074100  3716 raft_consensus.cc:3060] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.074273  3492 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.076273  3384 leader_election.cc:304] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:31.077183  3757 raft_consensus.cc:2804] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.077589  3757 raft_consensus.cc:493] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.077950  3757 raft_consensus.cc:3060] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:31.079082  3235 leader_election.cc:343] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.079636  3235 leader_election.cc:304] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:31.080874  3538 tablet_bootstrap.cc:654] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.081249  3635 raft_consensus.cc:2749] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:31.060833  3234 leader_election.cc:343] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.082773  3573 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.058524  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:31.090030  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:31.110064  3540 tablet_bootstrap.cc:654] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.086169  3573 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.113412  3539 raft_consensus.cc:359] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.114029  3539 raft_consensus.cc:385] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.114274  3539 raft_consensus.cc:740] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.116070  3539 consensus_queue.cc:260] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.060371  3787 consensus_queue.cc:1048] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 13:15:31.094328  3552 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:31.086618  3622 consensus_queue.cc:1048] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:15:31.129732  3539 ts_tablet_manager.cc:1434] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:15:31.131992  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:31.132885  3269 raft_consensus.cc:2393] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 9f99770bc87e426a893fc425299485cc in this term.
I20260709 13:15:31.136401  3537 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:31.125128  3680 consensus_queue.cc:1048] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:15:31.137164  3537 ts_tablet_manager.cc:1403] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.273s	user 0.027s	sys 0.006s
I20260709 13:15:31.140652  3539 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:31.149258  3537 raft_consensus.cc:359] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.150096  3537 raft_consensus.cc:385] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.150496  3537 raft_consensus.cc:740] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.149626  3414 raft_consensus.cc:1275] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:31.151427  3537 consensus_queue.cc:260] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.155644  3545 consensus_queue.cc:1048] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:31.156286  3537 ts_tablet_manager.cc:1434] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.002s
I20260709 13:15:31.157660  3537 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:31.163812  3539 tablet_bootstrap.cc:654] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.167264  3537 tablet_bootstrap.cc:654] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.179873  3342 raft_consensus.cc:1275] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:31.181814  3545 consensus_queue.cc:1048] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:31.205884  3573 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:31.200800  3757 raft_consensus.cc:515] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.207335  3716 raft_consensus.cc:515] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.216876  3538 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:31.217417  3538 ts_tablet_manager.cc:1403] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.160s	user 0.023s	sys 0.029s
I20260709 13:15:31.217828  3716 leader_election.cc:290] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:31.219525  3726 raft_consensus.cc:515] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.221397  3540 tablet_bootstrap.cc:492] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:31.221436  3539 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:31.221208  3538 raft_consensus.cc:359] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.222148  3538 raft_consensus.cc:385] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.222285  3539 ts_tablet_manager.cc:1403] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.009s
I20260709 13:15:31.222180  3540 ts_tablet_manager.cc:1403] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.167s	user 0.016s	sys 0.001s
I20260709 13:15:31.222627  3538 raft_consensus.cc:740] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.223693  3538 consensus_queue.cc:260] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.225334  3538 ts_tablet_manager.cc:1434] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:15:31.226260  3538 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:31.225991  3540 raft_consensus.cc:359] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.226848  3540 raft_consensus.cc:385] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.227248  3540 raft_consensus.cc:740] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.228047  3540 consensus_queue.cc:260] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.229025  3749 raft_consensus.cc:515] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.230331  3726 leader_election.cc:290] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:31.230567  3540 ts_tablet_manager.cc:1434] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:31.231006  3749 leader_election.cc:290] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:31.229066  3757 leader_election.cc:290] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
W20260709 13:15:31.289888  3235 leader_election.cc:343] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:31.298223  3384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 88862us
I20260709 13:15:31.309892  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba85e8b48b84b388c287165e85c21e3" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:31.311838  3417 raft_consensus.cc:3060] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.313163  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba85e8b48b84b388c287165e85c21e3" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:31.314961  3342 raft_consensus.cc:3060] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.211077  3489 raft_consensus.cc:2468] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:31.320319  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:31.342142  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:31.231907  3540 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:31.332032  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15c7b44e85542b696746192c0ff0d5b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:31.350739  3490 raft_consensus.cc:3060] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:31.351092  3795 log.cc:927] Time spent T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:15:31.356006  3384 leader_election.cc:343] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.291586  3235 leader_election.cc:304] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
W20260709 13:15:31.383898  3235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 94636.8us
I20260709 13:15:31.384557  3538 tablet_bootstrap.cc:654] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.386343  3307 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:31.386920  3635 raft_consensus.cc:2749] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.395028  3787 raft_consensus.cc:2749] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.398665  3537 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:31.399813  3537 ts_tablet_manager.cc:1403] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.009s
I20260709 13:15:31.400979  3635 raft_consensus.cc:493] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.401682  3635 raft_consensus.cc:515] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.309413  3539 raft_consensus.cc:359] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:31.429646  3234 leader_election.cc:343] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.419054  3784 raft_consensus.cc:493] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.438416  3784 raft_consensus.cc:515] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.442222  3573 raft_consensus.cc:493] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.442901  3784 leader_election.cc:290] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:31.443125  3573 raft_consensus.cc:515] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:31.444144  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15c7b44e85542b696746192c0ff0d5b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:31.445009  3344 raft_consensus.cc:3060] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.445850  3573 leader_election.cc:290] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:31.446095  3486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:31.432763  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03783871be14ed0a80c20c2be3e1b73" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:31.450692  3537 raft_consensus.cc:359] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.451503  3537 raft_consensus.cc:385] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.451547  3488 raft_consensus.cc:3060] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.451949  3537 raft_consensus.cc:740] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.452967  3537 consensus_queue.cc:260] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.453980  3540 tablet_bootstrap.cc:654] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.455557  3537 ts_tablet_manager.cc:1434] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.003s
I20260709 13:15:31.458830  3539 raft_consensus.cc:385] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.460242  3635 leader_election.cc:290] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:31.460855  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:31.459283  3539 raft_consensus.cc:740] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.472532  3539 consensus_queue.cc:260] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:31.477811  3309 leader_election.cc:304] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:31.462775  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:31.482859  3784 raft_consensus.cc:2749] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.489236  3682 raft_consensus.cc:493] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.490048  3682 raft_consensus.cc:515] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.493453  3682 leader_election.cc:290] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:31.495426  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:31.497172  3457 leader_election.cc:343] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.501665  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:31.502673  3268 raft_consensus.cc:2468] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:31.505738  3455 leader_election.cc:304] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:31.507777  3653 raft_consensus.cc:2804] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.508234  3653 raft_consensus.cc:493] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.508680  3653 raft_consensus.cc:3060] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.522647  3726 raft_consensus.cc:493] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.524497  3726 raft_consensus.cc:515] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.533429  3491 raft_consensus.cc:2468] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:31.537290  3537 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:31.553143  3682 raft_consensus.cc:493] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.553808  3682 raft_consensus.cc:515] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.557519  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:31.559952  3682 leader_election.cc:290] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:15:31.561251  3457 leader_election.cc:343] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.561293  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03783871be14ed0a80c20c2be3e1b73" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:31.562163  3417 raft_consensus.cc:2468] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:31.562445  3418 raft_consensus.cc:3060] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.563455  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:31.564239  3268 raft_consensus.cc:2468] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:31.565891  3455 leader_election.cc:304] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:31.568492  3682 raft_consensus.cc:2804] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.568948  3682 raft_consensus.cc:493] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.569420  3682 raft_consensus.cc:3060] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.589646  3488 raft_consensus.cc:2468] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:31.591033  3796 consensus_queue.cc:1048] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:31.592849  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:31.573094  3457 leader_election.cc:304] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:31.607762  3539 ts_tablet_manager.cc:1434] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.385s	user 0.012s	sys 0.013s
I20260709 13:15:31.623123  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:31.623865  3269 raft_consensus.cc:3060] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.624274  3538 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:31.624989  3538 ts_tablet_manager.cc:1403] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.399s	user 0.044s	sys 0.041s
I20260709 13:15:31.625308  3344 raft_consensus.cc:2468] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:31.619046  3418 raft_consensus.cc:2468] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:31.638031  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:31.642335  3653 raft_consensus.cc:515] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.636620  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:31.646852  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:31.647716  3265 raft_consensus.cc:3060] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.648217  3383 leader_election.cc:304] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:31.647691  3539 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:31.671223  3342 raft_consensus.cc:2468] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:31.669941  3538 raft_consensus.cc:359] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.683106  3538 raft_consensus.cc:385] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.683501  3538 raft_consensus.cc:740] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.670723  3757 raft_consensus.cc:2804] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.666354  3490 raft_consensus.cc:2468] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:31.670897  3235 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:31.696120  3538 consensus_queue.cc:260] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:31.697328  3234 leader_election.cc:343] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:31.698233  3234 leader_election.cc:343] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.705338  3234 leader_election.cc:304] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:31.693704  3757 raft_consensus.cc:697] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:31.709326  3757 consensus_queue.cc:237] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.710232  3573 raft_consensus.cc:2804] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.711035  3573 raft_consensus.cc:697] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:31.713438  3573 consensus_queue.cc:237] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:15:31.686025  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 113126us
W20260709 13:15:31.721778  3235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 51061.4us
I20260709 13:15:31.728009  3235 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
W20260709 13:15:31.724691  3234 leader_election.cc:343] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.722620  3749 raft_consensus.cc:2804] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.735078  3749 raft_consensus.cc:697] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:31.737682  3682 raft_consensus.cc:515] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.736406  3749 consensus_queue.cc:237] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.742023  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:31.706290  3265 raft_consensus.cc:2468] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:31.742758  3266 raft_consensus.cc:3060] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.744247  3455 leader_election.cc:304] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:31.734323  3234 leader_election.cc:304] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:31.746130  3538 ts_tablet_manager.cc:1434] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.121s	user 0.013s	sys 0.005s
I20260709 13:15:31.731264  3537 tablet_bootstrap.cc:654] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.749217  3545 raft_consensus.cc:2804] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.751086  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:31.751503  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:31.753892  3803 raft_consensus.cc:2804] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.754539  3803 raft_consensus.cc:697] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
W20260709 13:15:31.755383  3457 leader_election.cc:343] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.755585  3803 consensus_queue.cc:237] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.759406  3682 leader_election.cc:290] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:31.760951  3545 raft_consensus.cc:697] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:31.760416  3635 raft_consensus.cc:2749] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.782903  3545 consensus_queue.cc:237] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:31.787593  3799 raft_consensus.cc:2804] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.788127  3799 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.788558  3799 raft_consensus.cc:3060] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.763463  3269 raft_consensus.cc:2468] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:31.792063  3539 tablet_bootstrap.cc:654] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:31.779338  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:15:31.771807  3457 leader_election.cc:343] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.805732  3266 raft_consensus.cc:2468] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:31.809294  3726 leader_election.cc:290] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:31.821532  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:31.822991  3269 raft_consensus.cc:2468] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:31.824470  3455 leader_election.cc:304] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:31.825065  3341 raft_consensus.cc:3060] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.826174  3653 leader_election.cc:290] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:31.813944  3235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 85283.5us
I20260709 13:15:31.879624  3538 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:31.878872  3797 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.847633  3682 raft_consensus.cc:2804] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:31.883606  3235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 52040.2us
I20260709 13:15:31.889953  3797 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:31.909592  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:31.910794  3811 raft_consensus.cc:493] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.913192  3811 raft_consensus.cc:515] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:31.915917  3811 leader_election.cc:290] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:31.916538  3797 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:31.894308  3455 leader_election.cc:304] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:31.927783  3537 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:31.928433  3537 ts_tablet_manager.cc:1403] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.392s	user 0.024s	sys 0.025s
I20260709 13:15:31.929423  3682 raft_consensus.cc:493] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680bff02deaf497e885eb83e37cca726)
I20260709 13:15:31.929958  3682 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:31.944674  3540 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:31.945372  3540 ts_tablet_manager.cc:1403] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.714s	user 0.022s	sys 0.007s
I20260709 13:15:31.945461  3539 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:31.948952  3625 consensus_queue.cc:1048] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:31.951918  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:31.955235  3383 leader_election.cc:343] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.956521  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:31.946259  3539 ts_tablet_manager.cc:1403] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.299s	user 0.019s	sys 0.029s
W20260709 13:15:31.952346  3455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 61361.4us
I20260709 13:15:31.970700  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:31.958143  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:31.936311  3803 raft_consensus.cc:2804] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.962251  3539 raft_consensus.cc:359] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:31.979167  3539 raft_consensus.cc:385] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.974592  3166 catalog_manager.cc:5697] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.979431  3539 raft_consensus.cc:740] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
W20260709 13:15:31.984215  3234 leader_election.cc:343] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.986907  3165 catalog_manager.cc:5697] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.988157  3166 catalog_manager.cc:5697] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.990155  3682 raft_consensus.cc:515] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:31.988684  3167 catalog_manager.cc:5697] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.994647  3803 raft_consensus.cc:697] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:31.995663  3803 consensus_queue.cc:237] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.002228  3538 tablet_bootstrap.cc:654] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.002481  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:32.001248  3540 raft_consensus.cc:359] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.003196  3540 raft_consensus.cc:385] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.003511  3540 raft_consensus.cc:740] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.983489  3537 raft_consensus.cc:359] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.005982  3537 raft_consensus.cc:385] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.006278  3537 raft_consensus.cc:740] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.004530  3540 consensus_queue.cc:260] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.007612  3537 consensus_queue.cc:260] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.012033  3490 raft_consensus.cc:1240] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Rejecting Update request from peer 680bff02deaf497e885eb83e37cca726 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:32.012939  3817 log.cc:927] Time spent T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:15:32.009768  3539 consensus_queue.cc:260] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.016122  3653 raft_consensus.cc:493] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.016631  3653 raft_consensus.cc:515] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.018376  3537 ts_tablet_manager.cc:1434] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.090s	user 0.010s	sys 0.000s
I20260709 13:15:32.019760  3537 tablet_bootstrap.cc:492] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:32.020967  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.021798  3268 raft_consensus.cc:2393] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 1: Already voted for candidate 680bff02deaf497e885eb83e37cca726 in this term.
I20260709 13:15:32.028126  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:32.028738  3268 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.024237  3653 leader_election.cc:290] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:32.032577  3540 ts_tablet_manager.cc:1434] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.003s
I20260709 13:15:32.034070  3540 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:32.041002  3540 tablet_bootstrap.cc:654] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.044302  3539 ts_tablet_manager.cc:1434] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:15:32.044430  3797 consensus_queue.cc:1059] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.045687  3539 tablet_bootstrap.cc:492] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
W20260709 13:15:32.048044  3235 leader_election.cc:343] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.048818  3235 leader_election.cc:304] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:32.049909  3811 raft_consensus.cc:2749] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.053543  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.053956  3381 leader_election.cc:304] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
W20260709 13:15:32.055279  3381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 50486.8us
I20260709 13:15:32.056078  3757 raft_consensus.cc:2804] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.059087  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:32.022323  3799 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.062959  3799 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:32.023995  3682 leader_election.cc:290] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:32.066293  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
W20260709 13:15:32.067905  3234 leader_election.cc:343] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.068325  3796 raft_consensus.cc:3055] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:32.068765  3796 raft_consensus.cc:740] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:32.069731  3796 consensus_queue.cc:260] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.071072  3796 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.076543  3268 raft_consensus.cc:2468] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:32.077675  3265 raft_consensus.cc:1240] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Rejecting Update request from peer 680bff02deaf497e885eb83e37cca726 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:32.089783  3757 raft_consensus.cc:697] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:32.091591  3757 consensus_queue.cc:237] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:15:32.093632  3381 leader_election.cc:343] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.094123  3381 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:32.086364  3539 tablet_bootstrap.cc:654] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.096463  3537 tablet_bootstrap.cc:654] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.099484  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:32.100255  3492 raft_consensus.cc:3060] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.104930  3455 leader_election.cc:304] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:32.106961  3803 raft_consensus.cc:2804] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:32.107542  3803 raft_consensus.cc:697] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:32.113061  3540 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:32.113610  3540 ts_tablet_manager.cc:1403] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.001s
I20260709 13:15:32.114324  3235 leader_election.cc:304] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:32.110051  3803 consensus_queue.cc:237] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.115247  3492 raft_consensus.cc:2468] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:32.095923  3796 raft_consensus.cc:2749] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.120524  3799 raft_consensus.cc:2749] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.127694  3825 raft_consensus.cc:493] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.128340  3825 raft_consensus.cc:515] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.135612  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.136042  3825 leader_election.cc:290] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:32.135931  3457 leader_election.cc:304] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:32.136313  3268 raft_consensus.cc:2468] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:32.135957  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:32.137604  3682 raft_consensus.cc:3060] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:32.138651  3383 leader_election.cc:343] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.141903  3381 leader_election.cc:304] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:32.142529  3540 raft_consensus.cc:359] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.143354  3540 raft_consensus.cc:385] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.143638  3796 raft_consensus.cc:2804] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.144177  3796 raft_consensus.cc:493] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.144557  3796 raft_consensus.cc:3060] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.143693  3540 raft_consensus.cc:740] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.148833  3540 consensus_queue.cc:260] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.151652  3540 ts_tablet_manager.cc:1434] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:15:32.159057  3796 raft_consensus.cc:515] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.160326  3682 raft_consensus.cc:2749] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.160573  3625 consensus_queue.cc:1048] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.161435  3796 leader_election.cc:290] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:32.161553  3540 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:32.161742  3539 tablet_bootstrap.cc:492] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:32.167006  3539 ts_tablet_manager.cc:1403] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.000s
I20260709 13:15:32.167474  3538 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:32.168313  3538 ts_tablet_manager.cc:1403] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.333s	user 0.020s	sys 0.006s
I20260709 13:15:32.164733  3537 tablet_bootstrap.cc:492] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:32.169909  3537 ts_tablet_manager.cc:1403] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.150s	user 0.009s	sys 0.007s
I20260709 13:15:32.167477  3799 consensus_queue.cc:1048] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.170302  3539 raft_consensus.cc:359] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.171083  3539 raft_consensus.cc:385] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.171391  3539 raft_consensus.cc:740] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.166301  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:32.172362  3539 consensus_queue.cc:260] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:32.174036  3383 leader_election.cc:343] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.174695  3803 consensus_queue.cc:1048] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.175041  3539 ts_tablet_manager.cc:1434] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:32.173661  3537 raft_consensus.cc:359] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.176208  3537 raft_consensus.cc:385] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.176568  3537 raft_consensus.cc:740] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.152801  3235 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:32.178161  3539 tablet_bootstrap.cc:492] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:32.181244  3540 tablet_bootstrap.cc:654] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.182626  3811 raft_consensus.cc:2804] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.183362  3811 raft_consensus.cc:697] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:32.185150  3811 consensus_queue.cc:237] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.188406  3539 tablet_bootstrap.cc:654] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.188622  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:32.190106  3268 raft_consensus.cc:3060] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.191542  3538 raft_consensus.cc:359] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.192517  3538 raft_consensus.cc:385] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.192857  3538 raft_consensus.cc:740] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.193652  3538 consensus_queue.cc:260] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.201594  3537 consensus_queue.cc:260] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.204103  3537 ts_tablet_manager.cc:1434] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:15:32.205279  3537 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:32.214181  3573 consensus_queue.cc:1048] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.215576  3537 tablet_bootstrap.cc:654] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.221010  3573 consensus_queue.cc:1048] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.221381  3268 raft_consensus.cc:2468] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
W20260709 13:15:32.224939  3457 consensus_peers.cc:597] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.227211  3538 ts_tablet_manager.cc:1434] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.003s
I20260709 13:15:32.226032  3653 consensus_queue.cc:1048] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:32.229277  3538 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:32.229930  3381 leader_election.cc:304] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:32.244225  3825 consensus_queue.cc:1048] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:32.241261  3796 raft_consensus.cc:2804] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.250628  3796 raft_consensus.cc:697] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:32.254587  3796 consensus_queue.cc:237] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.256351  3537 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:32.256961  3537 ts_tablet_manager.cc:1403] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.009s
I20260709 13:15:32.270323  3538 tablet_bootstrap.cc:654] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.269346  3537 raft_consensus.cc:359] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.272099  3537 raft_consensus.cc:385] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.272445  3537 raft_consensus.cc:740] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.283777  3537 consensus_queue.cc:260] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.289528  3799 raft_consensus.cc:493] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.298961  3540 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:32.299767  3540 ts_tablet_manager.cc:1403] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.009s
I20260709 13:15:32.302372  3537 ts_tablet_manager.cc:1434] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:15:32.290181  3799 raft_consensus.cc:515] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.323498  3537 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:32.332420  3799 leader_election.cc:290] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:32.338155  3545 raft_consensus.cc:493] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.338861  3545 raft_consensus.cc:515] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.341264  3545 leader_election.cc:290] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:32.341801  3545 consensus_queue.cc:1048] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.343052  3537 tablet_bootstrap.cc:654] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.337733  3540 raft_consensus.cc:359] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.348279  3540 raft_consensus.cc:385] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.347875  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.348575  3540 raft_consensus.cc:740] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.372634  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:32.373834  3268 raft_consensus.cc:2468] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:32.379626  3539 tablet_bootstrap.cc:492] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:32.380365  3539 ts_tablet_manager.cc:1403] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.202s	user 0.009s	sys 0.031s
W20260709 13:15:32.380333  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 76972.9us
I20260709 13:15:32.382015  3540 consensus_queue.cc:260] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.390498  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e629cf2e72494a84b27f79d2d660c379" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:32.402035  3234 leader_election.cc:343] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.403424  3455 leader_election.cc:304] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:32.404665  3682 raft_consensus.cc:2804] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.405081  3682 raft_consensus.cc:493] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.405452  3682 raft_consensus.cc:3060] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.413012  3539 raft_consensus.cc:359] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.413848  3539 raft_consensus.cc:385] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.414141  3539 raft_consensus.cc:740] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
W20260709 13:15:32.413460  3457 leader_election.cc:343] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.421001  3846 raft_consensus.cc:493] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.421574  3846 raft_consensus.cc:515] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.424731  3846 leader_election.cc:290] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:32.425710  3539 consensus_queue.cc:260] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.426241  3757 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.426789  3757 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.427683  3539 ts_tablet_manager.cc:1434] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:15:32.428344  3848 raft_consensus.cc:493] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.429020  3539 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:32.428936  3848 raft_consensus.cc:515] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.430259  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e629cf2e72494a84b27f79d2d660c379" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:32.431500  3848 leader_election.cc:290] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:32.432049  3540 ts_tablet_manager.cc:1434] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.001s
I20260709 13:15:32.433295  3540 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:32.428951  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69861273e1047ef9f4772769b689e8a" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:32.435217  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:32.436714  3757 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:32.438241  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:32.440042  3309 leader_election.cc:343] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.448186  3537 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:32.449007  3537 ts_tablet_manager.cc:1403] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.128s	user 0.018s	sys 0.008s
I20260709 13:15:32.444989  3811 consensus_queue.cc:1048] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:32.444500  3682 raft_consensus.cc:515] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.456135  3487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:32.459107  3487 raft_consensus.cc:2468] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:32.459632  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69861273e1047ef9f4772769b689e8a" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
W20260709 13:15:32.460698  3310 leader_election.cc:343] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.461344  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.462086  3266 raft_consensus.cc:2468] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:32.465442  3537 raft_consensus.cc:359] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.466017  3537 raft_consensus.cc:385] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.466183  3537 raft_consensus.cc:740] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.466949  3537 consensus_queue.cc:260] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:32.457374  3383 leader_election.cc:343] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.469201  3540 tablet_bootstrap.cc:654] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.471251  3384 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:32.472218  3796 raft_consensus.cc:2804] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.472589  3796 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.472939  3796 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.474566  3682 leader_election.cc:290] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:32.475884  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:32.476593  3266 raft_consensus.cc:3060] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.484229  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:32.488240  3266 raft_consensus.cc:2468] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
W20260709 13:15:32.493112  3457 leader_election.cc:343] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.494990  3537 ts_tablet_manager.cc:1434] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:15:32.496282  3537 tablet_bootstrap.cc:492] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:32.497772  3796 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.504232  3455 leader_election.cc:304] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:32.505780  3653 raft_consensus.cc:2804] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.506296  3653 raft_consensus.cc:697] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:32.506642  3538 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:32.507207  3538 ts_tablet_manager.cc:1403] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.278s	user 0.029s	sys 0.028s
I20260709 13:15:32.507824  3537 tablet_bootstrap.cc:654] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.507203  3653 consensus_queue.cc:237] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.510625  3538 raft_consensus.cc:359] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.511435  3538 raft_consensus.cc:385] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.511987  3538 raft_consensus.cc:740] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.512347  3757 consensus_queue.cc:1048] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.512789  3538 consensus_queue.cc:260] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.515472  3538 ts_tablet_manager.cc:1434] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:15:32.516688  3538 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:32.499006  3235 leader_election.cc:343] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.519354  3235 leader_election.cc:304] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:32.521920  3573 raft_consensus.cc:2749] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.523258  3540 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:32.523828  3540 ts_tablet_manager.cc:1403] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.009s
W20260709 13:15:32.524490  3307 leader_election.cc:343] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.525161  3307 leader_election.cc:304] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:32.526595  3846 raft_consensus.cc:2749] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.527920  3307 leader_election.cc:304] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:32.529426  3846 raft_consensus.cc:2804] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.529798  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:32.530194  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:32.530925  3490 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:32.533015  3383 leader_election.cc:343] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.529852  3846 raft_consensus.cc:493] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.535970  3846 raft_consensus.cc:3060] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.529103  3540 raft_consensus.cc:359] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.540556  3540 raft_consensus.cc:385] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.541405  3540 raft_consensus.cc:740] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.547113  3540 consensus_queue.cc:260] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.554338  3539 tablet_bootstrap.cc:654] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.557679  3414 raft_consensus.cc:1275] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:32.560330  3540 ts_tablet_manager.cc:1434] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:15:32.540570  3796 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:32.570647  3803 consensus_queue.cc:1048] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:32.574923  3537 tablet_bootstrap.cc:492] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:32.576889  3537 ts_tablet_manager.cc:1403] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.010s
I20260709 13:15:32.578684  3540 tablet_bootstrap.cc:492] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:32.580847  3539 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:32.581106  3538 tablet_bootstrap.cc:654] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.581406  3539 ts_tablet_manager.cc:1403] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.004s
I20260709 13:15:32.579505  3490 raft_consensus.cc:2468] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:32.584803  3384 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:32.584364  3167 catalog_manager.cc:5697] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.576730  3846 raft_consensus.cc:515] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.584687  3539 raft_consensus.cc:359] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.588491  3539 raft_consensus.cc:385] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.589197  3539 raft_consensus.cc:740] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.588933  3537 raft_consensus.cc:359] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.591666  3537 raft_consensus.cc:385] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.591951  3537 raft_consensus.cc:740] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.590747  3796 raft_consensus.cc:2804] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.592790  3796 raft_consensus.cc:697] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:32.593720  3796 consensus_queue.cc:237] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:32.594828  3457 consensus_peers.cc:597] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.595667  3268 raft_consensus.cc:1275] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:32.595450  3537 consensus_queue.cc:260] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.596779  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:32.597640  3726 consensus_queue.cc:1048] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.603096  3716 consensus_queue.cc:1048] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:32.604797  3846 leader_election.cc:290] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:32.605638  3537 ts_tablet_manager.cc:1434] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:15:32.606119  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:32.606874  3267 raft_consensus.cc:3060] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.606916  3537 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:32.609025  3540 tablet_bootstrap.cc:654] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.590782  3539 consensus_queue.cc:260] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:32.613822  3310 leader_election.cc:343] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.616025  3539 ts_tablet_manager.cc:1434] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:15:32.629575  3539 tablet_bootstrap.cc:492] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:32.630796  3267 raft_consensus.cc:2468] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:32.632144  3849 consensus_queue.cc:1048] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.632503  3307 leader_election.cc:304] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:32.635186  3846 raft_consensus.cc:2804] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.635700  3846 raft_consensus.cc:697] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:32.638944  3805 consensus_queue.cc:1048] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:32.632556  3164 catalog_manager.cc:5697] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } }
I20260709 13:15:32.637190  3846 consensus_queue.cc:237] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.642239  3539 tablet_bootstrap.cc:654] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.684983  3825 raft_consensus.cc:493] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.685585  3825 raft_consensus.cc:515] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.689595  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:32.692015  3383 leader_election.cc:343] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.696239  3165 catalog_manager.cc:5697] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } }
I20260709 13:15:32.698056  3165 catalog_manager.cc:5697] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.703548  3825 leader_election.cc:290] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:32.703491  3487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:32.707252  3384 leader_election.cc:343] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.707743  3384 leader_election.cc:304] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:32.708783  3825 raft_consensus.cc:2749] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.711702  3165 catalog_manager.cc:5697] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.739503  3540 tablet_bootstrap.cc:492] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:32.740178  3540 ts_tablet_manager.cc:1403] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.162s	user 0.017s	sys 0.005s
W20260709 13:15:32.742331  3234 consensus_peers.cc:597] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.714781  3165 catalog_manager.cc:5697] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 680bff02deaf497e885eb83e37cca726 (127.27.150.131) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.746202  3846 raft_consensus.cc:493] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.746841  3846 raft_consensus.cc:515] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.749003  3537 tablet_bootstrap.cc:654] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.775877  3846 leader_election.cc:290] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:32.779273  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:32.792387  3540 raft_consensus.cc:359] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.793277  3540 raft_consensus.cc:385] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.793556  3540 raft_consensus.cc:740] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.795328  3540 consensus_queue.cc:260] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.804849  3538 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:32.805565  3538 ts_tablet_manager.cc:1403] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.289s	user 0.008s	sys 0.010s
I20260709 13:15:32.805716  3166 catalog_manager.cc:5697] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.815448  3539 tablet_bootstrap.cc:492] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:32.816623  3540 ts_tablet_manager.cc:1434] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.006s
I20260709 13:15:32.820016  3539 ts_tablet_manager.cc:1403] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.191s	user 0.012s	sys 0.024s
I20260709 13:15:32.820711  3540 tablet_bootstrap.cc:492] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:32.822620  3340 raft_consensus.cc:3060] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.842959  3167 catalog_manager.cc:5697] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.846961  3167 catalog_manager.cc:5697] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.839975  3539 raft_consensus.cc:359] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.853384  3539 raft_consensus.cc:385] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.853783  3539 raft_consensus.cc:740] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.855245  3682 raft_consensus.cc:493] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.856371  3682 raft_consensus.cc:515] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.859411  3538 raft_consensus.cc:359] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.860225  3538 raft_consensus.cc:385] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.860498  3538 raft_consensus.cc:740] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.861270  3538 consensus_queue.cc:260] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.863334  3846 raft_consensus.cc:493] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.880190  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:32.880085  3846 raft_consensus.cc:515] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.864108  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e629cf2e72494a84b27f79d2d660c379" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.883188  3269 raft_consensus.cc:2468] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:32.876432  3682 leader_election.cc:290] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:32.877990  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e629cf2e72494a84b27f79d2d660c379" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:32.881351  3539 consensus_queue.cc:260] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.881901  3796 consensus_queue.cc:1048] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.882612  3341 raft_consensus.cc:3060] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.866075  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.889144  3538 ts_tablet_manager.cc:1434] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.002s
I20260709 13:15:32.890503  3538 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:32.893108  3540 tablet_bootstrap.cc:654] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.897361  3455 leader_election.cc:304] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:32.899570  3682 raft_consensus.cc:2804] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.900043  3682 raft_consensus.cc:493] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.900455  3682 raft_consensus.cc:3060] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:32.903285  3457 leader_election.cc:343] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.903805  3846 leader_election.cc:290] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:32.905185  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:32.906478  3539 ts_tablet_manager.cc:1434] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:15:32.883565  3810 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.907810  3810 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:32.909323  3539 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:32.910380  3810 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:32.913296  3537 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:32.913889  3537 ts_tablet_manager.cc:1403] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.307s	user 0.033s	sys 0.016s
I20260709 13:15:32.917244  3537 raft_consensus.cc:359] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.917951  3537 raft_consensus.cc:385] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.918228  3537 raft_consensus.cc:740] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.918998  3537 consensus_queue.cc:260] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.921501  3307 leader_election.cc:304] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:32.929793  3537 ts_tablet_manager.cc:1434] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:15:32.943653  3537 tablet_bootstrap.cc:492] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:32.951901  3537 tablet_bootstrap.cc:654] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.957969  3538 tablet_bootstrap.cc:654] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.960029  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:32.960846  3417 raft_consensus.cc:2468] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:32.931890  3682 raft_consensus.cc:515] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.932446  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c2352e9b64e8081d3c0d9baabce84" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:32.931346  3539 tablet_bootstrap.cc:654] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.964949  3682 leader_election.cc:290] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:32.972440  3540 tablet_bootstrap.cc:492] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:32.973002  3540 ts_tablet_manager.cc:1403] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.031s
I20260709 13:15:32.974710  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e629cf2e72494a84b27f79d2d660c379" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:32.975432  3269 raft_consensus.cc:3060] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.977239  3537 tablet_bootstrap.cc:492] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:32.977785  3537 ts_tablet_manager.cc:1403] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260709 13:15:32.973536  3234 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:32.980223  3811 raft_consensus.cc:2804] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.980659  3811 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.981063  3811 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.984447  3537 raft_consensus.cc:359] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.985184  3537 raft_consensus.cc:385] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.985471  3537 raft_consensus.cc:740] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.985616  3538 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:32.986378  3538 ts_tablet_manager.cc:1403] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.002s
I20260709 13:15:32.986223  3537 consensus_queue.cc:260] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.987886  3539 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:32.988408  3539 ts_tablet_manager.cc:1403] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.003s
I20260709 13:15:32.989528  3538 raft_consensus.cc:359] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.990242  3538 raft_consensus.cc:385] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.990531  3538 raft_consensus.cc:740] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.991421  3538 consensus_queue.cc:260] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:32.991401  3539 raft_consensus.cc:359] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.993065  3539 raft_consensus.cc:385] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.992741  3540 raft_consensus.cc:359] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.993347  3539 raft_consensus.cc:740] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.993485  3540 raft_consensus.cc:385] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.993801  3540 raft_consensus.cc:740] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.994364  3269 raft_consensus.cc:2468] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:32.994557  3540 consensus_queue.cc:260] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:32.996618  3538 ts_tablet_manager.cc:1434] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:32.994150  3539 consensus_queue.cc:260] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:32.996788  3540 ts_tablet_manager.cc:1434] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
W20260709 13:15:32.996814  3307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 75439.8us
I20260709 13:15:32.998000  3540 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:32.998736  3539 ts_tablet_manager.cc:1434] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:33.004197  3538 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:33.007063  3539 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:33.034482  3716 raft_consensus.cc:493] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.035270  3716 raft_consensus.cc:515] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.037873  3825 raft_consensus.cc:493] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.038611  3825 raft_consensus.cc:515] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.056214  3682 raft_consensus.cc:493] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.057046  3682 raft_consensus.cc:515] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.116668  3537 ts_tablet_manager.cc:1434] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.139s	user 0.016s	sys 0.027s
I20260709 13:15:33.116529  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:33.118271  3537 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:33.135878  3539 tablet_bootstrap.cc:654] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.135828  3848 raft_consensus.cc:493] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.136715  3848 raft_consensus.cc:515] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.140959  3487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:33.141695  3487 raft_consensus.cc:2468] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:33.143477  3310 leader_election.cc:304] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:33.152202  3716 leader_election.cc:290] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:33.148406  3848 leader_election.cc:290] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:33.153298  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69861273e1047ef9f4772769b689e8a" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:33.153729  3848 raft_consensus.cc:2804] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.154182  3848 raft_consensus.cc:493] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.154062  3268 raft_consensus.cc:2468] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:33.154299  3825 leader_election.cc:290] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:33.158115  3416 raft_consensus.cc:3060] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.159257  3455 leader_election.cc:304] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:33.134511  3307 leader_election.cc:304] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:33.161551  3848 raft_consensus.cc:3060] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.164055  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:33.171985  3537 tablet_bootstrap.cc:654] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.132364  3682 leader_election.cc:290] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:33.172734  3381 leader_election.cc:304] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:33.175033  3417 raft_consensus.cc:2468] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:33.179280  3540 tablet_bootstrap.cc:654] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.164744  3878 consensus_queue.cc:1048] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:33.165467  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
W20260709 13:15:33.187508  3310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 44123.3us
I20260709 13:15:33.201088  3457 leader_election.cc:304] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:33.202211  3726 raft_consensus.cc:2804] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.202641  3726 raft_consensus.cc:493] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.202996  3726 raft_consensus.cc:3060] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.204224  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:33.205410  3457 consensus_peers.cc:597] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.191793  3825 raft_consensus.cc:2804] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.209077  3825 raft_consensus.cc:493] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.211438  3811 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.212196  3726 raft_consensus.cc:515] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.214913  3384 leader_election.cc:304] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:33.215099  3726 leader_election.cc:290] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:33.209456  3825 raft_consensus.cc:3060] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.188580  3625 raft_consensus.cc:493] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.218618  3625 raft_consensus.cc:515] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.218729  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:33.219722  3414 raft_consensus.cc:2468] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:33.218982  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:33.220973  3417 raft_consensus.cc:3060] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.187465  3805 raft_consensus.cc:2804] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.223109  3538 tablet_bootstrap.cc:654] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.223955  3539 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:33.224705  3539 ts_tablet_manager.cc:1403] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.218s	user 0.015s	sys 0.022s
I20260709 13:15:33.189303  3682 raft_consensus.cc:493] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.245103  3625 leader_election.cc:290] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:33.242857  3805 raft_consensus.cc:697] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
W20260709 13:15:33.198137  3307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 67713.3us
I20260709 13:15:33.252552  3825 raft_consensus.cc:515] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.254916  3825 leader_election.cc:290] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:33.256166  3539 raft_consensus.cc:359] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.256886  3539 raft_consensus.cc:385] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.257155  3539 raft_consensus.cc:740] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.257817  3539 consensus_queue.cc:260] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.252936  3805 consensus_queue.cc:237] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:33.262645  3234 leader_election.cc:343] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.250224  3811 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:33.266332  3539 ts_tablet_manager.cc:1434] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:15:33.267062  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:33.243738  3682 raft_consensus.cc:515] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.267946  3879 raft_consensus.cc:2749] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.270053  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69861273e1047ef9f4772769b689e8a" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:33.280179  3266 raft_consensus.cc:3060] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.276805  3344 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.282783  3682 leader_election.cc:290] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:33.283432  3491 raft_consensus.cc:3060] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.279446  3492 raft_consensus.cc:2393] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:33.293121  3539 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:33.298842  3849 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.301558  3849 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.302676  3803 consensus_queue.cc:1048] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.292161  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:33.304756  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:33.306316  3417 raft_consensus.cc:2468] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:33.314888  3849 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:33.313310  3537 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:33.315948  3537 ts_tablet_manager.cc:1403] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.198s	user 0.030s	sys 0.019s
I20260709 13:15:33.310842  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69861273e1047ef9f4772769b689e8a" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:33.317701  3342 raft_consensus.cc:2468] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:33.320786  3848 raft_consensus.cc:515] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.320952  3457 leader_election.cc:304] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:33.324265  3726 raft_consensus.cc:2804] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.324831  3726 raft_consensus.cc:697] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:33.325706  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:33.325796  3726 consensus_queue.cc:237] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.326808  3268 raft_consensus.cc:2393] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 1: Already voted for candidate 2fbbf37a29b6416eb787ce4c9238e743 in this term.
I20260709 13:15:33.326967  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e629cf2e72494a84b27f79d2d660c379" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:33.327556  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:33.329689  3235 leader_election.cc:343] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.320894  3537 raft_consensus.cc:359] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.334230  3537 raft_consensus.cc:385] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.334630  3537 raft_consensus.cc:740] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.339000  3537 consensus_queue.cc:260] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.333264  3414 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.352133  3882 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.352921  3537 ts_tablet_manager.cc:1434] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.003s
I20260709 13:15:33.352727  3882 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.354146  3537 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:33.355243  3540 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:33.355803  3540 ts_tablet_manager.cc:1403] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.358s	user 0.046s	sys 0.016s
W20260709 13:15:33.357280  3384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 79518.9us
I20260709 13:15:33.358492  3878 consensus_queue.cc:1048] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.347514  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:33.365777  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:33.365829  3540 raft_consensus.cc:359] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.366725  3540 raft_consensus.cc:385] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.367096  3540 raft_consensus.cc:740] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.367878  3540 consensus_queue.cc:260] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.366555  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:33.370327  3488 raft_consensus.cc:2468] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:33.361711  3882 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:33.371806  3310 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:33.372709  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:33.375694  3539 tablet_bootstrap.cc:654] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.377015  3417 raft_consensus.cc:3060] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.360046  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:33.372805  3882 raft_consensus.cc:2804] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:33.372730  3266 raft_consensus.cc:2468] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:33.386725  3882 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.396624  3538 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:33.397274  3538 ts_tablet_manager.cc:1403] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.393s	user 0.027s	sys 0.014s
I20260709 13:15:33.389413  3848 leader_election.cc:290] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:33.396047  3882 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.401947  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:33.396571  3757 raft_consensus.cc:2749] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.411088  3490 raft_consensus.cc:3060] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.417548  3537 tablet_bootstrap.cc:654] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.418563  3540 ts_tablet_manager.cc:1434] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.005s
I20260709 13:15:33.403352  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9546f93765d34b7baa8dda85faad96ae" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:33.428546  3381 leader_election.cc:304] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:33.429078  3846 raft_consensus.cc:2749] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.430505  3878 raft_consensus.cc:2804] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.431016  3878 raft_consensus.cc:697] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:33.431918  3878 consensus_queue.cc:237] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.436589  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:33.421693  3879 consensus_queue.cc:1048] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:15:33.441639  3490 raft_consensus.cc:2468] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:33.445233  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69861273e1047ef9f4772769b689e8a" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:33.445912  3342 raft_consensus.cc:3060] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.461975  3540 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:33.466627  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:33.482358  3538 raft_consensus.cc:359] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.483502  3538 raft_consensus.cc:385] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.483844  3538 raft_consensus.cc:740] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.488045  3538 consensus_queue.cc:260] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.516584  3310 leader_election.cc:304] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:33.516852  3417 raft_consensus.cc:2468] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:33.517927  3892 raft_consensus.cc:2804] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:33.518177  3890 log.cc:927] Time spent T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:15:33.518471  3892 raft_consensus.cc:697] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:33.519486  3892 consensus_queue.cc:237] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.532007  3810 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.541894  3538 ts_tablet_manager.cc:1434] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.000s
I20260709 13:15:33.547238  3414 raft_consensus.cc:2468] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
W20260709 13:15:33.550366  3234 leader_election.cc:343] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.553882  3234 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:33.554654  3573 raft_consensus.cc:2804] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.555176  3573 raft_consensus.cc:697] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:33.556017  3573 consensus_queue.cc:237] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.559927  3539 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:33.560568  3539 ts_tablet_manager.cc:1403] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.270s	user 0.032s	sys 0.016s
I20260709 13:15:33.566375  3540 tablet_bootstrap.cc:654] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.567672  3538 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:33.567137  3383 leader_election.cc:343] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:33.560659  3457 leader_election.cc:343] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.578667  3825 consensus_queue.cc:1048] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:33.569919  3340 raft_consensus.cc:3060] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.544485  3810 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.588843  3810 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:33.567415  3342 raft_consensus.cc:2468] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
W20260709 13:15:33.589334  3234 leader_election.cc:343] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.590795  3234 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:33.594380  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:33.594642  3457 leader_election.cc:343] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.595124  3492 raft_consensus.cc:2468] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
W20260709 13:15:33.596006  3457 leader_election.cc:343] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.597829  3165 catalog_manager.cc:5697] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.599817  3235 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:33.600759  3165 catalog_manager.cc:5697] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.608086  3849 raft_consensus.cc:2804] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.613745  3537 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:33.614532  3537 ts_tablet_manager.cc:1403] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.261s	user 0.027s	sys 0.019s
I20260709 13:15:33.590996  3383 leader_election.cc:304] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:33.609419  3849 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.617347  3849 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:33.620074  3383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 52976.1us
I20260709 13:15:33.608479  3810 raft_consensus.cc:2749] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.627776  3894 consensus_queue.cc:1048] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.620254  3877 raft_consensus.cc:2749] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.631103  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:33.633590  3457 leader_election.cc:304] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:33.637861  3653 raft_consensus.cc:2749] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.645049  3882 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.646847  3337 raft_consensus.cc:1240] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Rejecting Update request from peer 680bff02deaf497e885eb83e37cca726 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 13:15:33.646728  3234 leader_election.cc:343] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.649854  3539 raft_consensus.cc:359] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.657459  3539 raft_consensus.cc:385] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.657747  3539 raft_consensus.cc:740] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.668728  3540 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:33.669556  3540 ts_tablet_manager.cc:1403] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.221s	user 0.016s	sys 0.009s
I20260709 13:15:33.671343  3539 consensus_queue.cc:260] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.681926  3538 tablet_bootstrap.cc:654] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.681102  3166 catalog_manager.cc:5697] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.688764  3537 raft_consensus.cc:359] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.689529  3537 raft_consensus.cc:385] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.689810  3537 raft_consensus.cc:740] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
W20260709 13:15:33.695251  3901 log.cc:927] Time spent T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: Append to log took a long time: real 0.063s	user 0.000s	sys 0.003s
I20260709 13:15:33.697690  3882 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:33.677098  3877 raft_consensus.cc:493] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.704303  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:33.704473  3877 raft_consensus.cc:515] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.706849  3417 raft_consensus.cc:3060] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.708601  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:33.709765  3878 consensus_queue.cc:1059] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.711167  3309 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:33.711751  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:33.714322  3878 raft_consensus.cc:3055] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:33.714912  3878 raft_consensus.cc:740] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:33.715303  3849 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.715945  3878 consensus_queue.cc:260] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.717909  3878 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.724617  3882 raft_consensus.cc:2749] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:33.726092  3877 leader_election.cc:290] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:33.727736  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:33.728796  3539 ts_tablet_manager.cc:1434] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.168s	user 0.008s	sys 0.001s
I20260709 13:15:33.730206  3539 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:33.733104  3381 leader_election.cc:304] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:33.735327  3849 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:33.739179  3540 raft_consensus.cc:359] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.739956  3540 raft_consensus.cc:385] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.740257  3540 raft_consensus.cc:740] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.741015  3537 consensus_queue.cc:260] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.751561  3537 ts_tablet_manager.cc:1434] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.136s	user 0.004s	sys 0.003s
I20260709 13:15:33.752817  3537 tablet_bootstrap.cc:492] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:33.742744  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:33.744846  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:33.755625  3488 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:33.755821  3234 leader_election.cc:343] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.758371  3540 consensus_queue.cc:260] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.760874  3540 ts_tablet_manager.cc:1434] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 13:15:33.787508  3625 raft_consensus.cc:2749] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.792176  3539 tablet_bootstrap.cc:654] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:33.794915  3457 consensus_peers.cc:597] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.795262  3540 tablet_bootstrap.cc:492] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:33.811093  3537 tablet_bootstrap.cc:654] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.814205  3540 tablet_bootstrap.cc:654] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.808363  3625 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.818410  3625 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.821529  3538 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:33.822391  3538 ts_tablet_manager.cc:1403] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.273s	user 0.010s	sys 0.012s
I20260709 13:15:33.839905  3625 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:33.841020  3625 consensus_queue.cc:1048] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.841334  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:33.843417  3538 raft_consensus.cc:359] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:33.843987  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:33.844343  3538 raft_consensus.cc:385] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.844684  3538 raft_consensus.cc:740] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.845350  3538 consensus_queue.cc:260] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:33.847224  3381 leader_election.cc:343] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:33.848815  3383 leader_election.cc:343] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.849426  3538 ts_tablet_manager.cc:1434] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:15:33.849272  3383 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:33.850697  3538 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:33.851357  3625 raft_consensus.cc:2749] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.851050  3164 catalog_manager.cc:5697] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.859649  3488 raft_consensus.cc:2468] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:33.861088  3235 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:33.862197  3573 raft_consensus.cc:2804] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.862738  3573 raft_consensus.cc:697] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:33.863713  3573 consensus_queue.cc:237] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.866484  3538 tablet_bootstrap.cc:654] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.869547  3653 consensus_queue.cc:1048] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.871145  3167 catalog_manager.cc:5697] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.878639  3538 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:33.879184  3538 ts_tablet_manager.cc:1403] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.007s
W20260709 13:15:33.882018  3457 consensus_peers.cc:597] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.882340  3538 raft_consensus.cc:359] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.883735  3538 raft_consensus.cc:385] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.884029  3538 raft_consensus.cc:740] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.884790  3538 consensus_queue.cc:260] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.888876  3537 tablet_bootstrap.cc:492] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:33.889480  3537 ts_tablet_manager.cc:1403] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.007s
I20260709 13:15:33.893949  3538 ts_tablet_manager.cc:1434] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:15:33.895150  3538 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:33.895788  3653 consensus_queue.cc:1048] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.901841  3538 tablet_bootstrap.cc:654] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.907864  3540 tablet_bootstrap.cc:492] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:33.912343  3847 raft_consensus.cc:493] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.925155  3540 ts_tablet_manager.cc:1403] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.010s
I20260709 13:15:33.925396  3847 raft_consensus.cc:515] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:33.926069  3538 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:33.926654  3538 ts_tablet_manager.cc:1403] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.002s
I20260709 13:15:33.928107  3847 leader_election.cc:290] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:33.929927  3538 raft_consensus.cc:359] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.930771  3538 raft_consensus.cc:385] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.931056  3538 raft_consensus.cc:740] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.931737  3538 consensus_queue.cc:260] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:33.934594  3538 ts_tablet_manager.cc:1434] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:33.935351  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:33.935880  3538 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:33.942765  3234 leader_election.cc:343] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.943264  3538 tablet_bootstrap.cc:654] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.960831  3540 raft_consensus.cc:359] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.962779  3540 raft_consensus.cc:385] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.963056  3540 raft_consensus.cc:740] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.965317  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:33.967368  3235 leader_election.cc:343] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.967811  3235 leader_election.cc:304] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:33.984747  3573 raft_consensus.cc:2749] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.985410  3540 consensus_queue.cc:260] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:33.990995  3540 ts_tablet_manager.cc:1434] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.065s	user 0.003s	sys 0.005s
I20260709 13:15:33.992184  3540 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:33.992652  3625 consensus_queue.cc:1048] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.999593  3540 tablet_bootstrap.cc:654] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.002602  3892 consensus_queue.cc:1048] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.005998  3339 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.015823  3538 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:34.016584  3538 ts_tablet_manager.cc:1403] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.005s
I20260709 13:15:34.020427  3538 raft_consensus.cc:359] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.021358  3538 raft_consensus.cc:385] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.021867  3538 raft_consensus.cc:740] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.022883  3538 consensus_queue.cc:260] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.023972  3892 consensus_queue.cc:1048] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.028672  3540 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.029260  3540 ts_tablet_manager.cc:1403] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.002s
I20260709 13:15:34.024688  3849 consensus_queue.cc:1048] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.043633  3540 raft_consensus.cc:359] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.044413  3540 raft_consensus.cc:385] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.906888  3537 raft_consensus.cc:359] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.044602  3538 ts_tablet_manager.cc:1434] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:15:34.047619  3538 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:33.907879  3539 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:34.048856  3539 ts_tablet_manager.cc:1403] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.319s	user 0.017s	sys 0.009s
I20260709 13:15:34.052088  3539 raft_consensus.cc:359] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.052775  3539 raft_consensus.cc:385] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.053048  3539 raft_consensus.cc:740] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.045169  3537 raft_consensus.cc:385] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.053856  3537 raft_consensus.cc:740] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.054677  3537 consensus_queue.cc:260] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.044705  3540 raft_consensus.cc:740] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.057464  3537 ts_tablet_manager.cc:1434] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.168s	user 0.010s	sys 0.000s
I20260709 13:15:34.058568  3540 consensus_queue.cc:260] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.061239  3540 ts_tablet_manager.cc:1434] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:15:34.062419  3540 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:34.063946  3537 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:34.066854  3653 raft_consensus.cc:493] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.067448  3653 raft_consensus.cc:515] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.069458  3540 tablet_bootstrap.cc:654] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.070392  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.071080  3653 leader_election.cc:290] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:34.071477  3537 tablet_bootstrap.cc:654] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.072458  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:34.072785  3539 consensus_queue.cc:260] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:15:34.074091  3455 leader_election.cc:343] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:34.075420  3457 leader_election.cc:343] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.075876  3457 leader_election.cc:304] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:34.077390  3653 raft_consensus.cc:2749] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.082470  3540 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.083052  3540 ts_tablet_manager.cc:1403] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:15:34.085448  3539 ts_tablet_manager.cc:1434] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 13:15:34.096560  3539 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
W20260709 13:15:34.100278  3930 log.cc:927] Time spent T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:15:34.100656  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:34.103612  3538 tablet_bootstrap.cc:654] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.106320  3539 tablet_bootstrap.cc:654] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.107123  3726 raft_consensus.cc:493] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.107762  3166 catalog_manager.cc:5697] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.107779  3726 raft_consensus.cc:515] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.115398  3811 consensus_queue.cc:1048] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.117269  3726 leader_election.cc:290] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:34.094587  3849 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.118592  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67a8637f824de9911512eedc03ec43" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:34.118784  3849 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.120496  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67a8637f824de9911512eedc03ec43" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.121721  3849 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
W20260709 13:15:34.122771  3457 leader_election.cc:343] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:34.123571  3457 leader_election.cc:343] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.124066  3457 leader_election.cc:304] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:34.086273  3540 raft_consensus.cc:359] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.131073  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.132095  3417 raft_consensus.cc:2468] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:34.133472  3234 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:34.133560  3540 raft_consensus.cc:385] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.143254  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:34.145525  3540 raft_consensus.cc:740] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.138527  3892 raft_consensus.cc:493] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.136241  3726 raft_consensus.cc:2749] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.146265  3892 raft_consensus.cc:515] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:34.148960  3234 leader_election.cc:343] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.147311  3849 raft_consensus.cc:2804] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.149653  3849 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.150225  3849 raft_consensus.cc:3060] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.155560  3892 leader_election.cc:290] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:34.162078  3540 consensus_queue.cc:260] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.164875  3540 ts_tablet_manager.cc:1434] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:15:34.165329  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:34.171137  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d5ccb77dd0428e957babbce39cf870" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.192795  3540 tablet_bootstrap.cc:492] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:34.197721  3537 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:34.198349  3537 ts_tablet_manager.cc:1403] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.135s	user 0.039s	sys 0.060s
I20260709 13:15:34.201714  3309 leader_election.cc:304] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:34.204737  3892 raft_consensus.cc:2749] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.208648  3849 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.212530  3539 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:34.213307  3539 ts_tablet_manager.cc:1403] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.117s	user 0.007s	sys 0.009s
I20260709 13:15:34.216588  3539 raft_consensus.cc:359] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.217001  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:34.217850  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:34.224967  3418 raft_consensus.cc:3060] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.219115  3537 raft_consensus.cc:359] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.220642  3849 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:34.225672  3537 raft_consensus.cc:385] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.226073  3537 raft_consensus.cc:740] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.226517  3540 tablet_bootstrap.cc:654] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.226858  3537 consensus_queue.cc:260] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.229825  3537 ts_tablet_manager.cc:1434] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
W20260709 13:15:34.230428  3234 leader_election.cc:343] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.231312  3537 tablet_bootstrap.cc:492] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:34.223701  3538 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:34.234990  3538 ts_tablet_manager.cc:1403] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.188s	user 0.019s	sys 0.009s
I20260709 13:15:34.238292  3540 tablet_bootstrap.cc:492] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.238379  3538 raft_consensus.cc:359] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.238981  3540 ts_tablet_manager.cc:1403] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.005s
I20260709 13:15:34.239217  3538 raft_consensus.cc:385] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.239384  3537 tablet_bootstrap.cc:654] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.239533  3538 raft_consensus.cc:740] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.240350  3539 raft_consensus.cc:385] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.240640  3539 raft_consensus.cc:740] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.243937  3726 raft_consensus.cc:493] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.244637  3726 raft_consensus.cc:515] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.250587  3540 raft_consensus.cc:359] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.251302  3540 raft_consensus.cc:385] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.251574  3540 raft_consensus.cc:740] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.252403  3540 consensus_queue.cc:260] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.241917  3539 consensus_queue.cc:260] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.256577  3540 ts_tablet_manager.cc:1434] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:34.257102  3539 ts_tablet_manager.cc:1434] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:15:34.257740  3540 tablet_bootstrap.cc:492] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:34.262707  3726 leader_election.cc:290] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:34.258285  3539 tablet_bootstrap.cc:492] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:34.270881  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:34.271685  3625 raft_consensus.cc:493] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.271983  3265 raft_consensus.cc:2468] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:34.272241  3625 raft_consensus.cc:515] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.273602  3455 leader_election.cc:304] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:34.274427  3726 raft_consensus.cc:2804] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.274516  3625 leader_election.cc:290] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:34.274938  3726 raft_consensus.cc:493] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.275314  3726 raft_consensus.cc:3060] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.275545  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:34.275590  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:34.276679  3265 raft_consensus.cc:2468] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 0.
I20260709 13:15:34.267891  3418 raft_consensus.cc:2468] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:34.270871  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.278285  3414 raft_consensus.cc:2468] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:34.265944  3538 consensus_queue.cc:260] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.280507  3538 ts_tablet_manager.cc:1434] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:15:34.281941  3538 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:34.281986  3381 leader_election.cc:304] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:34.283377  3234 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:34.284190  3811 raft_consensus.cc:2804] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.284691  3811 raft_consensus.cc:697] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:34.285177  3878 raft_consensus.cc:2804] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.285583  3878 raft_consensus.cc:493] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.286083  3878 raft_consensus.cc:3060] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.285632  3811 consensus_queue.cc:237] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.269759  3540 tablet_bootstrap.cc:654] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.270707  3537 tablet_bootstrap.cc:492] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:34.291500  3537 ts_tablet_manager.cc:1403] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.017s
I20260709 13:15:34.295064  3539 tablet_bootstrap.cc:654] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.304822  3538 tablet_bootstrap.cc:654] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.307446  3726 raft_consensus.cc:515] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:15:34.311513  3234 consensus_peers.cc:597] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.312012  3537 raft_consensus.cc:359] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.313453  3537 raft_consensus.cc:385] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.314129  3537 raft_consensus.cc:740] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.314736  3540 tablet_bootstrap.cc:492] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.315356  3540 ts_tablet_manager.cc:1403] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 13:15:34.316504  3573 raft_consensus.cc:493] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.317083  3573 raft_consensus.cc:515] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.318296  3492 raft_consensus.cc:2393] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:34.318619  3540 raft_consensus.cc:359] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.319324  3540 raft_consensus.cc:385] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.319618  3540 raft_consensus.cc:740] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.320113  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90df71c989bb49dda47f16aa67340ef6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:34.320385  3540 consensus_queue.cc:260] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.315842  3537 consensus_queue.cc:260] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.374635  3537 ts_tablet_manager.cc:1434] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:15:34.372238  3540 ts_tablet_manager.cc:1434] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.009s
I20260709 13:15:34.387099  3540 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:34.387184  3537 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:34.319336  3573 leader_election.cc:290] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:34.379272  3849 raft_consensus.cc:493] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.393157  3849 raft_consensus.cc:515] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.385032  3539 tablet_bootstrap.cc:492] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:34.395344  3539 ts_tablet_manager.cc:1403] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.013s
I20260709 13:15:34.396667  3540 tablet_bootstrap.cc:654] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.398347  3849 leader_election.cc:290] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:34.398731  3726 leader_election.cc:290] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:34.400066  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:34.400159  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ae694390334d8583cdad82212fb301" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:34.403975  3235 leader_election.cc:343] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.392297  3892 raft_consensus.cc:493] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.413985  3339 raft_consensus.cc:3060] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.414069  3539 raft_consensus.cc:359] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.415423  3539 raft_consensus.cc:385] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.415855  3539 raft_consensus.cc:740] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.417655  3539 consensus_queue.cc:260] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.407891  3892 raft_consensus.cc:515] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:34.427035  3234 leader_election.cc:343] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.433857  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:34.434574  3265 raft_consensus.cc:3060] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.435339  3540 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.435964  3540 ts_tablet_manager.cc:1403] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.010s
I20260709 13:15:34.438038  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90df71c989bb49dda47f16aa67340ef6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.438690  3539 ts_tablet_manager.cc:1434] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:15:34.440049  3539 tablet_bootstrap.cc:492] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:34.442874  3540 raft_consensus.cc:359] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.443646  3540 raft_consensus.cc:385] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.443920  3540 raft_consensus.cc:740] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.444684  3540 consensus_queue.cc:260] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.446010  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.446208  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:34.447137  3490 raft_consensus.cc:2468] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:34.447602  3540 ts_tablet_manager.cc:1434] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.007s
I20260709 13:15:34.448199  3310 leader_election.cc:304] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:34.448846  3540 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:34.449182  3894 raft_consensus.cc:2804] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.449600  3894 raft_consensus.cc:493] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.449928  3894 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:34.456017  3309 leader_election.cc:343] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.458788  3878 raft_consensus.cc:515] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.460093  3414 raft_consensus.cc:2393] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 1: Already voted for candidate 680bff02deaf497e885eb83e37cca726 in this term.
I20260709 13:15:34.464775  3878 leader_election.cc:290] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:34.466540  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:34.495819  3490 raft_consensus.cc:2393] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:34.468009  3337 raft_consensus.cc:3060] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.498647  3538 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:34.499261  3538 ts_tablet_manager.cc:1403] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.218s	user 0.041s	sys 0.027s
I20260709 13:15:34.475310  3573 raft_consensus.cc:493] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.500698  3573 raft_consensus.cc:515] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.502574  3538 raft_consensus.cc:359] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.503285  3538 raft_consensus.cc:385] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.503541  3538 raft_consensus.cc:740] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.504431  3538 consensus_queue.cc:260] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.504949  3166 catalog_manager.cc:5697] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.480182  3892 leader_election.cc:290] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:34.481391  3540 tablet_bootstrap.cc:654] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.468394  3894 raft_consensus.cc:515] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.482756  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:34.485737  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ae694390334d8583cdad82212fb301" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:34.517015  3342 raft_consensus.cc:2468] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:34.518210  3810 consensus_queue.cc:1048] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.519047  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:34.519667  3490 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.523582  3381 leader_election.cc:304] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:34.525094  3796 raft_consensus.cc:2749] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.517015  3894 leader_election.cc:290] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:34.446302  3265 raft_consensus.cc:2468] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:34.506218  3538 ts_tablet_manager.cc:1434] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:15:34.527976  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:34.507733  3573 leader_election.cc:290] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:34.529538  3538 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:34.530390  3490 raft_consensus.cc:2468] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:34.531526  3310 leader_election.cc:304] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:34.532562  3882 raft_consensus.cc:2804] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.533030  3882 raft_consensus.cc:697] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
W20260709 13:15:34.534584  3309 leader_election.cc:343] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.533877  3882 consensus_queue.cc:237] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.536293  3538 tablet_bootstrap.cc:654] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.536976  3894 raft_consensus.cc:493] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.541079  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:34.553432  3539 tablet_bootstrap.cc:654] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.537554  3894 raft_consensus.cc:515] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.557130  3455 leader_election.cc:304] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
W20260709 13:15:34.557334  3234 leader_election.cc:343] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.557821  3234 leader_election.cc:304] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:34.557987  3726 raft_consensus.cc:2804] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.559898  3726 raft_consensus.cc:697] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:34.560865  3726 consensus_queue.cc:237] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.562091  3849 raft_consensus.cc:2749] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.565848  3894 leader_election.cc:290] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:34.566798  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
W20260709 13:15:34.568446  3309 leader_election.cc:343] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:34.546482  3235 leader_election.cc:343] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.490178  3537 tablet_bootstrap.cc:654] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.601537  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
W20260709 13:15:34.615072  3307 leader_election.cc:343] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.615710  3307 leader_election.cc:304] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:34.624501  3894 raft_consensus.cc:2749] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.627362  3166 catalog_manager.cc:5697] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.638780  3540 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.643551  3625 raft_consensus.cc:493] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.644176  3625 raft_consensus.cc:515] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.646610  3625 leader_election.cc:290] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:34.649199  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
W20260709 13:15:34.650656  3381 leader_election.cc:343] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.643193  3540 ts_tablet_manager.cc:1403] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.006s
W20260709 13:15:34.651592  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 80994.7us
I20260709 13:15:34.654670  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:34.656123  3383 leader_election.cc:343] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.656018  3540 raft_consensus.cc:359] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.656684  3383 leader_election.cc:304] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:34.657013  3540 raft_consensus.cc:385] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.657516  3540 raft_consensus.cc:740] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.657919  3796 raft_consensus.cc:2749] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.658494  3540 consensus_queue.cc:260] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:34.660892  3232 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.27.150.190:35321, user_credentials={real_user=slave}} blocked reactor thread for 80222.5us
I20260709 13:15:34.660953  3540 ts_tablet_manager.cc:1434] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:34.662619  3540 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:34.665975  3894 raft_consensus.cc:493] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.666661  3894 raft_consensus.cc:515] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.668937  3538 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:34.669560  3538 ts_tablet_manager.cc:1403] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.140s	user 0.040s	sys 0.063s
I20260709 13:15:34.670179  3894 leader_election.cc:290] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:34.670789  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67a8637f824de9911512eedc03ec43" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:34.671476  3492 raft_consensus.cc:2468] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:34.671591  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67a8637f824de9911512eedc03ec43" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.672345  3416 raft_consensus.cc:2468] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:34.673691  3310 leader_election.cc:304] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:34.676229  3894 raft_consensus.cc:2804] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.677253  3894 raft_consensus.cc:493] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.673264  3538 raft_consensus.cc:359] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.678002  3538 raft_consensus.cc:385] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.678309  3538 raft_consensus.cc:740] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.677673  3894 raft_consensus.cc:3060] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.679039  3538 consensus_queue.cc:260] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.679646  3810 raft_consensus.cc:493] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.680190  3810 raft_consensus.cc:515] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.681475  3538 ts_tablet_manager.cc:1434] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:34.682686  3538 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:34.682863  3810 leader_election.cc:290] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:34.656749  3234 leader_election.cc:304] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:34.696785  3811 raft_consensus.cc:2804] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.697203  3811 raft_consensus.cc:493] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.697592  3811 raft_consensus.cc:3060] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.699916  3538 tablet_bootstrap.cc:654] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.702376  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c143a12f1d074d6abf4f33d880d1c212" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:34.711115  3235 leader_election.cc:343] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.712116  3537 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:34.712733  3537 ts_tablet_manager.cc:1403] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.326s	user 0.008s	sys 0.019s
I20260709 13:15:34.713156  3894 raft_consensus.cc:515] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.715922  3537 raft_consensus.cc:359] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.715049  3540 tablet_bootstrap.cc:654] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.716625  3537 raft_consensus.cc:385] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.716939  3537 raft_consensus.cc:740] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.717603  3537 consensus_queue.cc:260] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.720084  3537 ts_tablet_manager.cc:1434] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:34.721182  3537 tablet_bootstrap.cc:492] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:34.722967  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67a8637f824de9911512eedc03ec43" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:34.723811  3416 raft_consensus.cc:3060] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.705750  3539 tablet_bootstrap.cc:492] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:34.725620  3539 ts_tablet_manager.cc:1403] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.286s	user 0.011s	sys 0.003s
I20260709 13:15:34.706097  3165 catalog_manager.cc:5697] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.736413  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67a8637f824de9911512eedc03ec43" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:34.737118  3488 raft_consensus.cc:3060] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.737066  3894 leader_election.cc:290] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:34.742517  3416 raft_consensus.cc:2468] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:34.743750  3538 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:34.745613  3309 leader_election.cc:304] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:34.746344  3538 ts_tablet_manager.cc:1403] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.064s	user 0.034s	sys 0.012s
I20260709 13:15:34.747045  3894 raft_consensus.cc:2804] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.749365  3538 raft_consensus.cc:359] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.749699  3488 raft_consensus.cc:2468] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:34.750088  3538 raft_consensus.cc:385] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.750422  3538 raft_consensus.cc:740] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.751124  3538 consensus_queue.cc:260] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.751777  3894 raft_consensus.cc:697] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:34.752794  3894 consensus_queue.cc:237] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.754078  3538 ts_tablet_manager.cc:1434] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:34.755586  3538 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:34.762217  3538 tablet_bootstrap.cc:654] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:34.766706  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 110074us
I20260709 13:15:34.774950  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.777757  3540 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.778422  3540 ts_tablet_manager.cc:1403] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.000s
I20260709 13:15:34.780835  3539 raft_consensus.cc:359] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.781879  3539 raft_consensus.cc:385] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.782763  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c143a12f1d074d6abf4f33d880d1c212" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:34.785945  3540 raft_consensus.cc:359] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.786988  3540 raft_consensus.cc:385] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.787319  3540 raft_consensus.cc:740] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.788249  3540 consensus_queue.cc:260] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.806888  3540 ts_tablet_manager.cc:1434] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:15:34.807967  3540 tablet_bootstrap.cc:492] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:34.816319  3540 tablet_bootstrap.cc:654] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.782230  3539 raft_consensus.cc:740] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.818378  3539 consensus_queue.cc:260] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.820036  3539 ts_tablet_manager.cc:1434] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.002s
I20260709 13:15:34.821184  3539 tablet_bootstrap.cc:492] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:34.810199  3811 raft_consensus.cc:515] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.827121  3811 leader_election.cc:290] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:34.828454  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ae694390334d8583cdad82212fb301" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:34.828270  3165 catalog_manager.cc:5697] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:34.830282  3235 leader_election.cc:343] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.835093  3539 tablet_bootstrap.cc:654] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.835651  3538 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:34.836217  3538 ts_tablet_manager.cc:1403] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.018s
I20260709 13:15:34.837515  3537 tablet_bootstrap.cc:654] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.839713  3538 raft_consensus.cc:359] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.840505  3538 raft_consensus.cc:385] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.840809  3538 raft_consensus.cc:740] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.841583  3538 consensus_queue.cc:260] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.843797  3538 ts_tablet_manager.cc:1434] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:15:34.852793  3811 raft_consensus.cc:493] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.853596  3811 raft_consensus.cc:515] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.856552  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ae694390334d8583cdad82212fb301" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:34.857328  3339 raft_consensus.cc:3060] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.856472  3811 leader_election.cc:290] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:34.858691  3894 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.859262  3894 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.863147  3894 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:34.865414  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:34.868670  3538 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:34.874351  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.878979  3416 raft_consensus.cc:2393] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 9f99770bc87e426a893fc425299485cc in this term.
I20260709 13:15:34.880259  3309 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:34.881542  3894 raft_consensus.cc:3060] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:34.885824  3234 leader_election.cc:343] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.886703  3234 leader_election.cc:304] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:34.893769  3811 raft_consensus.cc:2749] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.904358  3810 consensus_queue.cc:1048] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:34.905531  3234 leader_election.cc:343] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.906086  3234 leader_election.cc:304] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:34.907388  3954 raft_consensus.cc:2749] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.913690  3538 tablet_bootstrap.cc:654] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.916314  3537 tablet_bootstrap.cc:492] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:34.916956  3537 ts_tablet_manager.cc:1403] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.000s
I20260709 13:15:34.926004  3573 raft_consensus.cc:493] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.926564  3573 raft_consensus.cc:515] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:34.930327  3573 leader_election.cc:290] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:34.931834  3573 raft_consensus.cc:493] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.931886  3537 raft_consensus.cc:359] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.932646  3537 raft_consensus.cc:385] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.933336  3537 raft_consensus.cc:740] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.932310  3573 raft_consensus.cc:515] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:34.934088  3537 consensus_queue.cc:260] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:34.937180  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:34.939415  3573 leader_election.cc:290] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:34.940681  3537 ts_tablet_manager.cc:1434] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
W20260709 13:15:34.943122  3234 leader_election.cc:343] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.949180  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.950034  3540 tablet_bootstrap.cc:492] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:34.950672  3540 ts_tablet_manager.cc:1403] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.019s
I20260709 13:15:34.968425  3339 raft_consensus.cc:2468] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:34.968693  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:34.969503  3340 raft_consensus.cc:2468] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:34.969980  3234 leader_election.cc:304] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:34.971328  3573 raft_consensus.cc:2804] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.971803  3573 raft_consensus.cc:697] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:34.972289  3234 leader_election.cc:304] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:34.973949  3573 consensus_queue.cc:237] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:34.982116  3537 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:34.971608  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:34.979377  3894 raft_consensus.cc:2749] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.972643  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:34.984702  3539 tablet_bootstrap.cc:492] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:34.975442  3810 raft_consensus.cc:2804] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.986135  3539 ts_tablet_manager.cc:1403] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.165s	user 0.034s	sys 0.045s
I20260709 13:15:34.985496  3417 raft_consensus.cc:2468] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:34.986986  3810 raft_consensus.cc:493] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.989989  3810 raft_consensus.cc:3060] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.992621  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
W20260709 13:15:34.993888  3234 leader_election.cc:343] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.998512  3234 leader_election.cc:304] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:35.002143  3849 raft_consensus.cc:2804] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.002547  3849 raft_consensus.cc:493] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.002938  3849 raft_consensus.cc:3060] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.983251  3848 consensus_queue.cc:1048] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:15:34.999029  3488 raft_consensus.cc:2468] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 0.
I20260709 13:15:35.017560  3811 consensus_queue.cc:1048] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.023633  3235 leader_election.cc:304] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:35.026878  3954 raft_consensus.cc:2804] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.027272  3954 raft_consensus.cc:493] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.027608  3954 raft_consensus.cc:3060] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.037629  3538 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: No bootstrap required, opened a new log
I20260709 13:15:35.038254  3538 ts_tablet_manager.cc:1403] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.190s	user 0.004s	sys 0.012s
I20260709 13:15:35.038053  3539 raft_consensus.cc:359] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.040632  3539 raft_consensus.cc:385] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:35.040628  3234 leader_election.cc:343] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.041110  3539 raft_consensus.cc:740] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.041934  3539 consensus_queue.cc:260] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.045159  3849 raft_consensus.cc:515] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.048220  3849 leader_election.cc:290] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:35.059298  3538 raft_consensus.cc:359] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.061065  3538 raft_consensus.cc:385] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.061372  3538 raft_consensus.cc:740] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.061859  3538 consensus_queue.cc:260] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.063961  3539 ts_tablet_manager.cc:1434] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 13:15:35.072860  3538 ts_tablet_manager.cc:1434] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:15:35.074872  3537 tablet_bootstrap.cc:654] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:35.075716  3309 consensus_peers.cc:597] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:35.071405  3653 raft_consensus.cc:493] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.076833  3653 raft_consensus.cc:515] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.079722  3653 leader_election.cc:290] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:35.107173  3539 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:35.114595  3653 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680bff02deaf497e885eb83e37cca726)
I20260709 13:15:35.115406  3653 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.117996  3653 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:35.123025  3540 raft_consensus.cc:359] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.124186  3540 raft_consensus.cc:385] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.124540  3540 raft_consensus.cc:740] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
W20260709 13:15:35.131332  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 89013.6us
I20260709 13:15:35.129489  3540 consensus_queue.cc:260] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.126523  3848 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.141651  3540 ts_tablet_manager.cc:1434] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.191s	user 0.007s	sys 0.001s
I20260709 13:15:35.136071  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:35.153584  3726 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.162868  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:35.162708  3726 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:35.163796  3340 raft_consensus.cc:2393] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 2: Already voted for candidate 2fbbf37a29b6416eb787ce4c9238e743 in this term.
I20260709 13:15:35.172832  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:35.173484  3418 raft_consensus.cc:3060] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.175745  3539 tablet_bootstrap.cc:654] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.150885  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:35.175343  3416 raft_consensus.cc:2468] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:35.179603  3339 raft_consensus.cc:2468] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:35.185540  3457 leader_election.cc:304] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:35.187888  3726 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:35.146673  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:35.192121  3682 raft_consensus.cc:2804] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.193315  3682 raft_consensus.cc:493] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.193735  3682 raft_consensus.cc:3060] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.195104  3726 consensus_queue.cc:1048] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.153913  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:35.147617  3848 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:35.150054  3810 raft_consensus.cc:515] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.200558  3415 raft_consensus.cc:2468] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:35.222659  3848 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:35.224931  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:35.225759  3265 raft_consensus.cc:2468] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:35.231506  3418 raft_consensus.cc:2468] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:35.232211  3682 raft_consensus.cc:515] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
W20260709 13:15:35.233332  3234 leader_election.cc:343] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:35.236378  3455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 50178us
I20260709 13:15:35.240224  3234 leader_election.cc:304] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743
W20260709 13:15:35.251832  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:35.252617  3682 leader_election.cc:290] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
W20260709 13:15:35.260264  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 74820.2us
I20260709 13:15:35.237746  3455 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:35.263746  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:35.266283  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:35.266947  3416 raft_consensus.cc:3060] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.267424  3167 catalog_manager.cc:5697] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.255358  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:35.269966  3341 raft_consensus.cc:3060] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.240711  3810 leader_election.cc:290] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:35.275605  3726 raft_consensus.cc:2804] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.276875  3726 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.278016  3726 raft_consensus.cc:3060] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.247303  3968 raft_consensus.cc:2804] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.266582  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:35.290735  3344 raft_consensus.cc:3060] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.291249  3537 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:35.291850  3537 ts_tablet_manager.cc:1403] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.313s	user 0.017s	sys 0.009s
I20260709 13:15:35.294726  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:35.294940  3537 raft_consensus.cc:359] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.295434  3267 raft_consensus.cc:2468] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:35.295619  3537 raft_consensus.cc:385] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:35.298081  3234 leader_election.cc:343] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.295904  3537 raft_consensus.cc:740] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.299621  3537 consensus_queue.cc:260] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.300400  3307 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:35.301666  3892 raft_consensus.cc:2804] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.302044  3892 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.302402  3892 raft_consensus.cc:3060] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.276834  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:35.309908  3540 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:35.317782  3537 ts_tablet_manager.cc:1434] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:15:35.272158  3796 raft_consensus.cc:493] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.330287  3457 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:35.331501  3682 raft_consensus.cc:2804] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:35.331969  3682 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680bff02deaf497e885eb83e37cca726)
I20260709 13:15:35.332432  3682 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:35.341522  3341 raft_consensus.cc:2468] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:35.352259  3974 consensus_queue.cc:1048] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.327342  3796 raft_consensus.cc:515] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.359555  3811 raft_consensus.cc:493] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.359973  3892 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:35.360177  3811 raft_consensus.cc:515] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.342681  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:35.324554  3968 raft_consensus.cc:697] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:35.317214  3954 raft_consensus.cc:515] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.365092  3234 leader_election.cc:304] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:35.370694  3726 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:35.377991  3537 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:35.382498  3726 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:35.384768  3573 raft_consensus.cc:2804] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.385288  3573 raft_consensus.cc:697] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:35.387373  3682 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.386092  3573 consensus_queue.cc:237] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.368460  3894 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.408512  3682 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:35.419463  3540 tablet_bootstrap.cc:654] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.426923  3796 leader_election.cc:290] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
W20260709 13:15:35.437425  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 59252.3us
I20260709 13:15:35.427882  3340 raft_consensus.cc:2393] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 1: Already voted for candidate 2fbbf37a29b6416eb787ce4c9238e743 in this term.
I20260709 13:15:35.429816  3491 raft_consensus.cc:2393] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:35.427465  3811 leader_election.cc:290] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:35.441807  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:35.418180  3894 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.471809  3539 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:35.471701  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:35.472523  3539 ts_tablet_manager.cc:1403] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.366s	user 0.023s	sys 0.022s
I20260709 13:15:35.476864  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:35.478267  3537 tablet_bootstrap.cc:654] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.444245  3344 raft_consensus.cc:2468] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
W20260709 13:15:35.488467  3235 leader_election.cc:343] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.479549  3267 raft_consensus.cc:3060] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.450470  3968 consensus_queue.cc:237] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.533834  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:35.543553  3539 raft_consensus.cc:359] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.544675  3539 raft_consensus.cc:385] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.545048  3539 raft_consensus.cc:740] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.531509  3416 raft_consensus.cc:2468] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:35.568766  3892 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:35.570209  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:35.572268  3954 leader_election.cc:290] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:35.573956  3894 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:35.575210  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:35.576126  3267 raft_consensus.cc:2468] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:35.578833  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:35.579711  3341 raft_consensus.cc:2393] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 2: Already voted for candidate 2fbbf37a29b6416eb787ce4c9238e743 in this term.
I20260709 13:15:35.562053  3539 consensus_queue.cc:260] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.580687  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:35.581367  3489 raft_consensus.cc:3060] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.583348  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:35.581398  3539 ts_tablet_manager.cc:1434] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.109s	user 0.010s	sys 0.001s
I20260709 13:15:35.585251  3539 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
W20260709 13:15:35.558259  3310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 181377us
I20260709 13:15:35.649075  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:35.657222  3539 tablet_bootstrap.cc:654] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.652860  3267 raft_consensus.cc:2393] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:35.678052  3540 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:35.678804  3540 ts_tablet_manager.cc:1403] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.369s	user 0.031s	sys 0.004s
I20260709 13:15:35.680622  3455 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:35.681813  3726 raft_consensus.cc:2804] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.682385  3726 raft_consensus.cc:697] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
W20260709 13:15:35.647171  3384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 175095us
I20260709 13:15:35.683312  3726 consensus_queue.cc:237] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:35.701277  3384 leader_election.cc:304] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:35.704258  3878 raft_consensus.cc:2749] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.675484  3415 raft_consensus.cc:2468] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:35.696522  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:35.709888  3416 raft_consensus.cc:2410] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:15:35.711489  3537 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:35.712080  3537 ts_tablet_manager.cc:1403] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.334s	user 0.032s	sys 0.051s
W20260709 13:15:35.713929  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 327079us
I20260709 13:15:35.717995  3489 raft_consensus.cc:2468] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 1.
I20260709 13:15:35.720453  3537 raft_consensus.cc:359] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:35.721268  3537 raft_consensus.cc:385] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.721534  3537 raft_consensus.cc:740] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.722414  3537 consensus_queue.cc:260] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:35.723505  3234 leader_election.cc:343] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.724014  3234 leader_election.cc:304] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:35.725684  3849 raft_consensus.cc:2749] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.730582  3989 consensus_queue.cc:1048] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.736382  3537 ts_tablet_manager.cc:1434] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:15:35.741684  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:35.744232  3537 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:35.748564  3540 raft_consensus.cc:359] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.750706  3540 raft_consensus.cc:385] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.751368  3540 raft_consensus.cc:740] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.752470  3540 consensus_queue.cc:260] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.756235  3991 raft_consensus.cc:493] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.756726  3991 raft_consensus.cc:515] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:35.757725  3234 leader_election.cc:343] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.761073  3848 consensus_queue.cc:1048] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.762624  3878 raft_consensus.cc:493] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.763181  3878 raft_consensus.cc:515] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:35.765638  3878 leader_election.cc:290] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:35.767508  3540 ts_tablet_manager.cc:1434] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.001s
I20260709 13:15:35.770823  3974 raft_consensus.cc:493] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.772156  3414 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.772176  3974 raft_consensus.cc:515] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.775278  3974 leader_election.cc:290] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:35.775727  3235 leader_election.cc:304] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:35.776578  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:35.777357  3269 raft_consensus.cc:2468] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:35.777616  3999 raft_consensus.cc:2804] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.778316  3999 raft_consensus.cc:697] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:35.778544  3455 leader_election.cc:304] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:35.779667  3974 raft_consensus.cc:2804] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.780081  3974 raft_consensus.cc:493] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.779399  3999 consensus_queue.cc:237] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.780407  3974 raft_consensus.cc:3060] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.792099  3413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:35.793315  3413 raft_consensus.cc:2393] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 1: Already voted for candidate 9f99770bc87e426a893fc425299485cc in this term.
I20260709 13:15:35.796998  3486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:35.800424  3486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:35.801752  3486 raft_consensus.cc:2410] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:15:35.802032  3991 leader_election.cc:290] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:35.819165  3539 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:35.820015  3539 ts_tablet_manager.cc:1403] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.235s	user 0.011s	sys 0.005s
I20260709 13:15:35.821620  3457 leader_election.cc:304] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:35.800742  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:35.804405  3540 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:35.827056  3653 raft_consensus.cc:2804] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.829123  3653 raft_consensus.cc:697] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:35.830089  3653 consensus_queue.cc:237] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.838423  3344 raft_consensus.cc:2393] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 in current term 1: Already voted for candidate 9f99770bc87e426a893fc425299485cc in this term.
I20260709 13:15:35.839756  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:35.841070  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:35.840209  3974 raft_consensus.cc:515] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.840171  3537 tablet_bootstrap.cc:654] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.845386  3381 leader_election.cc:304] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:35.846288  3878 raft_consensus.cc:3060] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.846493  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:35.847124  3266 raft_consensus.cc:3060] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.827765  3457 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:35.846113  3307 leader_election.cc:304] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:35.853519  3682 raft_consensus.cc:2804] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:35.854014  3682 raft_consensus.cc:697] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:35.854930  3682 consensus_queue.cc:237] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:35.856289  3991 raft_consensus.cc:3060] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.852094  3974 leader_election.cc:290] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:15:35.907454  4005 log.cc:927] Time spent T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:15:35.895373  3165 catalog_manager.cc:5697] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.927083  3166 catalog_manager.cc:5697] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.937536  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:35.947501  3878 raft_consensus.cc:2749] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.956604  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
W20260709 13:15:35.961333  3234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 97618us
W20260709 13:15:35.964789  3457 leader_election.cc:343] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:35.966305  3457 leader_election.cc:343] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.970259  3849 consensus_queue.cc:1048] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:35.984050  3310 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:35.985754  3310 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:35.986631  3988 raft_consensus.cc:2749] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.987287  3988 raft_consensus.cc:2749] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:35.990685  3266 raft_consensus.cc:2468] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:35.992100  3455 leader_election.cc:304] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:35.994130  3726 raft_consensus.cc:2804] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.995014  3539 raft_consensus.cc:359] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.995895  3539 raft_consensus.cc:385] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.996173  3539 raft_consensus.cc:740] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.996919  3539 consensus_queue.cc:260] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:35.998174  3726 raft_consensus.cc:697] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:35.999223  3726 consensus_queue.cc:237] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.001701  3991 raft_consensus.cc:2749] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.026580  3537 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:36.034631  3537 ts_tablet_manager.cc:1403] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.291s	user 0.020s	sys 0.015s
W20260709 13:15:36.030840  3235 consensus_peers.cc:597] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc -> Peer 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967): Couldn't send request to peer 6861cafc7c054539ab0c01ec4986d417. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:36.007061  3540 tablet_bootstrap.cc:654] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:36.031484  3310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 45826us
I20260709 13:15:36.006834  3539 ts_tablet_manager.cc:1434] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.186s	user 0.002s	sys 0.006s
I20260709 13:15:36.051303  3539 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:36.051734  3537 raft_consensus.cc:359] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.062903  3537 raft_consensus.cc:385] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.066782  3537 raft_consensus.cc:740] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.068511  3537 consensus_queue.cc:260] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.084510  3537 ts_tablet_manager.cc:1434] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:15:36.100841  3540 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:36.101869  3540 ts_tablet_manager.cc:1403] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.298s	user 0.015s	sys 0.019s
I20260709 13:15:36.104353  3537 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417: Bootstrap starting.
I20260709 13:15:36.104841  3970 consensus_queue.cc:1048] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.109551  3954 consensus_queue.cc:1048] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.118463  3540 raft_consensus.cc:359] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.119256  3540 raft_consensus.cc:385] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.119562  3540 raft_consensus.cc:740] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.120329  3540 consensus_queue.cc:260] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.122665  3539 tablet_bootstrap.cc:654] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.126204  3540 ts_tablet_manager.cc:1434] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:15:36.127454  3540 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:36.151793  3810 consensus_queue.cc:1048] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:36.154747  3540 tablet_bootstrap.cc:654] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.166119  3682 raft_consensus.cc:493] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.166767  3682 raft_consensus.cc:515] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.171175  3682 leader_election.cc:290] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:36.172355  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c143a12f1d074d6abf4f33d880d1c212" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:36.173435  3266 raft_consensus.cc:2468] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:36.169719  3166 catalog_manager.cc:5697] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } }
I20260709 13:15:36.175343  3455 leader_election.cc:304] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:36.176908  3682 raft_consensus.cc:2804] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.177259  3682 raft_consensus.cc:493] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.177567  3682 raft_consensus.cc:3060] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.192093  3682 raft_consensus.cc:515] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.203203  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c143a12f1d074d6abf4f33d880d1c212" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:36.204423  3266 raft_consensus.cc:3060] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.207863  3970 consensus_queue.cc:1048] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.219269  3682 leader_election.cc:290] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:36.223263  3537 tablet_bootstrap.cc:654] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.225979  3682 raft_consensus.cc:493] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.226300  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c143a12f1d074d6abf4f33d880d1c212" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:36.230564  3164 catalog_manager.cc:5697] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 680bff02deaf497e885eb83e37cca726 (127.27.150.131) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.238030  3539 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:36.303560  3539 ts_tablet_manager.cc:1403] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.253s	user 0.010s	sys 0.032s
I20260709 13:15:36.247104  3983 consensus_queue.cc:1048] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:36.263794  3974 consensus_queue.cc:1048] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:36.304955  3266 raft_consensus.cc:2468] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:36.305135  3973 consensus_queue.cc:1048] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.306370  3455 leader_election.cc:304] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:36.265795  3412 raft_consensus.cc:3060] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.286155  3413 raft_consensus.cc:1275] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:36.312047  3539 raft_consensus.cc:359] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:36.312839  3539 raft_consensus.cc:385] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.313141  3539 raft_consensus.cc:740] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.313874  3539 consensus_queue.cc:260] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:36.306763  3164 catalog_manager.cc:5697] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.322047  3164 catalog_manager.cc:5697] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.328289  3726 raft_consensus.cc:2804] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.329027  3726 raft_consensus.cc:697] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:36.288726  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c143a12f1d074d6abf4f33d880d1c212" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:36.300827  3682 raft_consensus.cc:515] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.307507  3341 raft_consensus.cc:3060] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.338792  3539 ts_tablet_manager.cc:1434] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.004s
I20260709 13:15:36.334199  3726 consensus_queue.cc:237] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.354271  3682 leader_election.cc:290] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:36.361748  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
W20260709 13:15:36.367336  3457 leader_election.cc:343] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.368438  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:36.369187  3269 raft_consensus.cc:2468] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 0.
I20260709 13:15:36.375675  3539 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:36.378100  3455 leader_election.cc:304] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:36.381965  3682 raft_consensus.cc:2804] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.382310  3682 raft_consensus.cc:493] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.382649  3682 raft_consensus.cc:3060] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.347350  3974 consensus_queue.cc:1048] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:15:36.416193  3803 consensus_queue.cc:1048] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:36.432296  3540 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:36.432832  3537 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417: No bootstrap required, opened a new log
I20260709 13:15:36.435032  3537 ts_tablet_manager.cc:1403] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417: Time spent bootstrapping tablet: real 0.331s	user 0.015s	sys 0.004s
I20260709 13:15:36.436054  3540 ts_tablet_manager.cc:1403] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.309s	user 0.028s	sys 0.069s
I20260709 13:15:36.438059  3167 catalog_manager.cc:5697] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 1 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.440340  3537 raft_consensus.cc:359] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.442073  3537 raft_consensus.cc:385] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.442111  3341 raft_consensus.cc:2468] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:36.442746  3537 raft_consensus.cc:740] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.445143  3537 consensus_queue.cc:260] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.445854  3878 raft_consensus.cc:493] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.447669  3954 consensus_queue.cc:1048] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.451846  3682 raft_consensus.cc:515] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:15:36.468935  3215 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:36.475759  3537 ts_tablet_manager.cc:1434] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:15:36.477533  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:36.479090  3682 leader_election.cc:290] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:15:36.481201  3457 leader_election.cc:343] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:36.485464  3457 consensus_peers.cc:597] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:36.486670  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:36.470427  3878 raft_consensus.cc:515] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.487346  3267 raft_consensus.cc:3060] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.498566  3878 leader_election.cc:290] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:36.498817  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:36.505151  3540 raft_consensus.cc:359] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:36.505959  3540 raft_consensus.cc:385] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.506227  3540 raft_consensus.cc:740] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.507097  3540 consensus_queue.cc:260] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:36.509591  3340 raft_consensus.cc:1275] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:36.510890  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:36.525198  3381 leader_election.cc:304] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:36.532815  3726 consensus_queue.cc:1048] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:36.543061  3540 ts_tablet_manager.cc:1434] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.003s
I20260709 13:15:36.546152  3539 tablet_bootstrap.cc:654] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.554091  3540 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743: Bootstrap starting.
I20260709 13:15:36.545598  3995 raft_consensus.cc:493] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.532831  3803 consensus_queue.cc:1048] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:15:36.558590  3974 consensus_queue.cc:1048] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:36.568802  3984 raft_consensus.cc:2749] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:36.578260  3486 raft_consensus.cc:3060] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.569247  3995 raft_consensus.cc:515] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:36.597379  3995 leader_election.cc:290] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:36.599598  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90df71c989bb49dda47f16aa67340ef6" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:36.602352  3414 raft_consensus.cc:2468] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:36.609395  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90df71c989bb49dda47f16aa67340ef6" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:36.610116  3268 raft_consensus.cc:2468] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 0.
I20260709 13:15:36.616372  3307 leader_election.cc:304] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:36.624887  3995 raft_consensus.cc:2804] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.625425  3995 raft_consensus.cc:493] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.625870  3995 raft_consensus.cc:3060] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.700996  3267 raft_consensus.cc:2468] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:36.703002  3455 leader_election.cc:304] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726
I20260709 13:15:36.704385  3974 raft_consensus.cc:2804] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.704922  3974 raft_consensus.cc:697] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:36.705839  3974 consensus_queue.cc:237] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.694269  3540 tablet_bootstrap.cc:654] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:36.736913  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 138017us
W20260709 13:15:36.735667  3384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 161492us
I20260709 13:15:36.742986  3163 catalog_manager.cc:5697] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.768405  3726 consensus_queue.cc:1048] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:36.776932  3539 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:36.777577  3539 ts_tablet_manager.cc:1403] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.402s	user 0.014s	sys 0.003s
I20260709 13:15:36.783047  3539 raft_consensus.cc:359] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.783834  3539 raft_consensus.cc:385] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.784153  3539 raft_consensus.cc:740] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.788627  3995 raft_consensus.cc:515] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:36.785732  3539 consensus_queue.cc:260] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:36.861737  3995 leader_election.cc:290] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
W20260709 13:15:36.862299  3234 consensus_peers.cc:597] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:36.871196  3539 ts_tablet_manager.cc:1434] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 13:15:36.874262  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90df71c989bb49dda47f16aa67340ef6" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:36.875087  3414 raft_consensus.cc:3060] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.866490  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90df71c989bb49dda47f16aa67340ef6" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc"
I20260709 13:15:36.882903  3265 raft_consensus.cc:3060] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.899307  3540 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743: No bootstrap required, opened a new log
I20260709 13:15:36.899942  3540 ts_tablet_manager.cc:1403] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743: Time spent bootstrapping tablet: real 0.346s	user 0.007s	sys 0.018s
I20260709 13:15:36.908671  3414 raft_consensus.cc:2468] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:36.909400  3539 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726: Bootstrap starting.
I20260709 13:15:36.910264  3309 leader_election.cc:304] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:36.911549  4043 raft_consensus.cc:2804] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.912108  4043 raft_consensus.cc:697] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:36.913153  4043 consensus_queue.cc:237] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:36.916082  3682 consensus_queue.cc:1048] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.922297  3265 raft_consensus.cc:2468] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:36.929399  3540 raft_consensus.cc:359] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.937345  3540 raft_consensus.cc:385] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.943466  3539 tablet_bootstrap.cc:654] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.937745  3540 raft_consensus.cc:740] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.951666  3540 consensus_queue.cc:260] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:36.955432  3540 ts_tablet_manager.cc:1434] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.005s
I20260709 13:15:36.997593  3539 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726: No bootstrap required, opened a new log
I20260709 13:15:36.998659  3539 ts_tablet_manager.cc:1403] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726: Time spent bootstrapping tablet: real 0.096s	user 0.023s	sys 0.018s
I20260709 13:15:37.006224  3539 raft_consensus.cc:359] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:37.007392  3539 raft_consensus.cc:385] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.007686  3539 raft_consensus.cc:740] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.008517  3539 consensus_queue.cc:260] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:37.011343  3539 ts_tablet_manager.cc:1434] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:37.025686  3987 raft_consensus.cc:493] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.026193  3987 raft_consensus.cc:515] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:37.028610  3987 leader_election.cc:290] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:37.030644  3486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:37.031698  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc0678dd7da4af08ae4454d8b3e9f32" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:37.032778  3265 raft_consensus.cc:2393] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680bff02deaf497e885eb83e37cca726 in current term 1: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:37.039544  3381 leader_election.cc:304] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:37.041589  4039 raft_consensus.cc:3060] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.055764  3164 catalog_manager.cc:5697] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 1 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.065080  3987 raft_consensus.cc:493] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.065754  3987 raft_consensus.cc:515] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:37.074011  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:37.077093  3987 leader_election.cc:290] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:37.069468  4039 raft_consensus.cc:2749] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:37.079370  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bf210b6f6b4a11a7bfbf815676b433" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:37.081014  3381 leader_election.cc:304] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:37.086917  4043 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.087556  4043 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:37.088876  3167 catalog_manager.cc:5697] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.090723  4043 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:37.091672  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f99770bc87e426a893fc425299485cc" is_pre_election: true
I20260709 13:15:37.092077  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:37.094115  4039 raft_consensus.cc:2749] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:37.098063  3307 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:37.099138  4043 raft_consensus.cc:2749] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:37.700238  4062 consensus_queue.cc:1048] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:37.735080  3410 raft_consensus.cc:3060] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.774570  3995 consensus_queue.cc:1048] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:37.859472  3344 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:37.866946  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 81245.8us
I20260709 13:15:37.892654  4062 consensus_queue.cc:1048] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:37.936235  4061 consensus_queue.cc:1048] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:37.950691  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 44870.4us
I20260709 13:15:38.173982 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
W20260709 13:15:38.181201  3381 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:15:38.186188  3381 consensus_peers.cc:597] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.202898  3455 consensus_peers.cc:597] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.226671 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:38.228266 28250 tablet_replica.cc:333] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.230021 28250 raft_consensus.cc:2243] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.231382 28250 raft_consensus.cc:2272] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.235031 28250 tablet_replica.cc:333] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.235983 28250 raft_consensus.cc:2243] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.237048 28250 raft_consensus.cc:2272] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.239627 28250 tablet_replica.cc:333] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.240343 28250 raft_consensus.cc:2243] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.240906 28250 raft_consensus.cc:2272] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.243283 28250 tablet_replica.cc:333] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.244199 28250 raft_consensus.cc:2243] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.244661 28250 raft_consensus.cc:2272] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.246603 28250 tablet_replica.cc:333] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.247313 28250 raft_consensus.cc:2243] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.247841 28250 raft_consensus.cc:2272] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.251062 28250 tablet_replica.cc:333] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.252142 28250 raft_consensus.cc:2243] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.253365 28250 raft_consensus.cc:2272] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.256050 28250 tablet_replica.cc:333] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.256848 28250 raft_consensus.cc:2243] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.257402 28250 raft_consensus.cc:2272] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.260139 28250 tablet_replica.cc:333] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.261029 28250 raft_consensus.cc:2243] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.262123 28250 raft_consensus.cc:2272] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.264894 28250 tablet_replica.cc:333] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.265767 28250 raft_consensus.cc:2243] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.266320 28250 raft_consensus.cc:2272] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.269022 28250 tablet_replica.cc:333] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.269899 28250 raft_consensus.cc:2243] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.270488 28250 raft_consensus.cc:2272] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.273633 28250 tablet_replica.cc:333] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.274706 28250 raft_consensus.cc:2243] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.275266 28250 raft_consensus.cc:2272] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.278118 28250 tablet_replica.cc:333] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.279093 28250 raft_consensus.cc:2243] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.280187 28250 raft_consensus.cc:2272] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.281852  3307 consensus_peers.cc:597] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.283392 28250 tablet_replica.cc:333] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.284547 28250 raft_consensus.cc:2243] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.285148 28250 raft_consensus.cc:2272] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.288189 28250 tablet_replica.cc:333] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.289048 28250 raft_consensus.cc:2243] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.289999 28250 raft_consensus.cc:2272] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.292742 28250 tablet_replica.cc:333] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.293581 28250 raft_consensus.cc:2243] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.294116 28250 raft_consensus.cc:2272] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.296128  3307 consensus_peers.cc:597] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.297000 28250 tablet_replica.cc:333] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.297756 28250 raft_consensus.cc:2243] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.298224 28250 raft_consensus.cc:2272] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.300446 28250 tablet_replica.cc:333] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.301131 28250 raft_consensus.cc:2243] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.301647 28250 raft_consensus.cc:2272] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.303894 28250 tablet_replica.cc:333] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.304641 28250 raft_consensus.cc:2243] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.305085 28250 raft_consensus.cc:2272] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.307219 28250 tablet_replica.cc:333] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.308140 28250 raft_consensus.cc:2243] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.309377 28250 raft_consensus.cc:2272] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.312511 28250 tablet_replica.cc:333] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
W20260709 13:15:38.312654  3307 consensus_peers.cc:597] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.313428 28250 raft_consensus.cc:2243] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:38.313822  3381 consensus_peers.cc:597] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.314103 28250 raft_consensus.cc:2272] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.316597 28250 tablet_replica.cc:333] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.317353 28250 raft_consensus.cc:2243] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.318261 28250 raft_consensus.cc:2272] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.321376 28250 tablet_replica.cc:333] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.322129 28250 raft_consensus.cc:2243] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.322772 28250 raft_consensus.cc:2272] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.325209 28250 tablet_replica.cc:333] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.326097 28250 raft_consensus.cc:2243] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.327286 28250 raft_consensus.cc:2272] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.328763  3455 consensus_peers.cc:597] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.329911 28250 tablet_replica.cc:333] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.330771 28250 raft_consensus.cc:2243] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.331264 28250 raft_consensus.cc:2272] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.333842 28250 tablet_replica.cc:333] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.334496 28250 raft_consensus.cc:2243] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.335387 28250 raft_consensus.cc:2272] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.337651 28250 tablet_replica.cc:333] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.338604 28250 raft_consensus.cc:2243] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.339200 28250 raft_consensus.cc:2272] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.342458 28250 tablet_replica.cc:333] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.343331 28250 raft_consensus.cc:2243] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.344172 28250 raft_consensus.cc:2272] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.346606 28250 tablet_replica.cc:333] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.347433 28250 raft_consensus.cc:2243] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.348496 28250 raft_consensus.cc:2272] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.351236 28250 tablet_replica.cc:333] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.352165 28250 raft_consensus.cc:2243] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.353345 28250 raft_consensus.cc:2272] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.356480 28250 tablet_replica.cc:333] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
W20260709 13:15:38.356691  3455 consensus_peers.cc:597] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.357275 28250 raft_consensus.cc:2243] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:38.357611  3455 consensus_peers.cc:597] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.358595 28250 raft_consensus.cc:2272] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.361846 28250 tablet_replica.cc:333] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.362756 28250 raft_consensus.cc:2243] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.363265 28250 raft_consensus.cc:2272] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.365931 28250 tablet_replica.cc:333] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.366679 28250 raft_consensus.cc:2243] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.367563 28250 raft_consensus.cc:2272] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.369810 28250 tablet_replica.cc:333] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.370463 28250 raft_consensus.cc:2243] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.370924 28250 raft_consensus.cc:2272] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.373138 28250 tablet_replica.cc:333] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.373762 28250 raft_consensus.cc:2243] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.374825 28250 raft_consensus.cc:2272] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.377003 28250 tablet_replica.cc:333] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.377595 28250 raft_consensus.cc:2243] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.378640 28250 raft_consensus.cc:2272] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.381767 28250 tablet_replica.cc:333] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.382606 28250 raft_consensus.cc:2243] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.383128 28250 raft_consensus.cc:2272] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.383216  3455 consensus_peers.cc:597] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.385499 28250 tablet_replica.cc:333] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.386281 28250 raft_consensus.cc:2243] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.386899 28250 raft_consensus.cc:2272] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.389822 28250 tablet_replica.cc:333] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.390566 28250 raft_consensus.cc:2243] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.391074 28250 raft_consensus.cc:2272] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.393954 28250 tablet_replica.cc:333] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.394562 28250 raft_consensus.cc:2243] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.395467 28250 raft_consensus.cc:2272] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.398404 28250 tablet_replica.cc:333] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.399222 28250 raft_consensus.cc:2243] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.399829 28250 raft_consensus.cc:2272] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.402863 28250 tablet_replica.cc:333] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.403512 28250 raft_consensus.cc:2243] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.404503 28250 raft_consensus.cc:2272] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.406713 28250 tablet_replica.cc:333] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.407372 28250 raft_consensus.cc:2243] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.407850 28250 raft_consensus.cc:2272] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.409832 28250 tablet_replica.cc:333] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.410310 28250 raft_consensus.cc:2243] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.410761 28250 raft_consensus.cc:2272] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.412981 28250 tablet_replica.cc:333] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.413697 28250 raft_consensus.cc:2243] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.415192 28250 raft_consensus.cc:2272] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.418268 28250 tablet_replica.cc:333] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: stopping tablet replica
I20260709 13:15:38.418843 28250 raft_consensus.cc:2243] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.419968 28250 raft_consensus.cc:2272] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.457094  3455 consensus_peers.cc:597] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.481913  3455 consensus_peers.cc:597] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.502599  3307 consensus_peers.cc:597] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.514240 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
W20260709 13:15:38.538595  3381 consensus_peers.cc:597] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.557483  3381 consensus_peers.cc:597] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.590814  3381 consensus_peers.cc:597] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.601616  3455 consensus_peers.cc:597] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.610764  3455 consensus_peers.cc:597] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.613335  3439 debug-util.cc:398] Leaking SignalData structure 0x7b080013d6e0 after lost signal to thread 28253
W20260709 13:15:38.615005  3439 debug-util.cc:398] Leaking SignalData structure 0x7b080027d200 after lost signal to thread 3201
W20260709 13:15:38.615873  3381 consensus_peers.cc:597] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.618283  3439 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecf80 after lost signal to thread 3368
W20260709 13:15:38.620069  3439 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8b00 after lost signal to thread 3442
W20260709 13:15:38.621704  3439 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebcc0 after lost signal to thread 3516
W20260709 13:15:38.622416  3439 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4b00 after lost signal to thread 4011
I20260709 13:15:38.622965 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:38.632282  4087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.632395  4088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.641923  4091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.644724  3455 consensus_peers.cc:597] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.645689 28250 server_base.cc:1061] running on GCE node
I20260709 13:15:38.655731 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:38.656142 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
W20260709 13:15:38.655929  3455 consensus_peers.cc:597] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.656415 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602938656401 us; error 0 us; skew 500 ppm
I20260709 13:15:38.657276 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:38.660807 28250 webserver.cc:533] Webserver started at http://127.27.150.129:45375/ using document root <none> and password file <none>
I20260709 13:15:38.661466 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:38.661715 28250 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:15:38.666967 28250 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:15:38.676743  4095 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.677637 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:15:38.677980 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "9f99770bc87e426a893fc425299485cc"
format_stamp: "Formatted at 2026-07-09 13:15:24 on dist-test-slave-nvvq"
I20260709 13:15:38.678473 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:38.704514 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:38.706656 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:38.710183 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:15:38.713512  3381 consensus_peers.cc:597] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.722398  4102 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:15:38.758733  3455 consensus_peers.cc:597] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.776327  3455 consensus_peers.cc:597] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:39.071772 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:15:39.072343 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.352s	user 0.010s	sys 0.002s
I20260709 13:15:39.072774 28250 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:15:39.083017  4102 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.147491  4102 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.148658  4102 tablet_bootstrap.cc:492] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.149417  4102 ts_tablet_manager.cc:1403] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.000s
I20260709 13:15:39.170622  4055 raft_consensus.cc:493] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.171334  4055 raft_consensus.cc:515] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.172650  4102 raft_consensus.cc:359] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.173538  4102 raft_consensus.cc:740] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.173731  4055 leader_election.cc:290] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.174701  4102 consensus_queue.cc:260] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.175951  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.191787  4102 ts_tablet_manager.cc:1434] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 13:15:39.192898  4102 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:39.211061  3381 leader_election.cc:336] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.211671  3381 leader_election.cc:304] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.212463  4065 raft_consensus.cc:2749] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.222028  4102 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.223338  4102 tablet_bootstrap.cc:492] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.224200  4102 ts_tablet_manager.cc:1403] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:15:39.227437  4102 raft_consensus.cc:359] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.228289  4102 raft_consensus.cc:740] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.238428  4102 consensus_queue.cc:260] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.240808  4102 ts_tablet_manager.cc:1434] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:39.241729  4102 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.267961  4102 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.274930  4102 tablet_bootstrap.cc:492] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.276088  4102 ts_tablet_manager.cc:1403] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.011s
I20260709 13:15:39.279361  4102 raft_consensus.cc:359] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.280161  4102 raft_consensus.cc:740] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.281231  4102 consensus_queue.cc:260] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.283746  4102 ts_tablet_manager.cc:1434] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:15:39.284696  4102 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.313521  4055 raft_consensus.cc:493] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.314260  4055 raft_consensus.cc:515] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.319851  4102 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.321159  4102 tablet_bootstrap.cc:492] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.322022  4102 ts_tablet_manager.cc:1403] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.007s
I20260709 13:15:39.323237  4065 raft_consensus.cc:493] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.323844  4065 raft_consensus.cc:515] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.325197  4102 raft_consensus.cc:359] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.326014  4102 raft_consensus.cc:740] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.326049  4065 leader_election.cc:290] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.316707  4055 leader_election.cc:290] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:39.340500  3381 leader_election.cc:336] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.327054  4102 consensus_queue.cc:260] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.330879  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.330901  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.344908  4102 ts_tablet_manager.cc:1434] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:15:39.345855  4102 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.345621  3383 leader_election.cc:304] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.347915  4055 raft_consensus.cc:2749] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:39.351559  3381 leader_election.cc:336] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.352144  3381 leader_election.cc:304] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.353178  4065 raft_consensus.cc:2749] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.367609  4102 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.368685  4102 tablet_bootstrap.cc:492] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.369369  4102 ts_tablet_manager.cc:1403] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:15:39.373867  4083 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.374569  4083 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.376767  4083 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.372138  4102 raft_consensus.cc:359] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.377575  4102 raft_consensus.cc:740] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.378504  4102 consensus_queue.cc:260] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.381072  4102 ts_tablet_manager.cc:1434] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:15:39.381997  4102 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.384075  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:39.396255  3307 leader_election.cc:336] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.396797  3307 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.398326  4076 raft_consensus.cc:493] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.402490  4076 raft_consensus.cc:515] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.405246  4083 raft_consensus.cc:2749] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.410506  4102 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.411669  4102 tablet_bootstrap.cc:492] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.412460  4102 ts_tablet_manager.cc:1403] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 13:15:39.419736  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.420567  3410 raft_consensus.cc:2468] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:39.427281  3457 leader_election.cc:304] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:39.428172  4071 raft_consensus.cc:2804] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.428577  4071 raft_consensus.cc:493] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.428903  4071 raft_consensus.cc:3060] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.430822  3455 leader_election.cc:336] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.455161  4102 raft_consensus.cc:359] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.456094  4102 raft_consensus.cc:740] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.457012  4102 consensus_queue.cc:260] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.459388  4102 ts_tablet_manager.cc:1434] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:15:39.460311  4102 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.488566  4102 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.489718  4102 tablet_bootstrap.cc:492] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.435154  4076 leader_election.cc:290] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.490512  4102 ts_tablet_manager.cc:1403] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.007s
I20260709 13:15:39.493865  4102 raft_consensus.cc:359] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.494789  4102 raft_consensus.cc:740] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.495527  4065 raft_consensus.cc:493] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.495692  4102 consensus_queue.cc:260] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.496251  4065 raft_consensus.cc:515] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.498292  4102 ts_tablet_manager.cc:1434] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:39.499221  4102 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.504344  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.523038  4102 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.524237  4102 tablet_bootstrap.cc:492] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.525321  4102 ts_tablet_manager.cc:1403] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.012s
I20260709 13:15:39.528549  4102 raft_consensus.cc:359] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.532922  4102 raft_consensus.cc:740] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.534411  4076 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.527340  4065 leader_election.cc:290] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.536849  4102 consensus_queue.cc:260] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.537876  4069 raft_consensus.cc:493] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.538546  4069 raft_consensus.cc:515] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.539206 28250 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:15:39.539729 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.467s	user 0.308s	sys 0.005s
I20260709 13:15:39.541676  4069 leader_election.cc:290] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.543684  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.546240  4102 ts_tablet_manager.cc:1434] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:39.547241  4102 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.547648  4069 raft_consensus.cc:493] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.548171  4069 raft_consensus.cc:515] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.552351  4115 raft_consensus.cc:493] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.553056  4115 raft_consensus.cc:515] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.555274  4110 raft_consensus.cc:493] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.555883  4110 raft_consensus.cc:515] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.556811  4115 leader_election.cc:290] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:15:39.557687  3381 leader_election.cc:336] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.562836  3381 leader_election.cc:304] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.563751  4069 leader_election.cc:290] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.558074  4110 leader_election.cc:290] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.559679  4111 raft_consensus.cc:493] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.535070  4076 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:39.560236  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 119714us
I20260709 13:15:39.566006  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.566082  4111 raft_consensus.cc:515] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.553117  4071 raft_consensus.cc:515] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.568612  4111 leader_election.cc:290] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.570616  4076 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:39.572854  3307 leader_election.cc:336] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.574426  3307 leader_election.cc:304] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
W20260709 13:15:39.575712  3307 leader_election.cc:336] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.565653  4065 raft_consensus.cc:2749] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.576345  3307 leader_election.cc:304] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.576504  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.572641  4071 leader_election.cc:290] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.578260  4069 raft_consensus.cc:2749] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.579612  4083 raft_consensus.cc:2749] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:39.581960  3455 leader_election.cc:336] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.582571  3455 leader_election.cc:336] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.583473  3455 leader_election.cc:336] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.586287  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03783871be14ed0a80c20c2be3e1b73" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.589697  4055 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.590298  4055 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.590687  4083 raft_consensus.cc:493] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.591259  4083 raft_consensus.cc:515] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.593497  4083 leader_election.cc:290] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.594135  4110 raft_consensus.cc:493] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.594445  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.594790  4110 raft_consensus.cc:515] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.595196  3342 raft_consensus.cc:2468] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:39.594326  3457 leader_election.cc:304] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.596993  4110 leader_election.cc:290] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.597474  4116 raft_consensus.cc:2749] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.598343  4055 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.598978  3457 leader_election.cc:304] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.599082  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ae694390334d8583cdad82212fb301" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.599872  4110 raft_consensus.cc:2749] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.601048  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.603188  4069 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.603735  4069 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.605823  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99a38ce9bfc4c8896ba84328639b90b" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:39.606065  4069 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.606163  4083 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.606544  3417 raft_consensus.cc:3060] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.606879  4083 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.607230  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.609308  4083 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.612030  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.615037  3417 raft_consensus.cc:2468] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
W20260709 13:15:39.605474  3455 leader_election.cc:336] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.617353  3455 leader_election.cc:336] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.619239  3307 leader_election.cc:336] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.620519  4102 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.621616  4102 tablet_bootstrap.cc:492] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.622612  4102 ts_tablet_manager.cc:1403] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.004s
I20260709 13:15:39.623471  4083 raft_consensus.cc:493] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.624419  4083 raft_consensus.cc:515] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.623975  3457 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.625871  4102 raft_consensus.cc:359] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:39.626621  3455 leader_election.cc:336] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.626623  4102 raft_consensus.cc:740] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.628135  4110 raft_consensus.cc:2804] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.627869  4102 consensus_queue.cc:260] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.628592  4110 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.629002  4110 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.630466  4102 ts_tablet_manager.cc:1434] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:39.631451  4102 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.631248  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.632251  3410 raft_consensus.cc:2468] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:39.634720  3309 leader_election.cc:304] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:39.635754  4069 raft_consensus.cc:2804] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.636415  4069 raft_consensus.cc:493] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.636806  4069 raft_consensus.cc:3060] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.640009  4110 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.641271  4055 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.641808  4055 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.644248  4055 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.646804  4083 leader_election.cc:290] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.647819  4055 raft_consensus.cc:493] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.648471  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.648358  4055 raft_consensus.cc:515] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.650413  3995 raft_consensus.cc:493] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.651031  3995 raft_consensus.cc:515] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.653877  4055 leader_election.cc:290] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.653110  3995 leader_election.cc:290] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.655296  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.656765  3310 leader_election.cc:304] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.658754  4065 raft_consensus.cc:493] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.659319  4065 raft_consensus.cc:515] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.660055  4071 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.660799  4071 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.662257  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03783871be14ed0a80c20c2be3e1b73" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.662765  4065 leader_election.cc:290] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.663012  3490 raft_consensus.cc:2468] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:39.663687  4071 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.664660  3384 leader_election.cc:304] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:39.665609  4065 raft_consensus.cc:2804] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.666047  4065 raft_consensus.cc:493] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.666504  4065 raft_consensus.cc:3060] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.667141  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.671885  3457 leader_election.cc:304] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.673175  4102 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:39.672024  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a79b63b8204a21b06b365598657efb" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.673395  4111 raft_consensus.cc:2804] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.678150  4111 raft_consensus.cc:697] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:39.663378  4083 raft_consensus.cc:2749] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.673961  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.679605  3490 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:39.679163  4111 consensus_queue.cc:237] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.678673  4102 tablet_bootstrap.cc:492] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:39.684307  4102 ts_tablet_manager.cc:1403] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.004s
I20260709 13:15:39.682112  4110 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.686928  4071 raft_consensus.cc:493] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.674295  3457 leader_election.cc:304] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
W20260709 13:15:39.688234  3307 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.688756  3307 leader_election.cc:336] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.689087  3307 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.691708  4102 raft_consensus.cc:359] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.692461  4102 raft_consensus.cc:740] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.693176  4083 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.693814  4083 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.693382  4102 consensus_queue.cc:260] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.695655  4065 raft_consensus.cc:515] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.697026  4102 ts_tablet_manager.cc:1434] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:15:39.687647  4071 raft_consensus.cc:515] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.697386  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.698019  3417 raft_consensus.cc:2468] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
W20260709 13:15:39.699101  3381 leader_election.cc:336] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.699187  3309 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:39.699951  3381 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.700429  3995 raft_consensus.cc:2804] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.698112  4102 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:39.700938  3995 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.701421  3995 raft_consensus.cc:3060] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.704528  3455 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.707295  4118 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.708055  4118 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.709851  4115 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.710376  4115 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.711459  4055 raft_consensus.cc:2749] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.711664  4056 raft_consensus.cc:493] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.712288  4056 raft_consensus.cc:515] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:39.717685  3381 leader_election.cc:336] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.721057  3381 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
W20260709 13:15:39.722781  3381 leader_election.cc:336] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.725719  3381 leader_election.cc:304] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bff02deaf497e885eb83e37cca726; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
W20260709 13:15:39.726810  3381 leader_election.cc:336] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.703358  4110 raft_consensus.cc:2749] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.706560  4083 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.725749  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.734954  3342 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:39.714365  4056 leader_election.cc:290] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.735885  4056 raft_consensus.cc:2749] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.737459  4056 raft_consensus.cc:493] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.739297  4083 raft_consensus.cc:493] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.739862  4083 raft_consensus.cc:515] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.742103  4083 leader_election.cc:290] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.706750  4069 raft_consensus.cc:515] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.744501  4069 leader_election.cc:290] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.724785  4055 raft_consensus.cc:2749] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.753289  3167 catalog_manager.cc:5697] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.737929  4056 raft_consensus.cc:515] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.761270  4129 raft_consensus.cc:2749] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:39.767590  3455 leader_election.cc:336] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.812294  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f240b1bc43564ebb9629430509c691e1" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:39.744973  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:39.813879  3417 raft_consensus.cc:3060] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.814646  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ae694390334d8583cdad82212fb301" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.815469  3344 raft_consensus.cc:2468] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:39.767267  4076 raft_consensus.cc:493] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.816794  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.803992  4069 raft_consensus.cc:493] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.822726  4126 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.823984  3457 leader_election.cc:304] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.824877  3417 raft_consensus.cc:2468] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
W20260709 13:15:39.825371  3307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 136604us
I20260709 13:15:39.827138  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.828153  3726 raft_consensus.cc:493] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.817530  3339 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.829272  3726 raft_consensus.cc:515] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.819422  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.817276  4129 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.842389  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03783871be14ed0a80c20c2be3e1b73" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:39.843051  3490 raft_consensus.cc:3060] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.843971  4065 leader_election.cc:290] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.829523  4069 raft_consensus.cc:515] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.845887  4115 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.848004  4118 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.820827  4076 raft_consensus.cc:515] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.851024  4071 leader_election.cc:290] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.851439  4076 leader_election.cc:290] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.852649  4056 leader_election.cc:290] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:39.853534  3455 leader_election.cc:336] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.854595  4124 raft_consensus.cc:493] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.855163  4124 raft_consensus.cc:515] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.823275  4126 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.856225  3490 raft_consensus.cc:2468] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:39.856735  3344 raft_consensus.cc:2468] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:39.857533  4124 leader_election.cc:290] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.858425  4083 raft_consensus.cc:493] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.859063  4083 raft_consensus.cc:515] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.861014  3384 leader_election.cc:304] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:39.861344  4083 leader_election.cc:290] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:39.861676  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a79b63b8204a21b06b365598657efb" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.862072  4125 raft_consensus.cc:2804] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.862666  4125 raft_consensus.cc:697] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:39.839303  3457 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.826642  3342 raft_consensus.cc:2468] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:39.837473  3309 leader_election.cc:304] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:39.841750  3410 raft_consensus.cc:2468] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:39.841892  3726 leader_election.cc:290] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.836635  4130 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.839793  4134 raft_consensus.cc:2749] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.818320  4131 raft_consensus.cc:493] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.866046  3457 leader_election.cc:304] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:39.842460  4129 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.877903  4128 raft_consensus.cc:493] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.846174  4069 leader_election.cc:290] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.857595  4126 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.863611  4125 consensus_queue.cc:237] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:39.882861  3726 raft_consensus.cc:2804] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:39.886627  3307 leader_election.cc:336] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.868333  4116 raft_consensus.cc:2804] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.887164  4131 raft_consensus.cc:515] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.880728  4083 raft_consensus.cc:493] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.890254  4126 raft_consensus.cc:2804] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.882004  4130 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.891058  3995 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.891332  4128 raft_consensus.cc:515] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.892824  3726 raft_consensus.cc:493] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.895927  3457 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.904088  3726 raft_consensus.cc:3060] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.896904  3383 leader_election.cc:304] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:39.896993  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:39.897475  3307 leader_election.cc:336] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.901705  4083 raft_consensus.cc:515] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.894665  4116 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.905562  3307 leader_election.cc:304] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.908138  4083 leader_election.cc:290] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.915804  4083 raft_consensus.cc:2749] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.908990  4129 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.909160  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.917660  3337 raft_consensus.cc:2468] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:39.909687  4126 raft_consensus.cc:697] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:39.919780  3995 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:39.919497  4126 consensus_queue.cc:237] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.900723  3489 raft_consensus.cc:2468] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:39.920763  4056 raft_consensus.cc:2804] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.921957  3383 leader_election.cc:304] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
W20260709 13:15:39.930016  3307 leader_election.cc:336] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.923096  4065 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.911545  4131 leader_election.cc:290] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.923753  3726 raft_consensus.cc:515] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.914223  3344 raft_consensus.cc:2468] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
W20260709 13:15:39.914755  3455 leader_election.cc:336] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.914777  4116 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.906834  4071 raft_consensus.cc:2804] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.912962  4130 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:39.892868  3310 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
W20260709 13:15:39.948254  3310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 67493us
I20260709 13:15:39.951611  3384 leader_election.cc:304] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:39.927067  4128 leader_election.cc:290] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:39.931756  3307 leader_election.cc:336] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.940829  3726 leader_election.cc:290] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:39.934851  3455 leader_election.cc:336] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.938927  3457 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.932682  4056 raft_consensus.cc:493] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.961753  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.962256  4056 raft_consensus.cc:3060] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.962489  3490 raft_consensus.cc:2468] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
W20260709 13:15:39.964473  3307 leader_election.cc:336] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.965150  3307 leader_election.cc:336] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.965996  3307 leader_election.cc:336] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.934186  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.960566  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ae694390334d8583cdad82212fb301" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:39.966750  3342 raft_consensus.cc:2468] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:39.961407  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.957598  4130 raft_consensus.cc:2804] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.967675  4130 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
W20260709 13:15:39.967762  3307 leader_election.cc:336] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.968122  4130 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.968467  3307 leader_election.cc:336] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.969081  3307 leader_election.cc:336] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:39.969941  3307 leader_election.cc:336] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.938021  4055 raft_consensus.cc:2804] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.932512  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:39.970636  4055 raft_consensus.cc:493] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
W20260709 13:15:39.970738  3307 leader_election.cc:336] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.944748  4071 raft_consensus.cc:493] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.971174  4055 raft_consensus.cc:3060] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.966800  3344 raft_consensus.cc:3060] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.960718  4115 raft_consensus.cc:2804] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.971882  4115 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.972308  4115 raft_consensus.cc:3060] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.972028  3457 leader_election.cc:304] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:39.976608  4076 raft_consensus.cc:2804] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.977077  4076 raft_consensus.cc:493] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.977543  4076 raft_consensus.cc:3060] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.932114  4065 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:39.971462  4071 raft_consensus.cc:3060] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.980201  4065 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:39.980831  4140 raft_consensus.cc:2804] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.981352  4140 raft_consensus.cc:493] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:39.981065  4115 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:39.981798  4140 raft_consensus.cc:3060] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.971515  3307 leader_election.cc:336] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.984417  4115 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:39.987111  3455 leader_election.cc:336] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.988847  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:39.970894  3415 raft_consensus.cc:2468] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 1.
I20260709 13:15:39.989511  3342 raft_consensus.cc:3060] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.990085  3455 leader_election.cc:336] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:39.940871  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:39.991317  3337 raft_consensus.cc:2468] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:39.993754  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.994211  3310 leader_election.cc:304] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:39.994359  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.994860  3486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:39.994412  3488 raft_consensus.cc:2468] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:40.001122  3310 leader_election.cc:304] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.006779  3486 raft_consensus.cc:2393] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 2: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
W20260709 13:15:39.942160  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 111773us
I20260709 13:15:40.010531  4141 raft_consensus.cc:2804] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.011037  4141 raft_consensus.cc:493] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.011449  4141 raft_consensus.cc:3060] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.014897  3310 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.017586  4056 raft_consensus.cc:515] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.028064  4056 leader_election.cc:290] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.006119  3344 raft_consensus.cc:2468] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:40.022251  3383 leader_election.cc:304] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:40.028224  3339 raft_consensus.cc:2468] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:40.031378  4056 raft_consensus.cc:2804] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.032150  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:40.033290  3410 raft_consensus.cc:2468] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:40.034412  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:40.035072  3418 raft_consensus.cc:2468] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 1.
I20260709 13:15:40.036837  3457 leader_election.cc:304] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:40.042060  3457 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.047001  4118 raft_consensus.cc:2804] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.047377  3342 raft_consensus.cc:2468] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:40.047566  4118 raft_consensus.cc:697] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:40.048512  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b0080a141145e687e0d361ecf150d3" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:40.048933  4069 raft_consensus.cc:2749] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.048600  4118 consensus_queue.cc:237] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.049268  3340 raft_consensus.cc:3060] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.051254  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:40.051915  3339 raft_consensus.cc:2468] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 1.
I20260709 13:15:40.052080  4115 raft_consensus.cc:2804] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.052667  4115 raft_consensus.cc:697] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:40.053507  4115 consensus_queue.cc:237] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.055665  3457 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:40.056749  4116 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.057591  4110 raft_consensus.cc:2804] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.058116  4110 raft_consensus.cc:697] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:40.041605  4129 raft_consensus.cc:2804] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.058825  4129 raft_consensus.cc:493] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.059206  4129 raft_consensus.cc:3060] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:40.059404  3455 leader_election.cc:336] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.061192  3340 raft_consensus.cc:2468] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
W20260709 13:15:40.062464  3455 leader_election.cc:336] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.074896  4076 raft_consensus.cc:515] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.076262  3490 raft_consensus.cc:2393] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 2: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:40.044358  4056 raft_consensus.cc:493] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.079218  3383 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:40.082667  3383 leader_election.cc:304] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:40.024449  4071 raft_consensus.cc:515] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.086663  3310 leader_election.cc:304] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.089464  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:40.090219  3410 raft_consensus.cc:3060] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.091315  4143 raft_consensus.cc:2804] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.091789  4143 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.092137  4143 raft_consensus.cc:3060] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.062400  4110 consensus_queue.cc:237] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.106674  3995 raft_consensus.cc:3060] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.082906  4056 raft_consensus.cc:3060] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.114879  3489 raft_consensus.cc:2393] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 2: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:40.097681  4140 raft_consensus.cc:515] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:40.115823  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9e6e9c0bbf4380ac17aff9aafbbce0" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:40.117190  4140 leader_election.cc:290] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:40.089519  4065 raft_consensus.cc:2804] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.118069  3310 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.118117  4065 raft_consensus.cc:697] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:40.119791  4065 consensus_queue.cc:237] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.116537  4076 leader_election.cc:290] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.128243  4136 raft_consensus.cc:3060] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.129490  4130 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:40.130152  3455 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.131219  3309 leader_election.cc:304] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.133297  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a79b63b8204a21b06b365598657efb" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:40.134707  3995 raft_consensus.cc:2749] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.135715  4141 raft_consensus.cc:515] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.139647  4071 leader_election.cc:290] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.143220  4102 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:40.142827  4056 raft_consensus.cc:515] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.149674  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad4a106ba3345e0abae4ec0677ecda1" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:40.149937  4116 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.152062  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
W20260709 13:15:40.179207  3455 leader_election.cc:336] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.179293  3339 raft_consensus.cc:2468] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:40.180084  4130 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:15:40.171205  3381 leader_election.cc:336] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.173216  4129 raft_consensus.cc:515] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.169523  3489 raft_consensus.cc:3060] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.183686  3457 leader_election.cc:304] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.182773  4126 raft_consensus.cc:2804] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.187160  4102 tablet_bootstrap.cc:492] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:40.188745  4055 raft_consensus.cc:515] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:40.189683  3307 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.179296  3342 raft_consensus.cc:2393] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6861cafc7c054539ab0c01ec4986d417 in current term 2: Already voted for candidate 2fbbf37a29b6416eb787ce4c9238e743 in this term.
I20260709 13:15:40.191485  4143 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.218705  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:40.237771  3490 raft_consensus.cc:2393] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fbbf37a29b6416eb787ce4c9238e743 in current term 2: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:40.233376  3163 catalog_manager.cc:5697] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:40.197808  3455 leader_election.cc:336] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.224402  3457 leader_election.cc:304] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.229314  3414 raft_consensus.cc:1275] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.219241  4102 ts_tablet_manager.cc:1403] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.521s	user 0.015s	sys 0.028s
I20260709 13:15:40.244382  4129 leader_election.cc:290] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:40.222883  4126 raft_consensus.cc:493] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.245326  4126 raft_consensus.cc:3060] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.248436  3164 catalog_manager.cc:5697] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.240800  3486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9b8357182495897ba580d2a2949a3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:40.250319  3486 raft_consensus.cc:3060] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.254015  3457 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.255204  3410 raft_consensus.cc:2468] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:40.255968  4071 raft_consensus.cc:2804] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.256171  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b367f1f6e54c6cb98054e8c63ba9da" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:40.256484  4071 raft_consensus.cc:493] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.256970  4071 raft_consensus.cc:3060] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.257381  4127 raft_consensus.cc:2749] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.257983  3310 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743; no voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.256902  3490 raft_consensus.cc:3060] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:40.261585  3455 consensus_peers.cc:597] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:40.261873  4055 leader_election.cc:290] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.263875  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:40.264575  3342 raft_consensus.cc:3060] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.265110  4056 leader_election.cc:290] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.266170  4143 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.268026  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd4ae37bd2d49a0b6b94c695fdff604" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:40.268433  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:40.234813  4110 raft_consensus.cc:2804] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.268693  3339 raft_consensus.cc:3060] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.269043  3344 raft_consensus.cc:3060] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.269155  4110 raft_consensus.cc:697] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:40.270334  4110 consensus_queue.cc:237] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:40.192610  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 70681.1us
I20260709 13:15:40.272915  3309 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.277099  3339 raft_consensus.cc:2468] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:40.267438  4129 raft_consensus.cc:2749] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.277552  3489 raft_consensus.cc:2468] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:40.282856  4130 raft_consensus.cc:2804] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.283321  4130 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.283843  4130 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.285642  3383 leader_election.cc:304] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
W20260709 13:15:40.287189  3381 leader_election.cc:336] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.287299  3384 leader_election.cc:304] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:40.288251  4143 raft_consensus.cc:2804] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.291114  4143 raft_consensus.cc:697] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:40.292057  4143 consensus_queue.cc:237] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.293960  3342 raft_consensus.cc:2468] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:40.296499  3383 leader_election.cc:304] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:40.297756  4125 raft_consensus.cc:2804] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.298269  4125 raft_consensus.cc:697] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:40.299207  4125 consensus_queue.cc:237] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.223212  4141 leader_election.cc:290] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
W20260709 13:15:40.282218  3307 leader_election.cc:336] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.292425  4065 raft_consensus.cc:2804] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:40.314780  3381 leader_election.cc:336] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.316149  3381 leader_election.cc:336] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.311873  3307 leader_election.cc:336] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.278822  3344 raft_consensus.cc:2468] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:40.328521  3490 raft_consensus.cc:2468] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:40.283380  3486 raft_consensus.cc:2468] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:40.334239  3383 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
W20260709 13:15:40.336225  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 78941.2us
W20260709 13:15:40.323865  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 51070us
I20260709 13:15:40.337990  3309 leader_election.cc:304] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.325318  4065 raft_consensus.cc:697] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:40.344558  3310 leader_election.cc:304] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.345714  4131 raft_consensus.cc:2804] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.346225  4131 raft_consensus.cc:697] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:40.346601  3310 leader_election.cc:304] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.341310  3995 raft_consensus.cc:2804] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.347187  4131 consensus_queue.cc:237] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.348222  3309 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.336506  4071 raft_consensus.cc:515] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:40.347725  3995 raft_consensus.cc:493] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:15:40.351859  4083 raft_consensus.cc:2804] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.352463  4083 raft_consensus.cc:697] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:40.340440  4140 raft_consensus.cc:2804] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.353591  4140 raft_consensus.cc:697] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:40.353330  4083 consensus_queue.cc:237] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.354593  4140 consensus_queue.cc:237] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:40.360230  3381 leader_election.cc:336] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.361418  3381 leader_election.cc:336] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.362383  3381 leader_election.cc:336] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.369068  3381 leader_election.cc:336] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.350710  4134 consensus_queue.cc:1048] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:15:40.370410  4135 raft_consensus.cc:2804] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.357923  4065 consensus_queue.cc:237] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:40.371057  4135 raft_consensus.cc:697] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:40.372009  4135 consensus_queue.cc:237] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:40.370087  3381 leader_election.cc:336] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.374775  3381 leader_election.cc:336] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.375878  3381 leader_election.cc:336] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.373224  4130 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.350836  3995 raft_consensus.cc:3060] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.381240  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "6861cafc7c054539ab0c01ec4986d417" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:40.381893  3418 raft_consensus.cc:3060] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.382316  4071 leader_election.cc:290] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:40.383142  4102 raft_consensus.cc:359] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.383916  4102 raft_consensus.cc:740] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.384729  4102 consensus_queue.cc:260] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.397804  3418 raft_consensus.cc:2468] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
I20260709 13:15:40.405026  3457 leader_election.cc:304] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:40.415659  4110 raft_consensus.cc:2804] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.419322  4136 raft_consensus.cc:2749] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:40.446409  3307 consensus_peers.cc:597] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:40.446558  4102 ts_tablet_manager.cc:1434] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.204s	user 0.027s	sys 0.003s
I20260709 13:15:40.452517  4102 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:40.455117  3486 raft_consensus.cc:1275] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.462080  4130 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
W20260709 13:15:40.455336  4163 log.cc:927] Time spent T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:15:40.455359  4155 log.cc:927] Time spent T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:15:40.467917  4143 consensus_queue.cc:1048] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.444846  4110 raft_consensus.cc:697] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:40.482190  3340 raft_consensus.cc:2468] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6861cafc7c054539ab0c01ec4986d417 in term 2.
W20260709 13:15:40.494390  4164 log.cc:927] Time spent T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:15:40.497581  3307 leader_election.cc:336] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.499689  3455 leader_election.cc:336] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.496343  4165 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.502731  4165 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.505571  4165 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:40.521073  4110 consensus_queue.cc:237] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:40.525038  3995 raft_consensus.cc:515] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.539312  3412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:40.540271  3412 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.541947  4126 raft_consensus.cc:515] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.565647  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7cbd198b1c458b9835725ccdb37439" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:40.566339  3417 raft_consensus.cc:3060] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.558244  4126 leader_election.cc:290] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:40.571805  3339 raft_consensus.cc:1275] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.573663  3417 raft_consensus.cc:2468] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:40.574518  3342 raft_consensus.cc:1275] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.574186  3413 raft_consensus.cc:1275] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.577512  4071 consensus_queue.cc:1048] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:40.580744  3307 leader_election.cc:336] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:40.592471  3412 raft_consensus.cc:2468] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:40.618489  3457 leader_election.cc:304] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.627817  4127 raft_consensus.cc:2804] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.632737  4127 raft_consensus.cc:697] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Leader. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:40.633797  4127 consensus_queue.cc:237] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.636289  4173 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.636969  4173 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:40.638882  3995 leader_election.cc:290] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:40.616770  4076 consensus_queue.cc:1048] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:15:40.661101  3995 consensus_queue.cc:1048] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:15:40.685475  3309 leader_election.cc:304] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.689714  4173 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:40.756039  3340 raft_consensus.cc:1275] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.764739  3342 raft_consensus.cc:1275] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:40.759290  3307 leader_election.cc:336] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:15:40.759990  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 90620.4us
I20260709 13:15:40.784466  3726 consensus_queue.cc:1048] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.766883  4161 raft_consensus.cc:2804] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.762511  4140 consensus_queue.cc:1048] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:15:40.803752  3339 raft_consensus.cc:1275] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:40.825853  3381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 109918us
I20260709 13:15:40.796944  4161 raft_consensus.cc:697] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
W20260709 13:15:40.847508  3455 consensus_peers.cc:597] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:40.806396  3309 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:40.880847  4165 raft_consensus.cc:493] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.899084  4161 consensus_queue.cc:237] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.861219  4173 raft_consensus.cc:493] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.966841  4129 raft_consensus.cc:2804] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.968314  4129 raft_consensus.cc:697] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:40.969308  4129 consensus_queue.cc:237] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:40.945322  4165 raft_consensus.cc:515] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:40.972991  4165 leader_election.cc:290] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:40.973523  4165 raft_consensus.cc:493] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.973959  4165 raft_consensus.cc:515] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:40.982719  3309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 187994us
I20260709 13:15:41.031242  4102 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:41.032442  4102 tablet_bootstrap.cc:492] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:41.033260  4102 ts_tablet_manager.cc:1403] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.583s	user 0.022s	sys 0.004s
W20260709 13:15:41.039549  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 134272us
I20260709 13:15:40.956195  4173 raft_consensus.cc:515] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:41.049408  3344 raft_consensus.cc:1275] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.963264  4156 consensus_queue.cc:1048] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 13:15:41.048000  4152 log.cc:927] Time spent T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:15:41.070583  3307 consensus_peers.cc:597] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.085472  3455 consensus_peers.cc:597] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:41.086160  3455 consensus_peers.cc:597] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:41.086766  3455 consensus_peers.cc:597] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.088326  3455 consensus_peers.cc:597] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.089041  3455 consensus_peers.cc:597] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.091933  4203 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.092592  4203 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:41.097832  4202 consensus_queue.cc:1048] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.098645  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ad0659cde14de3b129b42d480176b3" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:41.099373  3410 raft_consensus.cc:3060] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.105947  3418 raft_consensus.cc:1275] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.111160  3338 raft_consensus.cc:1275] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.130844  4102 raft_consensus.cc:359] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:41.131951  4102 raft_consensus.cc:740] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.132917  4102 consensus_queue.cc:260] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:41.134668  3381 consensus_peers.cc:597] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.106035  4203 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:41.135398  3381 consensus_peers.cc:597] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.138887  3381 consensus_peers.cc:597] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.145462  4201 consensus_queue.cc:1048] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:15:41.147197  3338 raft_consensus.cc:1275] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:41.149312  4193 log.cc:927] Time spent T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:15:41.192139  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 147590us
I20260709 13:15:41.141064  4203 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:41.192941  4198 log.cc:927] Time spent T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:15:41.140599  4130 consensus_queue.cc:1048] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:41.205765  3490 raft_consensus.cc:1275] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:41.213639  3307 consensus_peers.cc:597] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.198635  4203 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:41.219717  3410 raft_consensus.cc:2468] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:41.220022  4173 leader_election.cc:290] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:41.221242  4203 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:41.208370  4165 leader_election.cc:290] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:41.227120  3307 consensus_peers.cc:597] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:41.228279  3307 consensus_peers.cc:597] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.249861  3309 leader_election.cc:304] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 9f99770bc87e426a893fc425299485cc
W20260709 13:15:41.256412  3307 consensus_peers.cc:597] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.268415  4083 raft_consensus.cc:2804] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.269039  4083 raft_consensus.cc:697] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:41.270100  4083 consensus_queue.cc:237] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:41.277323  3307 consensus_peers.cc:597] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.239415  4131 consensus_queue.cc:1048] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:15:41.301848  4194 log.cc:927] Time spent T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 13:15:41.304702  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:41.315608  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:41.316847  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:41.317116  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:41.305629  3163 catalog_manager.cc:5697] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.318979  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:41.319422  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:41.347115  3163 catalog_manager.cc:5697] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:41.325927  3455 consensus_peers.cc:597] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.348980  3163 catalog_manager.cc:5697] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.349809  3455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 190476us
W20260709 13:15:41.350404  3455 consensus_peers.cc:597] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.350916  3163 catalog_manager.cc:5697] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } }
W20260709 13:15:41.350919  3455 consensus_peers.cc:597] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.358999  4217 raft_consensus.cc:493] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.359764  4217 raft_consensus.cc:515] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:41.362937  4217 leader_election.cc:290] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:41.365458  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
W20260709 13:15:41.367002  3381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 226609us
I20260709 13:15:41.328254  4102 ts_tablet_manager.cc:1434] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.295s	user 0.020s	sys 0.027s
I20260709 13:15:41.334163  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:41.335150  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:41.336071  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:41.339361  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:41.382267  4102 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:41.387271  4099 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:41.320914  3164 catalog_manager.cc:5697] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.390722  4217 raft_consensus.cc:493] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.391726  3164 catalog_manager.cc:5697] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.563763  3164 catalog_manager.cc:5697] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.568193  3164 catalog_manager.cc:5697] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:41.572800  3381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 154125us
I20260709 13:15:41.425997  3413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54eaf73806dc46cab15ec2140b557881" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:41.428784  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:41.424324  3417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17eb79c9e1a4d8f8fa12dc17e6f4b12" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:41.672766  4098 leader_election.cc:304] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:41.421312  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
W20260709 13:15:41.440433  3455 consensus_peers.cc:597] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.457927  3489 raft_consensus.cc:1275] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.455145  3490 raft_consensus.cc:1275] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.677371  4203 raft_consensus.cc:2749] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.393445  4099 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:41.675052  3164 catalog_manager.cc:5697] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.680850  4099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 287381us
I20260709 13:15:41.430343  3412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:41.468139  3414 raft_consensus.cc:1275] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.597931  4102 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:41.468317  4165 raft_consensus.cc:493] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.686909  4203 raft_consensus.cc:2749] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.687726  4165 raft_consensus.cc:515] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:41.396938  4065 consensus_queue.cc:1048] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.617048  3342 raft_consensus.cc:1275] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.692763  4124 consensus_queue.cc:1048] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.695989  4102 tablet_bootstrap.cc:492] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:41.697814  4102 ts_tablet_manager.cc:1403] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.316s	user 0.016s	sys 0.016s
I20260709 13:15:41.700076  3412 raft_consensus.cc:1275] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.703115  4099 leader_election.cc:304] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:41.394409  4210 raft_consensus.cc:2749] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.391806  4217 raft_consensus.cc:515] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:41.676219  4098 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:41.705322  4083 consensus_queue.cc:1048] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.707521  4131 consensus_queue.cc:1048] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.708283  4165 leader_election.cc:290] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:41.710911  4203 raft_consensus.cc:2749] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.713963  4217 leader_election.cc:290] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:15:41.676308  3455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 235755us
W20260709 13:15:41.648016  3307 consensus_peers.cc:597] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.718822  3307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 71067.5us
W20260709 13:15:41.719624  3307 consensus_peers.cc:597] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:41.734393  3455 consensus_peers.cc:597] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.741714  4165 raft_consensus.cc:2749] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.719655  4210 raft_consensus.cc:493] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.743933  4210 raft_consensus.cc:515] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:41.770315  3307 consensus_peers.cc:597] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.765599  4102 raft_consensus.cc:359] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:41.784905  4161 consensus_queue.cc:1048] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:41.786840  4210 leader_election.cc:290] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
W20260709 13:15:41.773840  4099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 91627.3us
I20260709 13:15:41.783368  4102 raft_consensus.cc:740] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.797683  4102 consensus_queue.cc:260] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:41.798007  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:41.802426  4102 ts_tablet_manager.cc:1434] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.104s	user 0.004s	sys 0.008s
I20260709 13:15:41.802488  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
W20260709 13:15:41.812997  3307 consensus_peers.cc:597] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.831161  3455 consensus_peers.cc:597] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.832136  3455 consensus_peers.cc:597] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.835644  3414 raft_consensus.cc:1275] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 6861cafc7c054539ab0c01ec4986d417: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.811472  4102 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:41.855973  3455 consensus_peers.cc:597] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.865061  3414 raft_consensus.cc:1275] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:41.869134  3455 consensus_peers.cc:597] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.876005  4189 consensus_queue.cc:1048] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 13:15:41.882851  3381 consensus_peers.cc:597] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:41.883472  3381 consensus_peers.cc:597] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:41.884400  3381 consensus_peers.cc:597] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.885090  3381 consensus_peers.cc:597] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.886113  3381 consensus_peers.cc:597] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:41.891624  3455 consensus_peers.cc:597] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.873405  4131 consensus_queue.cc:1048] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:15:41.918725  3455 consensus_peers.cc:597] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.872867  3164 catalog_manager.cc:5697] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.930902  4098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 254989us
W20260709 13:15:41.942030  3381 consensus_peers.cc:597] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.929749  3164 catalog_manager.cc:5697] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.946136  3381 consensus_peers.cc:597] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:41.954486  3381 consensus_peers.cc:597] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:41.959292  4127 consensus_queue.cc:1048] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.968869  4098 leader_election.cc:304] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:41.970867  4246 raft_consensus.cc:2749] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.971846  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20da3e12c2504daa9c5864745baaa5fd" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:41.973096  3414 raft_consensus.cc:2393] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f99770bc87e426a893fc425299485cc in current term 2: Already voted for candidate 6861cafc7c054539ab0c01ec4986d417 in this term.
I20260709 13:15:41.971885  3413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:41.978977  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:41.980799  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d91f3e7d644c7913db4af9e912b7e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:42.002167  4098 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:42.005393  4098 leader_election.cc:304] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:42.006722  4246 raft_consensus.cc:2749] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:41.995054  3455 consensus_peers.cc:597] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:42.020654  3381 consensus_peers.cc:597] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:42.022828  3455 consensus_peers.cc:597] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.041738  4246 raft_consensus.cc:2749] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.062592  4216 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.063673  4216 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
W20260709 13:15:42.107767  4098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.131:42471, user_credentials={real_user=slave}} blocked reactor thread for 102664us
I20260709 13:15:42.109737  4098 leader_election.cc:304] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:42.123216  4246 raft_consensus.cc:3060] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.127779  4098 leader_election.cc:304] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:42.131323  4210 raft_consensus.cc:2749] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.133144  4216 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:42.133687  4098 leader_election.cc:304] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:42.117024  3164 catalog_manager.cc:5697] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.146214  3164 catalog_manager.cc:5697] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.152634  4210 raft_consensus.cc:2749] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.180014  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:42.181104  3489 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:42.192145  3310 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:42.194247  4129 raft_consensus.cc:2804] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.194797  4129 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.195138  4129 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.222899  4102 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.222680  3167 catalog_manager.cc:5697] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } }
I20260709 13:15:42.224929  4102 tablet_bootstrap.cc:492] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:42.226420  4102 ts_tablet_manager.cc:1403] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.416s	user 0.030s	sys 0.005s
W20260709 13:15:42.247663  3307 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:42.217657  4246 raft_consensus.cc:2749] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.264729  3167 catalog_manager.cc:5697] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } }
W20260709 13:15:42.288975  3310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 51002.9us
I20260709 13:15:42.312438  4102 raft_consensus.cc:359] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:42.314198  4102 raft_consensus.cc:740] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.330374  4102 consensus_queue.cc:260] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
W20260709 13:15:42.329725  3381 consensus_peers.cc:597] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:42.328226  3163 catalog_manager.cc:5697] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.373560  4102 ts_tablet_manager.cc:1434] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.147s	user 0.007s	sys 0.003s
I20260709 13:15:42.374933  4102 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:42.391260  4129 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:42.401671  3489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:42.402658  3489 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.411916  4129 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:15:42.460247  3307 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:15:42.469276  4246 raft_consensus.cc:493] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.435866  3167 catalog_manager.cc:5697] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 reported cstate change: term changed from 1 to 2, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132). New cstate: current_term: 2 leader_uuid: "6861cafc7c054539ab0c01ec4986d417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.470184  4246 raft_consensus.cc:515] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:42.479103  3489 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 3.
I20260709 13:15:42.481101  3413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:42.483721  3310 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:15:42.486197  4268 raft_consensus.cc:2804] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.486986  4268 raft_consensus.cc:697] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:42.488263  4268 consensus_queue.cc:237] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:42.482334  4246 leader_election.cc:290] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:42.504863  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:42.510833  4098 leader_election.cc:304] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:42.511747  4246 raft_consensus.cc:2749] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.552419  4102 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.553720  4102 tablet_bootstrap.cc:492] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:42.557538  4102 ts_tablet_manager.cc:1403] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.183s	user 0.022s	sys 0.007s
I20260709 13:15:42.569248  4102 raft_consensus.cc:359] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:42.570060  4102 raft_consensus.cc:740] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.592818  4102 consensus_queue.cc:260] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:42.600281  4102 ts_tablet_manager.cc:1434] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:15:42.601444  4102 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:42.634589  3167 catalog_manager.cc:5697] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 3, leader changed from 9f99770bc87e426a893fc425299485cc (127.27.150.129) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.667058  4102 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.680653  4102 tablet_bootstrap.cc:492] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:42.695293  4102 ts_tablet_manager.cc:1403] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.006s
I20260709 13:15:42.704511  4102 raft_consensus.cc:359] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:42.705560  4102 raft_consensus.cc:740] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.707846  4102 consensus_queue.cc:260] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:42.715145  4102 ts_tablet_manager.cc:1434] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:15:42.724447  4102 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:42.814883  3455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:40641, user_credentials={real_user=slave}} blocked reactor thread for 83783.8us
I20260709 13:15:42.909322  4102 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.927034  4102 tablet_bootstrap.cc:492] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:42.927960  4102 ts_tablet_manager.cc:1403] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.204s	user 0.028s	sys 0.006s
I20260709 13:15:42.947767  4102 raft_consensus.cc:359] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:42.948598  4102 raft_consensus.cc:740] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.949594  4102 consensus_queue.cc:260] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:42.951989  4102 ts_tablet_manager.cc:1434] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:15:42.953083  4102 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:42.958925  4246 raft_consensus.cc:493] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.959573  4246 raft_consensus.cc:515] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:42.963953  4246 leader_election.cc:290] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:42.964838  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:42.967368  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a27de7996546fa9774914ac585e53e" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:42.969308  4099 leader_election.cc:304] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417
W20260709 13:15:42.970582  3307 consensus_peers.cc:597] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:42.976750  4246 raft_consensus.cc:2749] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.021314  3491 raft_consensus.cc:1275] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:43.023161  4216 consensus_queue.cc:1048] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:43.044884  4102 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.046033  4102 tablet_bootstrap.cc:492] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.046996  4102 ts_tablet_manager.cc:1403] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.005s
I20260709 13:15:43.061897  4102 raft_consensus.cc:359] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:43.062901  4102 raft_consensus.cc:740] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.064437  4102 consensus_queue.cc:260] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:43.079347  4102 ts_tablet_manager.cc:1434] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:15:43.080780  4102 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:43.099443  3307 consensus_peers.cc:597] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:43.129084  3307 consensus_peers.cc:597] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:43.156010  4102 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.157137  4102 tablet_bootstrap.cc:492] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.157872  4102 ts_tablet_manager.cc:1403] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.003s
I20260709 13:15:43.161561  4102 raft_consensus.cc:359] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:43.162351  4102 raft_consensus.cc:740] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.163895  4102 consensus_queue.cc:260] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:43.168119  4102 ts_tablet_manager.cc:1434] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:15:43.169499  4102 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:43.184378  4304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:40641 every 8 connection(s)
I20260709 13:15:43.185142 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:40641
I20260709 13:15:43.263164  4102 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.264464  4102 tablet_bootstrap.cc:492] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.265342  4102 ts_tablet_manager.cc:1403] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.096s	user 0.023s	sys 0.022s
I20260709 13:15:43.268682  4102 raft_consensus.cc:359] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.269434  4102 raft_consensus.cc:740] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.270201  4102 consensus_queue.cc:260] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.271816  4246 raft_consensus.cc:493] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.303548  4246 raft_consensus.cc:515] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.306351  4246 leader_election.cc:290] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:43.310207  3343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:43.298521  4102 ts_tablet_manager.cc:1434] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.019s
I20260709 13:15:43.313475  4102 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:43.314523  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9232f678266f497c8f5aa9b1c3334fd5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:43.329537  4099 leader_election.cc:304] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:43.330713  4246 raft_consensus.cc:2749] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.337839  4253 raft_consensus.cc:3060] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.345809  4246 raft_consensus.cc:493] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.346524  4246 raft_consensus.cc:515] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:43.349783  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:43.351869  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41010ff5db384e30a704f7cfd15b5ee4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680bff02deaf497e885eb83e37cca726" is_pre_election: true
I20260709 13:15:43.352097  4246 leader_election.cc:290] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:43.353832  4098 leader_election.cc:304] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726
I20260709 13:15:43.355067  4102 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:15:43.355448  3455 consensus_peers.cc:597] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:43.355675  4246 raft_consensus.cc:2749] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.356232  4102 tablet_bootstrap.cc:492] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.357096  4102 ts_tablet_manager.cc:1403] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.003s
I20260709 13:15:43.358795  4252 raft_consensus.cc:3060] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.360368  4102 raft_consensus.cc:359] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.361179  4102 raft_consensus.cc:740] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.362079  4102 consensus_queue.cc:260] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.364812  4102 ts_tablet_manager.cc:1434] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:43.365896  4102 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:43.384148  4250 raft_consensus.cc:3060] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:43.408071  3307 consensus_peers.cc:597] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:43.417049  4258 raft_consensus.cc:3060] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.436369  4306 heartbeater.cc:344] Connected to a master server at 127.27.150.190:35321
I20260709 13:15:43.437107  4306 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:43.438194  4306 heartbeater.cc:507] Master 127.27.150.190:35321 requested a full tablet report, sending...
I20260709 13:15:43.459138  4248 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.475046  4102 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.476331  4102 tablet_bootstrap.cc:492] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
W20260709 13:15:43.476481  3381 consensus_peers.cc:597] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:43.477171  4102 ts_tablet_manager.cc:1403] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.112s	user 0.026s	sys 0.016s
I20260709 13:15:43.501225  4262 raft_consensus.cc:3060] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.497200  4102 raft_consensus.cc:359] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.508488  4102 raft_consensus.cc:740] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.513815  4246 raft_consensus.cc:493] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6861cafc7c054539ab0c01ec4986d417)
I20260709 13:15:43.514638  4246 raft_consensus.cc:515] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.511685  4102 consensus_queue.cc:260] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.520843  4102 ts_tablet_manager.cc:1434] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:15:43.521905  4102 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:43.522146  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:15:43.524652  4246 leader_election.cc:290] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:43.526002  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee6f15e95d8479d8bf471ffeb68cdae" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743" is_pre_election: true
I20260709 13:15:43.529603  4098 leader_election.cc:304] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f99770bc87e426a893fc425299485cc; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417
I20260709 13:15:43.532233  4246 raft_consensus.cc:2749] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.532552  4252 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:15:43.552549  3307 consensus_peers.cc:597] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:43.570600  4253 raft_consensus.cc:3060] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:43.577167  3381 consensus_peers.cc:597] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:43.551110  4248 raft_consensus.cc:3060] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:43.600008  3455 consensus_peers.cc:597] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:43.632331  4102 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.646382  4102 tablet_bootstrap.cc:492] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.647256  4102 ts_tablet_manager.cc:1403] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.009s
I20260709 13:15:43.650323  4102 raft_consensus.cc:359] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:43.650786  3167 ts_manager.cc:194] Re-registered known tserver with Master: 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:15:43.651149  4102 raft_consensus.cc:740] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.652033  4102 consensus_queue.cc:260] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:43.654699  4102 ts_tablet_manager.cc:1434] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:43.655642  4102 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:43.679517  4102 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.680578  4102 tablet_bootstrap.cc:492] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.681269  4102 ts_tablet_manager.cc:1403] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:15:43.684330  4102 raft_consensus.cc:359] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:43.685220  4102 raft_consensus.cc:740] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.686050  4102 consensus_queue.cc:260] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:43.688647  4102 ts_tablet_manager.cc:1434] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:43.689455  4102 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:43.712816  4102 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.713894  4102 tablet_bootstrap.cc:492] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.714630  4102 ts_tablet_manager.cc:1403] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:15:43.717393  4102 raft_consensus.cc:359] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.718071  4102 raft_consensus.cc:740] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.718951  4102 consensus_queue.cc:260] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:43.721360  4102 ts_tablet_manager.cc:1434] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:15:43.722180  4102 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:43.740280  4102 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.741287  4102 tablet_bootstrap.cc:492] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.742218  4102 ts_tablet_manager.cc:1403] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:15:43.745362  4102 raft_consensus.cc:359] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:43.746114  4102 raft_consensus.cc:740] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.747023  4102 consensus_queue.cc:260] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:43.749871  4102 ts_tablet_manager.cc:1434] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:43.750834  4102 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:43.792369  3455 consensus_peers.cc:597] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:43.800463  4253 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.830881  3167 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45856
I20260709 13:15:43.839833  4252 raft_consensus.cc:3060] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.876478  4306 heartbeater.cc:499] Master 127.27.150.190:35321 was elected leader, sending a full tablet report...
I20260709 13:15:43.897239  4102 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:15:43.898188  3455 consensus_peers.cc:597] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:43.898968  4102 tablet_bootstrap.cc:492] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:43.913033  4102 ts_tablet_manager.cc:1403] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.162s	user 0.039s	sys 0.035s
I20260709 13:15:43.954201  4102 raft_consensus.cc:359] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:43.968972  4250 raft_consensus.cc:3060] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:43.999900  3455 consensus_peers.cc:597] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:44.013397  4102 raft_consensus.cc:740] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.014825  4102 consensus_queue.cc:260] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.020406  4102 ts_tablet_manager.cc:1434] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 13:15:44.021422  4102 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.069975  4102 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.071218  4102 tablet_bootstrap.cc:492] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.072062  4102 ts_tablet_manager.cc:1403] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.005s
I20260709 13:15:44.076558  4102 raft_consensus.cc:359] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.077330  4102 raft_consensus.cc:740] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.078169  4102 consensus_queue.cc:260] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.080678  4102 ts_tablet_manager.cc:1434] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:44.081521  4102 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:44.101370  3455 consensus_peers.cc:597] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:44.119422  4102 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.120771  4102 tablet_bootstrap.cc:492] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.121639  4102 ts_tablet_manager.cc:1403] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.004s
I20260709 13:15:44.126533  4102 raft_consensus.cc:359] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.127334  4102 raft_consensus.cc:740] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.128243  4102 consensus_queue.cc:260] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.147506  4102 ts_tablet_manager.cc:1434] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:15:44.151024  4102 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.181977  4102 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.184267  4102 tablet_bootstrap.cc:492] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.187915  4102 ts_tablet_manager.cc:1403] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.002s
I20260709 13:15:44.191059  4102 raft_consensus.cc:359] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:44.192065  4102 raft_consensus.cc:740] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.192777  4102 consensus_queue.cc:260] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:44.196480  4102 ts_tablet_manager.cc:1434] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:44.197408  4102 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.221927  4102 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.222932  4102 tablet_bootstrap.cc:492] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.223554  4102 ts_tablet_manager.cc:1403] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 13:15:44.226481  4102 raft_consensus.cc:359] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.227180  4102 raft_consensus.cc:740] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.227893  4102 consensus_queue.cc:260] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.230230  4102 ts_tablet_manager.cc:1434] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:44.231904  4102 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.247977  4102 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.249073  4102 tablet_bootstrap.cc:492] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.250324  4102 ts_tablet_manager.cc:1403] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
W20260709 13:15:44.252161  3381 consensus_peers.cc:597] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:44.254165  4102 raft_consensus.cc:359] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:44.255036  4102 raft_consensus.cc:740] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.255813  4102 consensus_queue.cc:260] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:44.258683  4102 ts_tablet_manager.cc:1434] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:44.259545  4102 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:44.262077  3381 consensus_peers.cc:597] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:44.283157  4102 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.284221  4102 tablet_bootstrap.cc:492] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.285218  4102 ts_tablet_manager.cc:1403] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 13:15:44.287894  4102 raft_consensus.cc:359] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.288516  4102 raft_consensus.cc:740] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.289078  4102 consensus_queue.cc:260] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.291409  4102 ts_tablet_manager.cc:1434] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:44.292678  4102 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
W20260709 13:15:44.299809  3307 consensus_peers.cc:597] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:44.334048  4102 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.335805  4102 tablet_bootstrap.cc:492] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.336709  4102 ts_tablet_manager.cc:1403] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.000s
I20260709 13:15:44.338500  4252 raft_consensus.cc:3060] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.339923  4102 raft_consensus.cc:359] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:44.340865  4102 raft_consensus.cc:740] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.341893  4102 consensus_queue.cc:260] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:44.344938  4102 ts_tablet_manager.cc:1434] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:44.358843  4102 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.456815  4102 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.458793  4102 tablet_bootstrap.cc:492] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.459769  4102 ts_tablet_manager.cc:1403] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.019s
I20260709 13:15:44.465346  4102 raft_consensus.cc:359] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.466630  4102 raft_consensus.cc:740] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.467623  4102 consensus_queue.cc:260] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.471859  4102 ts_tablet_manager.cc:1434] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:15:44.475092  4102 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.508553  4102 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.509690  4102 tablet_bootstrap.cc:492] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.510579  4102 ts_tablet_manager.cc:1403] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.000s
I20260709 13:15:44.513881  4102 raft_consensus.cc:359] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.514782  4102 raft_consensus.cc:740] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.516018  4102 consensus_queue.cc:260] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.520303  4102 ts_tablet_manager.cc:1434] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:44.521332  4102 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.530170  4252 raft_consensus.cc:3060] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:44.553469  3455 consensus_peers.cc:597] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:44.566788  4102 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.571666  4102 tablet_bootstrap.cc:492] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.574604  4102 ts_tablet_manager.cc:1403] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.013s
I20260709 13:15:44.578601  4102 raft_consensus.cc:359] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.580803  4102 raft_consensus.cc:740] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.586768  4102 consensus_queue.cc:260] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:44.592667  4102 ts_tablet_manager.cc:1434] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:15:44.598865  4102 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.627293  4102 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.628609  4102 tablet_bootstrap.cc:492] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.629377  4102 ts_tablet_manager.cc:1403] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.004s
I20260709 13:15:44.632579  4102 raft_consensus.cc:359] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.633188  4102 raft_consensus.cc:740] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.633989  4102 consensus_queue.cc:260] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.635878  4102 ts_tablet_manager.cc:1434] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:44.636606  4102 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.813898  4102 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.816138  4102 tablet_bootstrap.cc:492] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.817420  4102 ts_tablet_manager.cc:1403] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.003s
I20260709 13:15:44.820562  4102 raft_consensus.cc:359] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:44.821295  4102 raft_consensus.cc:740] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.837522  4238 raft_consensus.cc:3060] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.822086  4102 consensus_queue.cc:260] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:44.852660  4102 ts_tablet_manager.cc:1434] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:15:44.853703  4102 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:44.872668  4242 raft_consensus.cc:3060] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.899341  4102 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.911877  4262 raft_consensus.cc:3060] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.913064  4102 tablet_bootstrap.cc:492] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:44.918143  4102 ts_tablet_manager.cc:1403] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.010s
I20260709 13:15:44.921547  4102 raft_consensus.cc:359] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.922308  4102 raft_consensus.cc:740] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.923060  4102 consensus_queue.cc:260] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:44.925976  4102 ts_tablet_manager.cc:1434] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:44.929143  4248 raft_consensus.cc:3060] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.956095  4102 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:45.084404  4102 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:45.085628  4102 tablet_bootstrap.cc:492] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:45.086310  4102 ts_tablet_manager.cc:1403] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.130s	user 0.044s	sys 0.015s
I20260709 13:15:45.088850  4102 raft_consensus.cc:359] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:45.089659  4102 raft_consensus.cc:740] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.090469  4102 consensus_queue.cc:260] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:45.092732  4102 ts_tablet_manager.cc:1434] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:45.093654  4102 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:45.122710  4102 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:45.123867  4102 tablet_bootstrap.cc:492] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:45.124744  4102 ts_tablet_manager.cc:1403] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.000s
I20260709 13:15:45.128063  4102 raft_consensus.cc:359] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:45.128944  4102 raft_consensus.cc:740] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.129825  4102 consensus_queue.cc:260] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:45.131884  4102 ts_tablet_manager.cc:1434] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:45.133988  4102 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:45.158380  4248 raft_consensus.cc:3060] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.178274  4102 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:45.181738  4102 tablet_bootstrap.cc:492] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:45.182613  4102 ts_tablet_manager.cc:1403] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.049s	user 0.030s	sys 0.008s
I20260709 13:15:45.195109  4102 raft_consensus.cc:359] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:45.198348  4102 raft_consensus.cc:740] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.199261  4102 consensus_queue.cc:260] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:45.205996  4102 ts_tablet_manager.cc:1434] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:15:45.208395  4102 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:45.236867  4102 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:45.238059  4102 tablet_bootstrap.cc:492] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:45.238830  4102 ts_tablet_manager.cc:1403] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.000s
I20260709 13:15:45.241756  4102 raft_consensus.cc:359] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:45.242496  4102 raft_consensus.cc:740] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.243217  4102 consensus_queue.cc:260] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:45.245697  4102 ts_tablet_manager.cc:1434] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:45.246601  4102 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Bootstrap starting.
I20260709 13:15:45.309402  4102 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:45.310750  4102 tablet_bootstrap.cc:492] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Bootstrap complete.
I20260709 13:15:45.312371  4102 ts_tablet_manager.cc:1403] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.028s
I20260709 13:15:45.316566  4102 raft_consensus.cc:359] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:45.325670  4102 raft_consensus.cc:740] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.338570  4102 consensus_queue.cc:260] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:45.358049  4248 raft_consensus.cc:3060] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.367458  4102 ts_tablet_manager.cc:1434] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
W20260709 13:15:45.703949  3513 debug-util.cc:398] Leaking SignalData structure 0x7b08000447a0 after lost signal to thread 28253
W20260709 13:15:45.705691  3513 debug-util.cc:398] Leaking SignalData structure 0x7b0800176a00 after lost signal to thread 3201
W20260709 13:15:45.707579  3513 debug-util.cc:398] Leaking SignalData structure 0x7b08002d79e0 after lost signal to thread 3368
W20260709 13:15:45.709254  3513 debug-util.cc:398] Leaking SignalData structure 0x7b08003ada40 after lost signal to thread 3442
W20260709 13:15:45.711009  3513 debug-util.cc:398] Leaking SignalData structure 0x7b08003a67c0 after lost signal to thread 3516
W20260709 13:15:45.712992  3513 debug-util.cc:398] Leaking SignalData structure 0x7b0800110ea0 after lost signal to thread 4304
W20260709 13:15:47.031189  3383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 50217.8us
I20260709 13:15:53.339570 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:53.404575  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107adc0bfe66488ca767649516d45327"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:15:53.405436  3414 raft_consensus.cc:606] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:53.420274  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:53.420996  3488 raft_consensus.cc:606] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:53.435477  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:15:53.436146  3338 raft_consensus.cc:606] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:53.440357  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:53.440996  3488 raft_consensus.cc:606] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:53.443719  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:15:53.444223  3414 raft_consensus.cc:606] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:53.445441 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:53.447781 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:53.467703  4395 raft_consensus.cc:993] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.468724  4388 raft_consensus.cc:1081] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.470775  4248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45772
I20260709 13:15:53.471393  4248 raft_consensus.cc:493] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:53.471771  4248 raft_consensus.cc:3060] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.485827  4248 raft_consensus.cc:515] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:53.487751  4248 leader_election.cc:290] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:53.488893  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:53.489264  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d553a23383a04c1bb059fbe6980659f0" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:53.489811  3338 raft_consensus.cc:3060] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.489914  3414 raft_consensus.cc:3055] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.490363  3414 raft_consensus.cc:740] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:53.491420  3414 consensus_queue.cc:260] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:53.493002  3414 raft_consensus.cc:3060] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.501142  3338 raft_consensus.cc:2468] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:53.502882  4098 leader_election.cc:304] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:53.503525  3414 raft_consensus.cc:2468] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:53.505853  4414 raft_consensus.cc:2804] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:53.509442  4414 raft_consensus.cc:697] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:53.510772  4414 consensus_queue.cc:237] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:53.512732  4409 raft_consensus.cc:993] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:53.513517  4402 raft_consensus.cc:1081] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:53.516458  3338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:15:53.517082  3338 raft_consensus.cc:493] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:53.517380  3338 raft_consensus.cc:3060] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.528358  3338 raft_consensus.cc:515] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:53.533489  3338 leader_election.cc:290] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:53.533735  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:53.535283  3410 raft_consensus.cc:3060] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.539458  3167 catalog_manager.cc:5697] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 680bff02deaf497e885eb83e37cca726 (127.27.150.131) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.539657  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8adbc138e3a482086d6d658376baa14" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:53.550695  3488 raft_consensus.cc:3055] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.551038  3488 raft_consensus.cc:740] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:53.551915  3488 consensus_queue.cc:260] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:53.553481  3488 raft_consensus.cc:3060] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.581674  4402 raft_consensus.cc:993] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.582542  4402 raft_consensus.cc:1081] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.585340  4248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:53.587019  4248 raft_consensus.cc:493] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:53.587419  4248 raft_consensus.cc:3060] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.587698  3488 raft_consensus.cc:2468] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:53.581360  3410 raft_consensus.cc:2468] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:53.589428  3310 leader_election.cc:304] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:53.590605  4386 raft_consensus.cc:2804] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:53.591065  4386 raft_consensus.cc:697] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:53.592062  4386 consensus_queue.cc:237] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:53.606424  4248 raft_consensus.cc:515] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:53.607828  3167 catalog_manager.cc:5697] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.609184  4248 leader_election.cc:290] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:53.609429  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:53.609807  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4742746a7270495f9cdbaef49775d3a8" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:53.610188  3410 raft_consensus.cc:3060] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.610543  3488 raft_consensus.cc:3055] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.610908  3488 raft_consensus.cc:740] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:53.611809  3488 consensus_queue.cc:260] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:53.613333  3488 raft_consensus.cc:3060] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.617268  3410 raft_consensus.cc:2468] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:53.618784  4098 leader_election.cc:304] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:53.619817  4414 raft_consensus.cc:2804] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:53.620330  4414 raft_consensus.cc:697] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:53.621361  4414 consensus_queue.cc:237] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:53.623277  3488 raft_consensus.cc:2468] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:53.632972  3167 catalog_manager.cc:5697] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.682827  4388 raft_consensus.cc:993] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.683434  4395 raft_consensus.cc:1081] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.685379  4248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "107adc0bfe66488ca767649516d45327"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45772
I20260709 13:15:53.686652  4248 raft_consensus.cc:493] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:53.687136  4248 raft_consensus.cc:3060] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.693586  4248 raft_consensus.cc:515] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:53.695864  4248 leader_election.cc:290] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:53.697090  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:53.697090  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107adc0bfe66488ca767649516d45327" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:53.698065  3410 raft_consensus.cc:3055] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.698160  3488 raft_consensus.cc:3060] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.698593  3410 raft_consensus.cc:740] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:53.699664  3410 consensus_queue.cc:260] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:53.701264  3410 raft_consensus.cc:3060] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.707445  3488 raft_consensus.cc:2468] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:53.710435  4099 leader_election.cc:304] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:53.714813  4414 raft_consensus.cc:2804] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:53.717774  4414 raft_consensus.cc:697] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:53.718910  4414 consensus_queue.cc:237] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:53.723881  3410 raft_consensus.cc:2468] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:53.730116  4400 raft_consensus.cc:993] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.730654  4386 raft_consensus.cc:1081] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:53.732398  4248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45774
I20260709 13:15:53.732890  4248 raft_consensus.cc:493] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:53.733225  4248 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.737766  3167 catalog_manager.cc:5697] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 680bff02deaf497e885eb83e37cca726 (127.27.150.131) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.743103  4248 raft_consensus.cc:515] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:53.746732  4248 leader_election.cc:290] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:53.747040  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:53.747321  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85997a2fc7b9454291059d6f4f427187" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:53.747777  3340 raft_consensus.cc:3055] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:53.748023  3410 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.748144  3340 raft_consensus.cc:740] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:53.749401  3340 consensus_queue.cc:260] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:53.750978  3340 raft_consensus.cc:3060] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.754490  3410 raft_consensus.cc:2468] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 3.
I20260709 13:15:53.755859  4098 leader_election.cc:304] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:53.756851  4414 raft_consensus.cc:2804] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.757707  4414 raft_consensus.cc:697] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 3 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:53.759789  4414 consensus_queue.cc:237] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:53.775547  3340 raft_consensus.cc:2468] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 3.
I20260709 13:15:53.792428  3167 catalog_manager.cc:5697] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 2 to 3, leader changed from 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 3 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.926276  3410 raft_consensus.cc:1275] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.927662  4414 consensus_queue.cc:1048] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:53.944410  3340 raft_consensus.cc:1275] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.946666  4415 consensus_queue.cc:1048] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:54.111421  3410 raft_consensus.cc:1275] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:54.113636  4431 consensus_queue.cc:1048] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:54.123250  3488 raft_consensus.cc:1275] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:54.125777  4414 consensus_queue.cc:1048] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.132357  3488 raft_consensus.cc:1275] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:54.134969  4414 consensus_queue.cc:1048] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.142674  3410 raft_consensus.cc:1275] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:54.145216  4414 consensus_queue.cc:1048] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:54.157634  3485 raft_consensus.cc:1275] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:54.161780  4425 consensus_queue.cc:1048] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:54.167788  3414 raft_consensus.cc:1275] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:54.175554  3418 raft_consensus.cc:1275] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:54.176957  4435 consensus_queue.cc:1048] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:54.178815  4400 consensus_queue.cc:1048] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:54.250360  3457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:38607, user_credentials={real_user=slave}} blocked reactor thread for 58806.7us
I20260709 13:15:54.277318  3340 raft_consensus.cc:1275] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:54.302212  4414 consensus_queue.cc:1048] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:54.449033 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:54.499344 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:54.538702  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0286901285774174994aca4647f28bd7"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
mode: GRACEFUL
new_leader_uuid: "680bff02deaf497e885eb83e37cca726"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:15:54.539498  3338 raft_consensus.cc:606] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Received request to transfer leadership to TS 680bff02deaf497e885eb83e37cca726
I20260709 13:15:54.542510  3485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "420c35c37a4c43428d913178a4e45696"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:54.543123  3485 raft_consensus.cc:606] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:54.546083  3485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:54.546720  3485 raft_consensus.cc:606] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:54.549497  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:54.550037  3488 raft_consensus.cc:606] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Received request to transfer leadership to TS 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:54.552536  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb4281e55873448583428fc3598636a6"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:54.552979  3488 raft_consensus.cc:606] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:54.553989 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:54.556226 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:54.674324  4444 raft_consensus.cc:993] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743: : Instructing follower 680bff02deaf497e885eb83e37cca726 to start an election
I20260709 13:15:54.675091  4444 raft_consensus.cc:1081] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Signalling peer 680bff02deaf497e885eb83e37cca726 to start an election
I20260709 13:15:54.677325  3410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0286901285774174994aca4647f28bd7"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
 from {username='slave'} at 127.0.0.1:37118
I20260709 13:15:54.677913  3410 raft_consensus.cc:493] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.678257  3410 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.686015  3410 raft_consensus.cc:515] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:54.689314  4409 raft_consensus.cc:993] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:54.689811  3410 leader_election.cc:290] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:54.690781  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:54.691570  3338 raft_consensus.cc:3055] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.691044  4417 raft_consensus.cc:1081] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:54.691905  3338 raft_consensus.cc:740] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:54.692981  3338 consensus_queue.cc:260] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:54.693877  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:54.694613  3338 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.696517  3340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:15:54.697109  3340 raft_consensus.cc:493] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.697464  3340 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.694641  3488 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.707268  3340 raft_consensus.cc:515] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:54.708426  3338 raft_consensus.cc:2468] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:54.711130  3383 leader_election.cc:304] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:54.712359  3340 leader_election.cc:290] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:54.712466  4395 raft_consensus.cc:2804] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.712610  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:54.713433  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:54.713485  3485 raft_consensus.cc:3055] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.714130  4395 raft_consensus.cc:697] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:54.714165  3485 raft_consensus.cc:740] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:54.715879  3485 consensus_queue.cc:260] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:54.717705  3488 raft_consensus.cc:2468] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:54.720976  3485 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.722399  4395 consensus_queue.cc:237] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:54.714174  3410 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.734637  3485 raft_consensus.cc:2468] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:54.736253  3310 leader_election.cc:304] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:54.737243  4400 raft_consensus.cc:2804] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.737637  3410 raft_consensus.cc:2468] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:54.737855  4400 raft_consensus.cc:697] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:54.739723  4400 consensus_queue.cc:237] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:54.745193  3163 catalog_manager.cc:5697] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.755657  3167 catalog_manager.cc:5697] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.789029  4409 raft_consensus.cc:993] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:54.789664  4417 raft_consensus.cc:1081] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:54.791541  4242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb4281e55873448583428fc3598636a6"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:54.792166  4242 raft_consensus.cc:493] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.792521  4242 raft_consensus.cc:3060] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.799674  4242 raft_consensus.cc:515] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:54.801218  4242 leader_election.cc:290] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:54.801928  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:54.802234  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4281e55873448583428fc3598636a6" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:54.802714  3485 raft_consensus.cc:3055] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.802950  3340 raft_consensus.cc:3060] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.802997  3485 raft_consensus.cc:740] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:54.804052  3485 consensus_queue.cc:260] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:54.805485  3485 raft_consensus.cc:3060] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.811107  3340 raft_consensus.cc:2468] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:54.812318  4098 leader_election.cc:304] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:54.813724  4415 raft_consensus.cc:2804] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.814211  4415 raft_consensus.cc:697] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:54.815186  4415 consensus_queue.cc:237] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:54.816090  3485 raft_consensus.cc:2468] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:54.851426  3167 catalog_manager.cc:5697] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.868157  4409 raft_consensus.cc:993] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:54.868767  4417 raft_consensus.cc:1081] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:54.870384  4242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "420c35c37a4c43428d913178a4e45696"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:54.871001  4242 raft_consensus.cc:493] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.871366  4242 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.879894  4242 raft_consensus.cc:515] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:54.882616  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:54.883255  3410 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.890898  3410 raft_consensus.cc:2468] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 3.
I20260709 13:15:54.892109  4098 leader_election.cc:304] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:54.895076  4242 leader_election.cc:290] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:54.895555  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420c35c37a4c43428d913178a4e45696" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:54.896330  3488 raft_consensus.cc:3055] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:54.896524  4415 raft_consensus.cc:2804] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:54.896646  3488 raft_consensus.cc:740] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:54.897634  4415 raft_consensus.cc:697] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 3 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:54.897773  3488 consensus_queue.cc:260] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:54.899430  3488 raft_consensus.cc:3060] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.899240  4415 consensus_queue.cc:237] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:54.909965  3488 raft_consensus.cc:2468] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 3.
I20260709 13:15:54.921284  3167 catalog_manager.cc:5697] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 2 to 3, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 3 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.995275  4417 raft_consensus.cc:993] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:54.995857  4417 raft_consensus.cc:1081] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Signalling peer 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:54.997519  3338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:15:54.998216  3338 raft_consensus.cc:493] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.998747  3338 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.007637  3338 raft_consensus.cc:515] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:55.010495  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:55.010807  3338 leader_election.cc:290] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:55.011245  3410 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.011955  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a8d971e3f46fba3f81a2410d8beea" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:55.012653  3488 raft_consensus.cc:3055] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:55.012990  3488 raft_consensus.cc:740] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:55.013891  3488 consensus_queue.cc:260] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:55.015115  3488 raft_consensus.cc:3060] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.017902  3410 raft_consensus.cc:2468] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 3.
I20260709 13:15:55.019117  3309 leader_election.cc:304] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 680bff02deaf497e885eb83e37cca726; no voters: 
I20260709 13:15:55.019940  4400 raft_consensus.cc:2804] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:55.020413  4400 raft_consensus.cc:697] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:55.021332  4400 consensus_queue.cc:237] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:55.023092  3488 raft_consensus.cc:2468] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 3.
I20260709 13:15:55.032207  3167 catalog_manager.cc:5697] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 2 to 3, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.111591  3488 raft_consensus.cc:1275] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.112980  4388 consensus_queue.cc:1048] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.124189  3338 raft_consensus.cc:1275] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.125901  4388 consensus_queue.cc:1048] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.149288  3410 raft_consensus.cc:1275] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.151088  4400 consensus_queue.cc:1048] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.171422  3488 raft_consensus.cc:1275] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.176877  4444 consensus_queue.cc:1048] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.285447  3488 raft_consensus.cc:1275] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.286983  4415 consensus_queue.cc:1048] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.298151  3410 raft_consensus.cc:1275] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.301173  4414 consensus_queue.cc:1048] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.328557  3488 raft_consensus.cc:1275] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.330188  4431 consensus_queue.cc:1048] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.342171  3342 raft_consensus.cc:1275] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.348392  4414 consensus_queue.cc:1048] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.476949  3490 raft_consensus.cc:1275] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.478621  4447 consensus_queue.cc:1048] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.491313  3414 raft_consensus.cc:1275] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.493112  4444 consensus_queue.cc:1048] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.557250 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:55.605479 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:55.665261  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0286901285774174994aca4647f28bd7"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
mode: GRACEFUL
new_leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:15:55.667980  3414 raft_consensus.cc:606] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Received request to transfer leadership to TS 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:55.671850  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:55.672528  3488 raft_consensus.cc:606] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:55.678748  3342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
mode: GRACEFUL
new_leader_uuid: "680bff02deaf497e885eb83e37cca726"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:15:55.679430  3342 raft_consensus.cc:606] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Received request to transfer leadership to TS 680bff02deaf497e885eb83e37cca726
I20260709 13:15:55.682508  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:55.683171  3488 raft_consensus.cc:606] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:55.685878  3342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:15:55.686391  3342 raft_consensus.cc:606] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:55.688802 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:55.691349 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:55.747579  4400 raft_consensus.cc:993] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743: : Instructing follower 680bff02deaf497e885eb83e37cca726 to start an election
I20260709 13:15:55.748275  4447 raft_consensus.cc:1081] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Signalling peer 680bff02deaf497e885eb83e37cca726 to start an election
I20260709 13:15:55.749899  3414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
 from {username='slave'} at 127.0.0.1:37118
I20260709 13:15:55.750423  3414 raft_consensus.cc:493] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:55.750905  3414 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.758347  3414 raft_consensus.cc:515] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:55.760377  3414 leader_election.cc:290] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:55.761085  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:55.761462  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3659596894d8b8dc2937c11c2a8cb" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:55.761929  3342 raft_consensus.cc:3055] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:55.762149  3485 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.762270  3342 raft_consensus.cc:740] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:55.763190  3342 consensus_queue.cc:260] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:55.764225  3342 raft_consensus.cc:3060] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.768523  3485 raft_consensus.cc:2468] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 3.
I20260709 13:15:55.770833  3384 leader_election.cc:304] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:55.771633  3342 raft_consensus.cc:2468] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 3.
I20260709 13:15:55.771775  4463 raft_consensus.cc:2804] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:55.773763  4463 raft_consensus.cc:697] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 3 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:55.774893  4463 consensus_queue.cc:237] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:55.789067  3163 catalog_manager.cc:5697] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 2 to 3, leader changed from 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 3 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.837960  4409 raft_consensus.cc:993] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:55.838641  4442 raft_consensus.cc:1081] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:55.840385  4248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:55.840972  4248 raft_consensus.cc:493] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:55.842305  4248 raft_consensus.cc:3060] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.850627  4248 raft_consensus.cc:515] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:55.853542  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:55.854219  3485 raft_consensus.cc:3055] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.854574  3485 raft_consensus.cc:740] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:55.855243  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9a21fadcd94d04b664457da232b137" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:55.856073  3342 raft_consensus.cc:3060] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.856846  4248 leader_election.cc:290] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:55.856803  3485 consensus_queue.cc:260] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:55.858621  3485 raft_consensus.cc:3060] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.863730  3342 raft_consensus.cc:2468] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:55.865058  4098 leader_election.cc:304] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:55.865970  4431 raft_consensus.cc:2804] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.866636  4431 raft_consensus.cc:697] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:55.867635  4431 consensus_queue.cc:237] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:55.870872  3485 raft_consensus.cc:2468] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:55.881160  3163 catalog_manager.cc:5697] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.068518  4417 raft_consensus.cc:993] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:56.069137  4409 raft_consensus.cc:1081] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:56.071041  4252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:56.071666  4252 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:56.072009  4252 raft_consensus.cc:3060] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.080988  4252 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:56.083689  4252 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:56.084311  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:56.085088  3488 raft_consensus.cc:3055] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.085438  3488 raft_consensus.cc:740] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:56.085486  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6845d090104ffea526fc245bcd9e0d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:56.086125  3342 raft_consensus.cc:3060] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.086443  3488 consensus_queue.cc:260] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:56.088019  3488 raft_consensus.cc:3060] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.095219  3342 raft_consensus.cc:2468] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:56.096400  4098 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:56.097025  3488 raft_consensus.cc:2468] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:56.097281  4431 raft_consensus.cc:2804] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.098191  4431 raft_consensus.cc:697] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:56.099190  4431 consensus_queue.cc:237] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:56.112104  3163 catalog_manager.cc:5697] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.158164  4395 raft_consensus.cc:993] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726: : Instructing follower 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:56.158826  4463 raft_consensus.cc:1081] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Signalling peer 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:56.160311  3338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0286901285774174994aca4647f28bd7"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:37948
I20260709 13:15:56.160838  3338 raft_consensus.cc:493] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:56.161154  3338 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.173600  3338 raft_consensus.cc:515] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:56.175664  3338 leader_election.cc:290] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:56.176213  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:56.176800  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0286901285774174994aca4647f28bd7" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:56.176999  3414 raft_consensus.cc:3055] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:56.177450  3488 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.177585  3414 raft_consensus.cc:740] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:56.178555  3414 consensus_queue.cc:260] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:56.179811  3414 raft_consensus.cc:3060] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.185511  3488 raft_consensus.cc:2468] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 3.
I20260709 13:15:56.186990  3310 leader_election.cc:304] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:56.188007  4447 raft_consensus.cc:2804] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.188923  3414 raft_consensus.cc:2468] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 3.
I20260709 13:15:56.190449  4447 raft_consensus.cc:697] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:56.191720  4447 consensus_queue.cc:237] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:56.202582  3163 catalog_manager.cc:5697] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 2 to 3, leader changed from 680bff02deaf497e885eb83e37cca726 (127.27.150.131) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.231683  4447 raft_consensus.cc:993] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:56.232229  4444 raft_consensus.cc:1081] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:56.233757  4252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45774
I20260709 13:15:56.234267  4252 raft_consensus.cc:493] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:56.234639  4252 raft_consensus.cc:3060] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.241909  4252 raft_consensus.cc:515] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:56.245185  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:56.245309  4252 leader_election.cc:290] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:15:56.245837  3338 raft_consensus.cc:3055] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.246199  3338 raft_consensus.cc:740] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:56.246630  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85294cffe3042d08d67fb88721fc72d" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:56.247340  3410 raft_consensus.cc:3060] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.247130  3338 consensus_queue.cc:260] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:56.248874  3338 raft_consensus.cc:3060] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.250766  3485 raft_consensus.cc:1275] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.252602  4431 consensus_queue.cc:1048] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.255704  3410 raft_consensus.cc:2468] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:56.256350  3338 raft_consensus.cc:2468] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:56.257453  4098 leader_election.cc:304] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:56.258983  4431 raft_consensus.cc:2804] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.260771  4431 raft_consensus.cc:697] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:56.262948  3338 raft_consensus.cc:1275] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:56.261898  4431 consensus_queue.cc:237] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } }
I20260709 13:15:56.266826  4395 consensus_queue.cc:1048] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:56.279827  3342 raft_consensus.cc:1275] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.283244  4473 consensus_queue.cc:1048] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:56.323864  3488 raft_consensus.cc:1275] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:56.327066  4463 consensus_queue.cc:1048] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:56.386963  4099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.132:33967, user_credentials={real_user=slave}} blocked reactor thread for 96557.3us
I20260709 13:15:56.401985  3167 catalog_manager.cc:5697] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.603320  3338 raft_consensus.cc:1275] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.605125  4431 consensus_queue.cc:1048] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.616663  3485 raft_consensus.cc:1275] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.618307  4488 consensus_queue.cc:1048] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.692545 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:56.713789  3485 raft_consensus.cc:1275] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:56.715642  4400 consensus_queue.cc:1048] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:56.739408  3414 raft_consensus.cc:1275] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:56.742911  4447 consensus_queue.cc:1048] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:56.761071 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:56.772576  3338 raft_consensus.cc:1275] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.773975  4431 consensus_queue.cc:1048] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:56.786408  3410 raft_consensus.cc:1275] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.788339  4473 consensus_queue.cc:1048] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.824715  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:56.825423  3488 raft_consensus.cc:606] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:56.829800  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:56.832249  3488 raft_consensus.cc:606] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:56.837378  3488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef"
dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:59702
I20260709 13:15:56.838048  3488 raft_consensus.cc:606] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:56.841091  3340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
mode: GRACEFUL
new_leader_uuid: "680bff02deaf497e885eb83e37cca726"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:15:56.841704  3340 raft_consensus.cc:606] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Received request to transfer leadership to TS 680bff02deaf497e885eb83e37cca726
I20260709 13:15:56.845917  3410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
mode: GRACEFUL
new_leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:15:56.846519  3410 raft_consensus.cc:606] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Received request to transfer leadership to TS 2fbbf37a29b6416eb787ce4c9238e743
I20260709 13:15:56.847959 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:56.850327 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:56.986320  4442 raft_consensus.cc:993] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:56.987113  4497 raft_consensus.cc:1081] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:56.988951  4248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:56.989579  4248 raft_consensus.cc:493] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:56.989971  4248 raft_consensus.cc:3060] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.997615  4248 raft_consensus.cc:515] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.001006  4248 leader_election.cc:290] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:57.002624  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:57.003454  3485 raft_consensus.cc:3055] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.003799  3485 raft_consensus.cc:740] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:57.004717  3485 consensus_queue.cc:260] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.005578  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee33bfcb9bb41ab90d52e8af1e38459" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:57.006309  3418 raft_consensus.cc:3060] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.006165  3485 raft_consensus.cc:3060] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.015548  3418 raft_consensus.cc:2468] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:57.017004  4098 leader_election.cc:304] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:57.018326  4489 raft_consensus.cc:2804] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.018923  4489 raft_consensus.cc:697] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:57.020115  4417 raft_consensus.cc:993] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:57.019872  4489 consensus_queue.cc:237] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.020730  4417 raft_consensus.cc:1081] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:57.023459  4242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:57.024039  4242 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:57.024477  4242 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.027055  3485 raft_consensus.cc:2468] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:57.038163  4242 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:57.040521  3166 catalog_manager.cc:5697] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.041805  4242 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:57.042271  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:57.042994  3338 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.044904  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e470b894b5f4fe6933870e43f2eb8bc" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:57.045657  3485 raft_consensus.cc:3055] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:57.046069  3485 raft_consensus.cc:740] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:57.047127  3485 consensus_queue.cc:260] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:57.049023  3485 raft_consensus.cc:3060] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.053633  3338 raft_consensus.cc:2468] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 3.
I20260709 13:15:57.055075  4098 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:57.056109  4489 raft_consensus.cc:2804] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:57.056622  4489 raft_consensus.cc:697] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 3 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:57.057631  3485 raft_consensus.cc:2468] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 3.
I20260709 13:15:57.057556  4489 consensus_queue.cc:237] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:57.061285  4499 raft_consensus.cc:993] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: : Instructing follower 680bff02deaf497e885eb83e37cca726 to start an election
I20260709 13:15:57.061816  4447 raft_consensus.cc:1081] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Signalling peer 680bff02deaf497e885eb83e37cca726 to start an election
I20260709 13:15:57.063899  3418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
 from {username='slave'} at 127.0.0.1:37118
I20260709 13:15:57.064610  3418 raft_consensus.cc:493] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:57.065039  3418 raft_consensus.cc:3060] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.075268  3418 raft_consensus.cc:515] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.077337  3418 leader_election.cc:290] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Requested vote from peers 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:57.077991  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:57.078375  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4474dd7fb94cf5a48e9737228cd59b" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:57.078783  3338 raft_consensus.cc:3055] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.079136  3338 raft_consensus.cc:740] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:57.079149  3485 raft_consensus.cc:3060] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.080051  3338 consensus_queue.cc:260] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.081847  3338 raft_consensus.cc:3060] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.086176  3166 catalog_manager.cc:5697] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 2 to 3, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 3 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.089093  3485 raft_consensus.cc:2468] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:57.089771  3338 raft_consensus.cc:2468] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:15:57.090298  3384 leader_election.cc:304] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:57.091297  4463 raft_consensus.cc:2804] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.091802  4463 raft_consensus.cc:697] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:57.092732  4463 consensus_queue.cc:237] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.108537  3166 catalog_manager.cc:5697] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 reported cstate change: term changed from 1 to 2, leader changed from 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130) to 680bff02deaf497e885eb83e37cca726 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "680bff02deaf497e885eb83e37cca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.185042  4463 raft_consensus.cc:993] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726: : Instructing follower 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:57.185671  4395 raft_consensus.cc:1081] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Signalling peer 2fbbf37a29b6416eb787ce4c9238e743 to start an election
I20260709 13:15:57.187197  3340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
 from {username='slave'} at 127.0.0.1:37948
I20260709 13:15:57.187750  3340 raft_consensus.cc:493] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:57.188078  3340 raft_consensus.cc:3060] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.196274  3340 raft_consensus.cc:515] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.198824  3340 leader_election.cc:290] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:57.199326  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:57.200371  3418 raft_consensus.cc:3055] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.200780  3418 raft_consensus.cc:740] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:57.201133  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a51029dec74d1dbbf9385234e5cc62" candidate_uuid: "2fbbf37a29b6416eb787ce4c9238e743" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:57.201879  3485 raft_consensus.cc:3060] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.201702  3418 consensus_queue.cc:260] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.203408  3418 raft_consensus.cc:3060] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.212736  3485 raft_consensus.cc:2468] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:57.214892  3310 leader_election.cc:304] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbf37a29b6416eb787ce4c9238e743, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:15:57.215902  4499 raft_consensus.cc:2804] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.216403  4499 raft_consensus.cc:697] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:57.217379  4499 consensus_queue.cc:237] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:15:57.221686  3418 raft_consensus.cc:2468] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbbf37a29b6416eb787ce4c9238e743 in term 2.
I20260709 13:15:57.232213  3166 catalog_manager.cc:5697] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 reported cstate change: term changed from 1 to 2, leader changed from 680bff02deaf497e885eb83e37cca726 (127.27.150.131) to 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "2fbbf37a29b6416eb787ce4c9238e743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.301842  4497 raft_consensus.cc:993] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:57.302469  4442 raft_consensus.cc:1081] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:57.304203  4242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45790
I20260709 13:15:57.304967  4242 raft_consensus.cc:493] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:57.305384  4242 raft_consensus.cc:3060] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.314280  4242 raft_consensus.cc:515] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:57.317510  3418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:57.318300  3418 raft_consensus.cc:3060] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.319113  4242 leader_election.cc:290] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:57.319280  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e8ac5126c3a4c50bf54cabb0135a5ef" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:57.320091  3485 raft_consensus.cc:3055] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.320415  3485 raft_consensus.cc:740] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6861cafc7c054539ab0c01ec4986d417, State: Running, Role: LEADER
I20260709 13:15:57.321291  3485 consensus_queue.cc:260] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:57.322947  3485 raft_consensus.cc:3060] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.327031  3418 raft_consensus.cc:2468] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:57.328317  4098 leader_election.cc:304] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:57.329149  4473 raft_consensus.cc:2804] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.329648  4473 raft_consensus.cc:697] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:57.330966  3485 raft_consensus.cc:2468] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:57.330715  4473 consensus_queue.cc:237] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:57.343533  3166 catalog_manager.cc:5697] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.410245  3418 raft_consensus.cc:1275] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.412034  4473 consensus_queue.cc:1048] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.429401  3488 raft_consensus.cc:1275] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.431617  4489 consensus_queue.cc:1048] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.478031  3485 raft_consensus.cc:1275] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:57.479648  4431 consensus_queue.cc:1048] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:57.490994  3338 raft_consensus.cc:1275] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:57.492659  4489 consensus_queue.cc:1048] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.608512  3488 raft_consensus.cc:1275] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.609895  4447 consensus_queue.cc:1048] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.620800  3410 raft_consensus.cc:1275] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 2fbbf37a29b6416eb787ce4c9238e743: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.622936  4400 consensus_queue.cc:1048] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.645323  3338 raft_consensus.cc:1275] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.646986  4395 consensus_queue.cc:1048] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.662232  3488 raft_consensus.cc:1275] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 680bff02deaf497e885eb83e37cca726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.664373  4395 consensus_queue.cc:1048] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.741390  3410 raft_consensus.cc:1275] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.743019  4431 consensus_queue.cc:1048] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:57.755160  3485 raft_consensus.cc:1275] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.756610  4431 consensus_queue.cc:1048] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.851517 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:57.902416 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:57.946967  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4"
dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:15:57.947702  3338 raft_consensus.cc:606] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:57.950623  3418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5"
dest_uuid: "680bff02deaf497e885eb83e37cca726"
mode: GRACEFUL
new_leader_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:15:57.951140  3418 raft_consensus.cc:606] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Received request to transfer leadership to TS 9f99770bc87e426a893fc425299485cc
I20260709 13:15:57.952544 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:57.954233 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:58.047996  4395 raft_consensus.cc:993] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:58.048727  4395 raft_consensus.cc:1081] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:58.050664  4242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45772
I20260709 13:15:58.051296  4242 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:58.051676  4242 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.060964  4242 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:58.063078  4242 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Requested vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967)
I20260709 13:15:58.064129  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bff02deaf497e885eb83e37cca726"
I20260709 13:15:58.064519  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:58.064875  3410 raft_consensus.cc:3055] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:58.065213  3488 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.065277  3410 raft_consensus.cc:740] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:15:58.066323  3410 consensus_queue.cc:260] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:58.069973  3410 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.073503  3488 raft_consensus.cc:2468] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:58.074950  4099 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:58.075878  4526 raft_consensus.cc:2804] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:58.076391  4526 raft_consensus.cc:697] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:58.077412  4526 consensus_queue.cc:237] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:15:58.081902  3410 raft_consensus.cc:2468] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 2.
I20260709 13:15:58.096690  3166 catalog_manager.cc:5697] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 1 to 2, leader changed from 680bff02deaf497e885eb83e37cca726 (127.27.150.131) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 2 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.253214  4499 raft_consensus.cc:993] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743: : Instructing follower 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:58.253858  4535 raft_consensus.cc:1081] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Signalling peer 9f99770bc87e426a893fc425299485cc to start an election
I20260709 13:15:58.255419  4252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4"
dest_uuid: "9f99770bc87e426a893fc425299485cc"
 from {username='slave'} at 127.0.0.1:45774
I20260709 13:15:58.256039  4252 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:58.256443  4252 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.264914  4252 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:58.267002  4252 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 4 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:15:58.267720  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:15:58.268488  3488 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.268968  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856fc57094a04df1b76480bda9d496b4" candidate_uuid: "9f99770bc87e426a893fc425299485cc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2fbbf37a29b6416eb787ce4c9238e743"
I20260709 13:15:58.269641  3338 raft_consensus.cc:3055] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:58.269989  3338 raft_consensus.cc:740] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fbbf37a29b6416eb787ce4c9238e743, State: Running, Role: LEADER
I20260709 13:15:58.270915  3338 consensus_queue.cc:260] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:58.272317  3338 raft_consensus.cc:3060] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.277328  3488 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 4.
I20260709 13:15:58.278509  4099 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417, 9f99770bc87e426a893fc425299485cc; no voters: 
I20260709 13:15:58.279443  4473 raft_consensus.cc:2804] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:58.279987  4473 raft_consensus.cc:697] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 4 LEADER]: Becoming Leader. State: Replica: 9f99770bc87e426a893fc425299485cc, State: Running, Role: LEADER
I20260709 13:15:58.280545  3338 raft_consensus.cc:2468] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f99770bc87e426a893fc425299485cc in term 4.
I20260709 13:15:58.282050  4473 consensus_queue.cc:237] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:15:58.294727  3166 catalog_manager.cc:5697] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc reported cstate change: term changed from 3 to 4, leader changed from 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130) to 9f99770bc87e426a893fc425299485cc (127.27.150.129). New cstate: current_term: 4 leader_uuid: "9f99770bc87e426a893fc425299485cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.533946  3488 raft_consensus.cc:1275] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.535859  4526 consensus_queue.cc:1048] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:58.548218  3418 raft_consensus.cc:1275] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.550513  4489 consensus_queue.cc:1048] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.839118  3488 raft_consensus.cc:1275] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 4 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.840483  4473 consensus_queue.cc:1048] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.857023  3338 raft_consensus.cc:1275] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 4 FOLLOWER]: Refusing update from remote peer 9f99770bc87e426a893fc425299485cc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.858700  4489 consensus_queue.cc:1048] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.955499 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:58.998742 28250 tablet_server.cc:179] TabletServer@127.27.150.129:40641 shutting down...
W20260709 13:15:59.009627  3381 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 357 similar messages]
W20260709 13:15:59.015317  3381 consensus_peers.cc:597] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.022702  3307 consensus_peers.cc:597] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.033634  3381 consensus_peers.cc:597] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.048426  3455 consensus_peers.cc:597] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.055182 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:59.056811 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.058125 28250 raft_consensus.cc:2243] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.058881 28250 raft_consensus.cc:2272] T 9546f93765d34b7baa8dda85faad96ae P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.063011 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.063748 28250 raft_consensus.cc:2243] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.064248 28250 raft_consensus.cc:2272] T 132c2352e9b64e8081d3c0d9baabce84 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.067127 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.068315 28250 raft_consensus.cc:2243] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.068918 28250 raft_consensus.cc:2272] T f99a38ce9bfc4c8896ba84328639b90b P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.072657 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.073601 28250 raft_consensus.cc:2243] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.074128 28250 raft_consensus.cc:2272] T 44b0080a141145e687e0d361ecf150d3 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.077461 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.078581 28250 raft_consensus.cc:2243] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.079262 28250 raft_consensus.cc:2272] T 56b367f1f6e54c6cb98054e8c63ba9da P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.082743 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.083807 28250 raft_consensus.cc:2243] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.084344 28250 raft_consensus.cc:2272] T e57df44e281f46d2844b50c4302bc52c P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.087594 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.088589 28250 raft_consensus.cc:2243] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:59.088661  3455 consensus_peers.cc:597] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.089216 28250 raft_consensus.cc:2272] T 87d9b8357182495897ba580d2a2949a3 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.092233 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.093043 28250 raft_consensus.cc:2243] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.093676 28250 raft_consensus.cc:2272] T f240b1bc43564ebb9629430509c691e1 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.092032  3455 consensus_peers.cc:597] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.097113 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.097860 28250 raft_consensus.cc:2243] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:59.098076  3455 consensus_peers.cc:597] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.098383 28250 raft_consensus.cc:2272] T b3ad0659cde14de3b129b42d480176b3 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.101433 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.102123 28250 raft_consensus.cc:2243] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.103070 28250 raft_consensus.cc:2272] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.105736 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.106675 28250 raft_consensus.cc:2243] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.107839 28250 raft_consensus.cc:2272] T 95ca8466f1d64370b2f629ed81d829b5 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.110057  3307 consensus_peers.cc:597] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.111733 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.112918 28250 raft_consensus.cc:2243] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.113554 28250 raft_consensus.cc:2272] T dcd4ae37bd2d49a0b6b94c695fdff604 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.113968  3307 consensus_peers.cc:597] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.116994 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.117998 28250 raft_consensus.cc:2243] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.118582 28250 raft_consensus.cc:2272] T e4bf210b6f6b4a11a7bfbf815676b433 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.121834 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.122547 28250 raft_consensus.cc:2243] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.123493 28250 raft_consensus.cc:2272] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.126684 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.127701 28250 raft_consensus.cc:2243] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.128229 28250 raft_consensus.cc:2272] T c143a12f1d074d6abf4f33d880d1c212 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.132709  3307 consensus_peers.cc:597] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.132908 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.134155 28250 raft_consensus.cc:2243] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.135250 28250 raft_consensus.cc:2272] T 4742746a7270495f9cdbaef49775d3a8 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.138157 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.139036 28250 raft_consensus.cc:2243] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.139626 28250 raft_consensus.cc:2272] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.142855 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.143656 28250 raft_consensus.cc:2243] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.144605 28250 raft_consensus.cc:2272] T 2e470b894b5f4fe6933870e43f2eb8bc P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.147102 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.147807 28250 raft_consensus.cc:2243] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.148850 28250 raft_consensus.cc:2272] T 856fc57094a04df1b76480bda9d496b4 P 9f99770bc87e426a893fc425299485cc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.152441 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.153380 28250 raft_consensus.cc:2243] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.153950 28250 raft_consensus.cc:2272] T e69861273e1047ef9f4772769b689e8a P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.157383 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.158366 28250 raft_consensus.cc:2243] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.158939 28250 raft_consensus.cc:2272] T 90df71c989bb49dda47f16aa67340ef6 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.161309  3381 consensus_peers.cc:597] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.163203 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.164316 28250 raft_consensus.cc:2243] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.164924 28250 raft_consensus.cc:2272] T 62ae694390334d8583cdad82212fb301 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.168280 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.169085 28250 raft_consensus.cc:2243] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.170296 28250 raft_consensus.cc:2272] T 107adc0bfe66488ca767649516d45327 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.173494 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.174345 28250 raft_consensus.cc:2243] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.175032 28250 raft_consensus.cc:2272] T 68a79b63b8204a21b06b365598657efb P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.177994  3455 consensus_peers.cc:597] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.178346 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.179138 28250 raft_consensus.cc:2243] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.179625 28250 raft_consensus.cc:2272] T f7a27de7996546fa9774914ac585e53e P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.182231 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.182888 28250 raft_consensus.cc:2243] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.183779 28250 raft_consensus.cc:2272] T 85997a2fc7b9454291059d6f4f427187 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.186704 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.187525 28250 raft_consensus.cc:2243] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.188087 28250 raft_consensus.cc:2272] T 20da3e12c2504daa9c5864745baaa5fd P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.191639 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.192554 28250 raft_consensus.cc:2243] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.193207 28250 raft_consensus.cc:2272] T e03783871be14ed0a80c20c2be3e1b73 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.194985  3307 consensus_peers.cc:597] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.196455 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.197224 28250 raft_consensus.cc:2243] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.198087 28250 raft_consensus.cc:2272] T cb4281e55873448583428fc3598636a6 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.201313 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.202170 28250 raft_consensus.cc:2243] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.202831 28250 raft_consensus.cc:2272] T 837d91f3e7d644c7913db4af9e912b7e P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.205943 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.206784 28250 raft_consensus.cc:2243] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.207340 28250 raft_consensus.cc:2272] T ca9f3f51f57b4c42b5063ccb7f51ccda P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.207947  3381 consensus_peers.cc:597] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.209789 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.210523 28250 raft_consensus.cc:2243] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.211146 28250 raft_consensus.cc:2272] T eee6f15e95d8479d8bf471ffeb68cdae P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.214951 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.215909 28250 raft_consensus.cc:2243] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.216475 28250 raft_consensus.cc:2272] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.216840  3307 consensus_peers.cc:597] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.219501 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.220453 28250 raft_consensus.cc:2243] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:15:59.220633  3455 consensus_peers.cc:597] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.221446 28250 raft_consensus.cc:2272] T 0f9a21fadcd94d04b664457da232b137 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.224409 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.225333 28250 raft_consensus.cc:2243] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.225838 28250 raft_consensus.cc:2272] T 54eaf73806dc46cab15ec2140b557881 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.229105 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.230023 28250 raft_consensus.cc:2243] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.230551 28250 raft_consensus.cc:2272] T e629cf2e72494a84b27f79d2d660c379 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.233083 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.233642 28250 raft_consensus.cc:2243] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.234520 28250 raft_consensus.cc:2272] T 420c35c37a4c43428d913178a4e45696 P 9f99770bc87e426a893fc425299485cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.236920 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.237493 28250 raft_consensus.cc:2243] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.237963 28250 raft_consensus.cc:2272] T 9232f678266f497c8f5aa9b1c3334fd5 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.240855 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.241679 28250 raft_consensus.cc:2243] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:59.242138  3455 consensus_peers.cc:597] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.242285 28250 raft_consensus.cc:2272] T 41010ff5db384e30a704f7cfd15b5ee4 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.246055 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.246956 28250 raft_consensus.cc:2243] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.248086 28250 raft_consensus.cc:2272] T d553a23383a04c1bb059fbe6980659f0 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.249728  3381 consensus_peers.cc:597] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.251442 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.252388 28250 raft_consensus.cc:2243] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.253588 28250 raft_consensus.cc:2272] T aa6845d090104ffea526fc245bcd9e0d P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.257050 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.257825 28250 raft_consensus.cc:2243] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.258347 28250 raft_consensus.cc:2272] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 9f99770bc87e426a893fc425299485cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.261234 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.261777 28250 raft_consensus.cc:2243] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.262192 28250 raft_consensus.cc:2272] T bad4a106ba3345e0abae4ec0677ecda1 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.264528 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.265017 28250 raft_consensus.cc:2243] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.265416 28250 raft_consensus.cc:2272] T 3c7cbd198b1c458b9835725ccdb37439 P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.267746 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:59.268285 28250 raft_consensus.cc:2243] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.269191 28250 raft_consensus.cc:2272] T f85294cffe3042d08d67fb88721fc72d P 9f99770bc87e426a893fc425299485cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.278496  3455 consensus_peers.cc:597] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.286435  3381 consensus_peers.cc:597] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.292351  3455 consensus_peers.cc:597] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.296646  3455 consensus_peers.cc:597] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.305009  3381 consensus_peers.cc:597] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.365156 28250 tablet_server.cc:196] TabletServer@127.27.150.129:40641 shutdown complete.
W20260709 13:15:59.393354  3381 consensus_peers.cc:597] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.419420  3307 consensus_peers.cc:597] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.435720  3455 consensus_peers.cc:597] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.436357  3381 consensus_peers.cc:597] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.465021  3455 consensus_peers.cc:597] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.483981  3307 consensus_peers.cc:597] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.489548 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
W20260709 13:15:59.496448  3457 consensus_peers.cc:597] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.511983  3381 consensus_peers.cc:597] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.528143  3307 consensus_peers.cc:597] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 -> Peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Couldn't send request to peer 9f99770bc87e426a893fc425299485cc. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.545286  3457 consensus_peers.cc:597] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.570215  3383 consensus_peers.cc:597] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.580179 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:59.581622 28250 tablet_replica.cc:333] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.585475 28250 raft_consensus.cc:2243] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.586856 28250 raft_consensus.cc:2272] T 90df71c989bb49dda47f16aa67340ef6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.590538 28250 tablet_replica.cc:333] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.596920 28250 raft_consensus.cc:2243] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.597636 28250 raft_consensus.cc:2272] T c143a12f1d074d6abf4f33d880d1c212 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.598543  3383 consensus_peers.cc:597] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.601296 28250 tablet_replica.cc:333] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.602260 28250 raft_consensus.cc:2243] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.603408 28250 raft_consensus.cc:2272] T b3ad0659cde14de3b129b42d480176b3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.606514 28250 tablet_replica.cc:333] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.607474 28250 raft_consensus.cc:2243] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.608899 28250 raft_consensus.cc:2272] T 41010ff5db384e30a704f7cfd15b5ee4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.612666 28250 tablet_replica.cc:333] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.613669 28250 raft_consensus.cc:2243] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.614897 28250 raft_consensus.cc:2272] T 0286901285774174994aca4647f28bd7 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.618338 28250 tablet_replica.cc:333] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.619570 28250 raft_consensus.cc:2243] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:59.620337  3457 consensus_peers.cc:597] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.621093 28250 raft_consensus.cc:2272] T 3b67a8637f824de9911512eedc03ec43 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.625168 28250 tablet_replica.cc:333] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.626118 28250 raft_consensus.cc:2243] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.627405 28250 raft_consensus.cc:2272] T 3c7cbd198b1c458b9835725ccdb37439 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.631187 28250 tablet_replica.cc:333] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.632491 28250 raft_consensus.cc:2243] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.633260 28250 raft_consensus.cc:2272] T e629cf2e72494a84b27f79d2d660c379 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.636977 28250 tablet_replica.cc:333] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.637815 28250 raft_consensus.cc:2243] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.638973 28250 raft_consensus.cc:2272] T b8adbc138e3a482086d6d658376baa14 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.641927 28250 tablet_replica.cc:333] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.654196 28250 raft_consensus.cc:2243] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.654784 28250 raft_consensus.cc:2272] T 85997a2fc7b9454291059d6f4f427187 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.657379 28250 tablet_replica.cc:333] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.658116 28250 raft_consensus.cc:2243] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.658666 28250 raft_consensus.cc:2272] T eee6f15e95d8479d8bf471ffeb68cdae P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.661617 28250 tablet_replica.cc:333] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.662422 28250 raft_consensus.cc:2243] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.663051 28250 raft_consensus.cc:2272] T 132c2352e9b64e8081d3c0d9baabce84 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.666291 28250 tablet_replica.cc:333] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.667059 28250 raft_consensus.cc:2243] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.667695 28250 raft_consensus.cc:2272] T cb4281e55873448583428fc3598636a6 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.670934 28250 tablet_replica.cc:333] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.671782 28250 raft_consensus.cc:2243] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:59.672523  3383 consensus_peers.cc:597] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.673035 28250 raft_consensus.cc:2272] T 9546f93765d34b7baa8dda85faad96ae P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.676187 28250 tablet_replica.cc:333] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.676944 28250 raft_consensus.cc:2243] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.677960 28250 raft_consensus.cc:2272] T 56b367f1f6e54c6cb98054e8c63ba9da P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.680557 28250 tablet_replica.cc:333] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.681252 28250 raft_consensus.cc:2243] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.681749 28250 raft_consensus.cc:2272] T e57df44e281f46d2844b50c4302bc52c P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.684238 28250 tablet_replica.cc:333] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.685213 28250 raft_consensus.cc:2243] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.685701 28250 raft_consensus.cc:2272] T bad4a106ba3345e0abae4ec0677ecda1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.688292 28250 tablet_replica.cc:333] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.688980 28250 raft_consensus.cc:2243] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.689538 28250 raft_consensus.cc:2272] T aa6845d090104ffea526fc245bcd9e0d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.692210 28250 tablet_replica.cc:333] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.692945 28250 raft_consensus.cc:2243] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.693450 28250 raft_consensus.cc:2272] T e1d5ccb77dd0428e957babbce39cf870 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.696301 28250 tablet_replica.cc:333] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.697214 28250 raft_consensus.cc:2243] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.697849 28250 raft_consensus.cc:2272] T 40f35a48457c46878dc583515c065166 P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.700506 28250 tablet_replica.cc:333] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.701066 28250 raft_consensus.cc:2243] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.701447 28250 raft_consensus.cc:2272] T d553a23383a04c1bb059fbe6980659f0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.703492 28250 tablet_replica.cc:333] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.704061 28250 raft_consensus.cc:2243] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.704449 28250 raft_consensus.cc:2272] T f85294cffe3042d08d67fb88721fc72d P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.707041 28250 tablet_replica.cc:333] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.707898 28250 raft_consensus.cc:2243] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.709074 28250 raft_consensus.cc:2272] T f240b1bc43564ebb9629430509c691e1 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.710659  3457 consensus_peers.cc:597] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.712190 28250 tablet_replica.cc:333] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.713218 28250 raft_consensus.cc:2243] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.713795 28250 raft_consensus.cc:2272] T 42f3659596894d8b8dc2937c11c2a8cb P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.716208 28250 tablet_replica.cc:333] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.716919 28250 raft_consensus.cc:2243] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.717494 28250 raft_consensus.cc:2272] T 54eaf73806dc46cab15ec2140b557881 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.719739 28250 tablet_replica.cc:333] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.720252 28250 raft_consensus.cc:2243] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.720613 28250 raft_consensus.cc:2272] T 0f9a21fadcd94d04b664457da232b137 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.722708 28250 tablet_replica.cc:333] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.723318 28250 raft_consensus.cc:2243] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.723827 28250 raft_consensus.cc:2272] T 837d91f3e7d644c7913db4af9e912b7e P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.726981 28250 tablet_replica.cc:333] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.727888 28250 raft_consensus.cc:2243] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.728408 28250 raft_consensus.cc:2272] T 2e470b894b5f4fe6933870e43f2eb8bc P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.728546  3457 consensus_peers.cc:597] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.731493 28250 tablet_replica.cc:333] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.732419 28250 raft_consensus.cc:2243] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.733014 28250 raft_consensus.cc:2272] T e69861273e1047ef9f4772769b689e8a P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.733409  3383 consensus_peers.cc:597] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.735939 28250 tablet_replica.cc:333] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.736832 28250 raft_consensus.cc:2243] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.737335 28250 raft_consensus.cc:2272] T 856fc57094a04df1b76480bda9d496b4 P 2fbbf37a29b6416eb787ce4c9238e743 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.739909 28250 tablet_replica.cc:333] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.740476 28250 raft_consensus.cc:2243] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.740888 28250 raft_consensus.cc:2272] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.743705 28250 tablet_replica.cc:333] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.744380 28250 raft_consensus.cc:2243] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.744828 28250 raft_consensus.cc:2272] T cac7eee9d52843488adb542293814e1e P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.747082 28250 tablet_replica.cc:333] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.747625 28250 raft_consensus.cc:2243] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.748093 28250 raft_consensus.cc:2272] T ba4474dd7fb94cf5a48e9737228cd59b P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.750636 28250 tablet_replica.cc:333] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.751397 28250 raft_consensus.cc:2243] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.751994 28250 raft_consensus.cc:2272] T dcd4ae37bd2d49a0b6b94c695fdff604 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.753746  3383 consensus_peers.cc:597] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.754935 28250 tablet_replica.cc:333] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.755914 28250 raft_consensus.cc:2243] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.756480 28250 raft_consensus.cc:2272] T b15c7b44e85542b696746192c0ff0d5b P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.759593 28250 tablet_replica.cc:333] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.760407 28250 raft_consensus.cc:2243] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:15:59.760356  3383 consensus_peers.cc:597] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.761757 28250 raft_consensus.cc:2272] T d1a51029dec74d1dbbf9385234e5cc62 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.764817 28250 tablet_replica.cc:333] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.765700 28250 raft_consensus.cc:2243] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.766335 28250 raft_consensus.cc:2272] T 306de156a5b14b259e6a51aafedf1579 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.766638  3383 consensus_peers.cc:597] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.769454 28250 tablet_replica.cc:333] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.770406 28250 raft_consensus.cc:2243] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.771701 28250 raft_consensus.cc:2272] T 9232f678266f497c8f5aa9b1c3334fd5 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.773857  3383 consensus_peers.cc:597] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.775007 28250 tablet_replica.cc:333] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.775911 28250 raft_consensus.cc:2243] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.777072 28250 raft_consensus.cc:2272] T 87d9b8357182495897ba580d2a2949a3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.779706 28250 tablet_replica.cc:333] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.780313 28250 raft_consensus.cc:2243] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.780817 28250 raft_consensus.cc:2272] T 62ae694390334d8583cdad82212fb301 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.783197 28250 tablet_replica.cc:333] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.783772 28250 raft_consensus.cc:2243] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.784235 28250 raft_consensus.cc:2272] T dba85e8b48b84b388c287165e85c21e3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.786537 28250 tablet_replica.cc:333] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.787092 28250 raft_consensus.cc:2243] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.788043 28250 raft_consensus.cc:2272] T 521a8d971e3f46fba3f81a2410d8beea P 2fbbf37a29b6416eb787ce4c9238e743 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.790619 28250 tablet_replica.cc:333] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.791157 28250 raft_consensus.cc:2243] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:59.792085 28250 raft_consensus.cc:2272] T 2760edcad0614547b67102f65f6369fc P 2fbbf37a29b6416eb787ce4c9238e743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.794950 28250 tablet_replica.cc:333] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743: stopping tablet replica
I20260709 13:15:59.795665 28250 raft_consensus.cc:2243] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.796203 28250 raft_consensus.cc:2272] T 44b0080a141145e687e0d361ecf150d3 P 2fbbf37a29b6416eb787ce4c9238e743 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:59.797111  3383 consensus_peers.cc:597] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.830487  3457 consensus_peers.cc:597] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.843544  3457 consensus_peers.cc:597] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.865926  3383 consensus_peers.cc:597] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.896274  3457 consensus_peers.cc:597] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.897369  3383 consensus_peers.cc:597] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.901607 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
W20260709 13:15:59.975299  3457 consensus_peers.cc:597] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:59.980116  3383 consensus_peers.cc:597] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 -> Peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Couldn't send request to peer 2fbbf37a29b6416eb787ce4c9238e743. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.007139 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
I20260709 13:16:00.045805  4417 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.046511  4417 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:16:00.053505  3457 consensus_peers.cc:597] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.055114  4417 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:16:00.059979  3455 leader_election.cc:336] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.062830  4463 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
W20260709 13:16:00.063045  3457 leader_election.cc:336] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:00.063495  3457 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.063506  4463 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
W20260709 13:16:00.064759  3457 consensus_peers.cc:597] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.065289  4417 raft_consensus.cc:2749] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.065891  4463 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:16:00.067476  3485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417" is_pre_election: true
I20260709 13:16:00.068154  3485 raft_consensus.cc:2468] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 2.
I20260709 13:16:00.069768  3384 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 
I20260709 13:16:00.070529  4463 raft_consensus.cc:2804] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.070892  4463 raft_consensus.cc:493] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
W20260709 13:16:00.071079  3381 leader_election.cc:336] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.071250  4463 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.080502  4463 raft_consensus.cc:515] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:16:00.083542  4463 leader_election.cc:290] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 election: Requested vote from peers 6861cafc7c054539ab0c01ec4986d417 (127.27.150.132:33967), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:16:00.088573  3381 leader_election.cc:336] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.091106  3488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8466f1d64370b2f629ed81d829b5" candidate_uuid: "680bff02deaf497e885eb83e37cca726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6861cafc7c054539ab0c01ec4986d417"
I20260709 13:16:00.091840  3488 raft_consensus.cc:3060] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.092779 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:00.093743 28250 tablet_replica.cc:333] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.095003 28250 raft_consensus.cc:2243] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.095712 28250 raft_consensus.cc:2272] T e4bf210b6f6b4a11a7bfbf815676b433 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.099179 28250 tablet_replica.cc:333] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.099977  3488 raft_consensus.cc:2468] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bff02deaf497e885eb83e37cca726 in term 3.
I20260709 13:16:00.100306 28250 raft_consensus.cc:2243] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.100988 28250 raft_consensus.cc:2272] T f99a38ce9bfc4c8896ba84328639b90b P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.101212  3384 leader_election.cc:304] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bff02deaf497e885eb83e37cca726, 6861cafc7c054539ab0c01ec4986d417; no voters: 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.102059  4463 raft_consensus.cc:2804] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:00.102593  4463 raft_consensus.cc:697] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 3 LEADER]: Becoming Leader. State: Replica: 680bff02deaf497e885eb83e37cca726, State: Running, Role: LEADER
I20260709 13:16:00.103436  4463 consensus_queue.cc:237] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:16:00.104375 28250 tablet_replica.cc:333] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.105741 28250 raft_consensus.cc:2243] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.106343 28250 raft_consensus.cc:2272] T 90df71c989bb49dda47f16aa67340ef6 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.110221 28250 tablet_replica.cc:333] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.110954 28250 raft_consensus.cc:2243] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.111485 28250 raft_consensus.cc:2272] T 3c7cbd198b1c458b9835725ccdb37439 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.114369 28250 tablet_replica.cc:333] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.115331 28250 raft_consensus.cc:2243] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.116014 28250 raft_consensus.cc:2272] T 3b67a8637f824de9911512eedc03ec43 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.119365 28250 tablet_replica.cc:333] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.120359 28250 raft_consensus.cc:2243] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.120960 28250 raft_consensus.cc:2272] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.124100 28250 tablet_replica.cc:333] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.124851 28250 raft_consensus.cc:2243] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.125469 28250 raft_consensus.cc:2272] T 41010ff5db384e30a704f7cfd15b5ee4 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.129024 28250 tablet_replica.cc:333] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.130128 28250 raft_consensus.cc:2243] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.130697 28250 raft_consensus.cc:2272] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:00.130962  3457 consensus_peers.cc:597] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.133392 28250 tablet_replica.cc:333] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.134232 28250 raft_consensus.cc:2243] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.134744 28250 raft_consensus.cc:2272] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.137784 28250 tablet_replica.cc:333] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.138725 28250 raft_consensus.cc:2243] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.139428 28250 raft_consensus.cc:2272] T 4742746a7270495f9cdbaef49775d3a8 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.141918 28250 tablet_replica.cc:333] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.142691 28250 raft_consensus.cc:2243] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.143692 28250 raft_consensus.cc:2272] T e69861273e1047ef9f4772769b689e8a P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.146211 28250 tablet_replica.cc:333] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.146999 28250 raft_consensus.cc:2243] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.148010 28250 raft_consensus.cc:2272] T 132c2352e9b64e8081d3c0d9baabce84 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.151268 28250 tablet_replica.cc:333] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.152139 28250 raft_consensus.cc:2243] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.152714 28250 raft_consensus.cc:2272] T 420c35c37a4c43428d913178a4e45696 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:00.153353  3457 consensus_peers.cc:597] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.155205 28250 tablet_replica.cc:333] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.155939 28250 raft_consensus.cc:2243] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.156436 28250 raft_consensus.cc:2272] T f240b1bc43564ebb9629430509c691e1 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.158957 28250 tablet_replica.cc:333] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.159556 28250 raft_consensus.cc:2243] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.160491 28250 raft_consensus.cc:2272] T 42f3659596894d8b8dc2937c11c2a8cb P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.162693 28250 tablet_replica.cc:333] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.163391 28250 raft_consensus.cc:2243] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.164276 28250 raft_consensus.cc:2272] T ca9f3f51f57b4c42b5063ccb7f51ccda P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.166567 28250 tablet_replica.cc:333] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.167389 28250 raft_consensus.cc:2243] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.168450 28250 raft_consensus.cc:2272] T b15c7b44e85542b696746192c0ff0d5b P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.170871 28250 tablet_replica.cc:333] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.171663 28250 raft_consensus.cc:2243] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.172183 28250 raft_consensus.cc:2272] T d1a51029dec74d1dbbf9385234e5cc62 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.174788 28250 tablet_replica.cc:333] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.175462 28250 raft_consensus.cc:2243] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.176456 28250 raft_consensus.cc:2272] T 306de156a5b14b259e6a51aafedf1579 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.178610 28250 tablet_replica.cc:333] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.179258 28250 raft_consensus.cc:2243] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.179698 28250 raft_consensus.cc:2272] T e1d5ccb77dd0428e957babbce39cf870 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.181978 28250 tablet_replica.cc:333] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.182694 28250 raft_consensus.cc:2243] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.183228 28250 raft_consensus.cc:2272] T 40f35a48457c46878dc583515c065166 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:00.184911  3457 consensus_peers.cc:597] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.185894 28250 tablet_replica.cc:333] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.186631 28250 raft_consensus.cc:2243] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.187032 28250 raft_consensus.cc:2272] T d553a23383a04c1bb059fbe6980659f0 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.189218 28250 tablet_replica.cc:333] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.189764 28250 raft_consensus.cc:2243] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.190135 28250 raft_consensus.cc:2272] T f85294cffe3042d08d67fb88721fc72d P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.192265 28250 tablet_replica.cc:333] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.192848 28250 raft_consensus.cc:2243] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.193675 28250 raft_consensus.cc:2272] T 44b0080a141145e687e0d361ecf150d3 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.196861 28250 tablet_replica.cc:333] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.197757 28250 raft_consensus.cc:2243] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.198349 28250 raft_consensus.cc:2272] T 0286901285774174994aca4647f28bd7 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.201336 28250 tablet_replica.cc:333] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.202493 28250 raft_consensus.cc:2243] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.203050 28250 raft_consensus.cc:2272] T 107adc0bfe66488ca767649516d45327 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.206100 28250 tablet_replica.cc:333] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.207000 28250 raft_consensus.cc:2243] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.207587 28250 raft_consensus.cc:2272] T f7a27de7996546fa9774914ac585e53e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.210630 28250 tablet_replica.cc:333] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.211536 28250 raft_consensus.cc:2243] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.212651 28250 raft_consensus.cc:2272] T 68a79b63b8204a21b06b365598657efb P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.215427 28250 tablet_replica.cc:333] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.216182 28250 raft_consensus.cc:2243] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.216694 28250 raft_consensus.cc:2272] T b8adbc138e3a482086d6d658376baa14 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.218983 28250 tablet_replica.cc:333] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.219590 28250 raft_consensus.cc:2243] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.220067 28250 raft_consensus.cc:2272] T 85997a2fc7b9454291059d6f4f427187 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.222115 28250 tablet_replica.cc:333] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.222816 28250 raft_consensus.cc:2243] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.223421 28250 raft_consensus.cc:2272] T 20da3e12c2504daa9c5864745baaa5fd P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.226683 28250 tablet_replica.cc:333] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.227417 28250 raft_consensus.cc:2243] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.228024 28250 raft_consensus.cc:2272] T b3ad0659cde14de3b129b42d480176b3 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.230259  4527 raft_consensus.cc:493] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.231045 28250 tablet_replica.cc:333] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.230934  4527 raft_consensus.cc:515] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } }
I20260709 13:16:00.232106 28250 raft_consensus.cc:2243] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.232756 28250 raft_consensus.cc:2272] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.233372  4527 leader_election.cc:290] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471)
I20260709 13:16:00.234671  4417 raft_consensus.cc:493] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.235251  4417 raft_consensus.cc:515] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:16:00.235922 28250 tablet_replica.cc:333] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.237398 28250 raft_consensus.cc:2243] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.238389 28250 pending_rounds.cc:70] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: Trying to abort 1 pending ops.
I20260709 13:16:00.238718 28250 pending_rounds.cc:77] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637724592463872 op_type: NO_OP noop_request { }
I20260709 13:16:00.239224 28250 raft_consensus.cc:2889] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:00.239619 28250 raft_consensus.cc:2272] T 95ca8466f1d64370b2f629ed81d829b5 P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:00.243930  3455 leader_election.cc:336] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.245589  4417 leader_election.cc:290] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:16:00.245689 28250 tablet_replica.cc:333] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.247530 28250 raft_consensus.cc:2243] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.248986 28250 raft_consensus.cc:2272] T e57df44e281f46d2844b50c4302bc52c P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:00.249974  3457 leader_election.cc:336] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:00.250506  3457 leader_election.cc:304] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.251331  4417 raft_consensus.cc:2749] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:00.257243  3455 leader_election.cc:336] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.258571 28250 tablet_replica.cc:333] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.259634 28250 raft_consensus.cc:2243] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:00.260183  3457 consensus_peers.cc:597] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.260267 28250 raft_consensus.cc:2272] T dba85e8b48b84b388c287165e85c21e3 P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:00.260989  3457 consensus_peers.cc:597] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:00.263345  3457 leader_election.cc:336] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:00.263926 28250 tablet_replica.cc:333] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.263769  3457 leader_election.cc:304] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.264706  4417 raft_consensus.cc:2749] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.264925 28250 raft_consensus.cc:2243] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.265671 28250 raft_consensus.cc:2272] T 521a8d971e3f46fba3f81a2410d8beea P 680bff02deaf497e885eb83e37cca726 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.268719 28250 tablet_replica.cc:333] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.269661 28250 raft_consensus.cc:2243] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.270179 28250 raft_consensus.cc:2272] T 2760edcad0614547b67102f65f6369fc P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.273587 28250 tablet_replica.cc:333] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.274367 28250 raft_consensus.cc:2243] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.275599 28250 raft_consensus.cc:2272] T ba4474dd7fb94cf5a48e9737228cd59b P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.278679 28250 tablet_replica.cc:333] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.279371 28250 raft_consensus.cc:2243] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.280448 28250 raft_consensus.cc:2272] T dcd4ae37bd2d49a0b6b94c695fdff604 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.282707 28250 tablet_replica.cc:333] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.283214 28250 raft_consensus.cc:2243] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.284009 28250 raft_consensus.cc:2272] T 54eaf73806dc46cab15ec2140b557881 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.286193 28250 tablet_replica.cc:333] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.286803 28250 raft_consensus.cc:2243] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.287635 28250 raft_consensus.cc:2272] T e03783871be14ed0a80c20c2be3e1b73 P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.289767 28250 tablet_replica.cc:333] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.290294 28250 raft_consensus.cc:2243] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.291214 28250 raft_consensus.cc:2272] T cac7eee9d52843488adb542293814e1e P 680bff02deaf497e885eb83e37cca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.293452 28250 tablet_replica.cc:333] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726: stopping tablet replica
I20260709 13:16:00.294026 28250 raft_consensus.cc:2243] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.294909 28250 raft_consensus.cc:2272] T 837d91f3e7d644c7913db4af9e912b7e P 680bff02deaf497e885eb83e37cca726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.356854  4417 raft_consensus.cc:493] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.357401  4417 raft_consensus.cc:515] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:16:00.359484  4417 leader_election.cc:290] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:16:00.363473  3455 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:16:00.364261  3457 leader_election.cc:336] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111)
I20260709 13:16:00.364641  3457 leader_election.cc:304] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.365216  4417 raft_consensus.cc:2749] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.407738 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
W20260709 13:16:00.435153  3457 consensus_peers.cc:597] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.131:42471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.492017  4527 raft_consensus.cc:493] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.492704  4527 raft_consensus.cc:515] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:16:00.495429  4527 leader_election.cc:290] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:16:00.499373  3457 leader_election.cc:336] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42471: connect: Connection refused (error 111)
W20260709 13:16:00.501226  3455 leader_election.cc:336] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.501664  3455 leader_election.cc:304] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.502358  4527 raft_consensus.cc:2749] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.512020 28250 tablet_server.cc:179] TabletServer@127.27.150.132:0 shutting down...
I20260709 13:16:00.513077  4527 raft_consensus.cc:493] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.513803  4527 raft_consensus.cc:515] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:16:00.516393  4527 leader_election.cc:290] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:16:00.522492  3455 leader_election.cc:336] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:16:00.523025  3457 leader_election.cc:336] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111)
I20260709 13:16:00.523397  3457 leader_election.cc:304] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.524071  4527 raft_consensus.cc:2749] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.547981  4527 raft_consensus.cc:493] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.548621  4527 raft_consensus.cc:515] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:16:00.549943  4559 raft_consensus.cc:493] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.550631  4559 raft_consensus.cc:515] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:16:00.553155  4559 leader_election.cc:290] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:16:00.554709  4527 leader_election.cc:290] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
W20260709 13:16:00.557622  3455 leader_election.cc:336] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:16:00.559113  3455 leader_election.cc:336] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:16:00.561602  3457 leader_election.cc:336] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111)
I20260709 13:16:00.562024  3457 leader_election.cc:304] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
W20260709 13:16:00.563046  3457 leader_election.cc:336] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111)
I20260709 13:16:00.563369  4559 raft_consensus.cc:2749] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.563956  3457 leader_election.cc:304] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.567308  4559 raft_consensus.cc:493] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.570530  4559 raft_consensus.cc:515] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:16:00.572814  4559 leader_election.cc:290] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
I20260709 13:16:00.567530  4527 raft_consensus.cc:2749] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.576526  4527 raft_consensus.cc:493] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.577188  4527 raft_consensus.cc:515] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680bff02deaf497e885eb83e37cca726" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 42471 } } peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } }
I20260709 13:16:00.582074  4527 leader_election.cc:290] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471), 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641)
W20260709 13:16:00.584174  3457 consensus_peers.cc:597] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 -> Peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Couldn't send request to peer 680bff02deaf497e885eb83e37cca726. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.131:42471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:00.585614  3455 leader_election.cc:336] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
W20260709 13:16:00.587867  3457 leader_election.cc:336] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42471: connect: Connection refused (error 111)
W20260709 13:16:00.588287  3455 leader_election.cc:336] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.588308  3457 leader_election.cc:304] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.589660  4559 raft_consensus.cc:2749] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:00.590006  3457 leader_election.cc:336] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 680bff02deaf497e885eb83e37cca726 (127.27.150.131:42471): Network error: Client connection negotiation failed: client connection to 127.27.150.131:42471: connect: Connection refused (error 111)
I20260709 13:16:00.590543  3457 leader_election.cc:304] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 680bff02deaf497e885eb83e37cca726, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.595127  4417 raft_consensus.cc:2749] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.602218 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:00.603233 28250 tablet_replica.cc:333] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.604388 28250 raft_consensus.cc:2243] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.605532 28250 raft_consensus.cc:2272] T c143a12f1d074d6abf4f33d880d1c212 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.607926 28250 tablet_replica.cc:333] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.608598 28250 raft_consensus.cc:2243] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.609750 28250 raft_consensus.cc:2272] T e4bf210b6f6b4a11a7bfbf815676b433 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.612214 28250 tablet_replica.cc:333] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.612774 28250 raft_consensus.cc:2243] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.613256 28250 raft_consensus.cc:2272] T 7e8ac5126c3a4c50bf54cabb0135a5ef P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.616068 28250 tablet_replica.cc:333] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.616812 28250 raft_consensus.cc:2243] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.617367 28250 raft_consensus.cc:2272] T 3b67a8637f824de9911512eedc03ec43 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.619539 28250 tablet_replica.cc:333] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.620095 28250 raft_consensus.cc:2243] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.620905 28250 raft_consensus.cc:2272] T f99a38ce9bfc4c8896ba84328639b90b P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.623126 28250 tablet_replica.cc:333] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.623719 28250 raft_consensus.cc:2243] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.624111 28250 raft_consensus.cc:2272] T ba4474dd7fb94cf5a48e9737228cd59b P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.626223 28250 tablet_replica.cc:333] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.626818 28250 raft_consensus.cc:2243] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.627208 28250 raft_consensus.cc:2272] T 9546f93765d34b7baa8dda85faad96ae P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.629300 28250 tablet_replica.cc:333] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.629825 28250 raft_consensus.cc:2243] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.630179 28250 raft_consensus.cc:2272] T cb4281e55873448583428fc3598636a6 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.632272 28250 tablet_replica.cc:333] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.632822 28250 raft_consensus.cc:2243] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.633610 28250 raft_consensus.cc:2272] T e629cf2e72494a84b27f79d2d660c379 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.635893 28250 tablet_replica.cc:333] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.636514 28250 raft_consensus.cc:2243] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.636896 28250 raft_consensus.cc:2272] T 420c35c37a4c43428d913178a4e45696 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.639050 28250 tablet_replica.cc:333] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.639631 28250 raft_consensus.cc:2243] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.640406 28250 raft_consensus.cc:2272] T eee6f15e95d8479d8bf471ffeb68cdae P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.642577 28250 tablet_replica.cc:333] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.643293 28250 raft_consensus.cc:2243] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.643702 28250 raft_consensus.cc:2272] T ca9f3f51f57b4c42b5063ccb7f51ccda P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.645977 28250 tablet_replica.cc:333] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.646679 28250 raft_consensus.cc:2243] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.647570 28250 raft_consensus.cc:2272] T b17eb79c9e1a4d8f8fa12dc17e6f4b12 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.649874 28250 tablet_replica.cc:333] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.650511 28250 raft_consensus.cc:2243] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.651396 28250 raft_consensus.cc:2272] T bad4a106ba3345e0abae4ec0677ecda1 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.653617 28250 tablet_replica.cc:333] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.654240 28250 raft_consensus.cc:2243] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.654803 28250 raft_consensus.cc:2272] T 0286901285774174994aca4647f28bd7 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.655335  4417 raft_consensus.cc:493] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f99770bc87e426a893fc425299485cc)
I20260709 13:16:00.655745  4417 raft_consensus.cc:515] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6861cafc7c054539ab0c01ec4986d417" member_type: VOTER last_known_addr { host: "127.27.150.132" port: 33967 } } peers { permanent_uuid: "9f99770bc87e426a893fc425299485cc" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 40641 } } peers { permanent_uuid: "2fbbf37a29b6416eb787ce4c9238e743" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 38607 } }
I20260709 13:16:00.657019 28250 tablet_replica.cc:333] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.657595  4417 leader_election.cc:290] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641), 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607)
I20260709 13:16:00.658031 28250 raft_consensus.cc:2243] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.658773 28250 raft_consensus.cc:2272] T 107adc0bfe66488ca767649516d45327 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.661731 28250 tablet_replica.cc:333] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
W20260709 13:16:00.662057  3455 leader_election.cc:336] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f99770bc87e426a893fc425299485cc (127.27.150.129:40641): Network error: Client connection negotiation failed: client connection to 127.27.150.129:40641: connect: Connection refused (error 111)
I20260709 13:16:00.662611 28250 raft_consensus.cc:2243] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:00.662688  3457 leader_election.cc:336] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fbbf37a29b6416eb787ce4c9238e743 (127.27.150.130:38607): Network error: Client connection negotiation failed: client connection to 127.27.150.130:38607: connect: Connection refused (error 111)
I20260709 13:16:00.663216  3457 leader_election.cc:304] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6861cafc7c054539ab0c01ec4986d417; no voters: 2fbbf37a29b6416eb787ce4c9238e743, 9f99770bc87e426a893fc425299485cc
I20260709 13:16:00.663374 28250 raft_consensus.cc:2272] T 68a79b63b8204a21b06b365598657efb P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.663904  4417 raft_consensus.cc:2749] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.666694 28250 tablet_replica.cc:333] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.667438 28250 raft_consensus.cc:2243] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.668588 28250 raft_consensus.cc:2272] T f7a27de7996546fa9774914ac585e53e P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.671135 28250 tablet_replica.cc:333] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.671669 28250 raft_consensus.cc:2243] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.672067 28250 raft_consensus.cc:2272] T d1a51029dec74d1dbbf9385234e5cc62 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.674062 28250 tablet_replica.cc:333] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.674660 28250 raft_consensus.cc:2243] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.675092 28250 raft_consensus.cc:2272] T b15c7b44e85542b696746192c0ff0d5b P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.677115 28250 tablet_replica.cc:333] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.677654 28250 raft_consensus.cc:2243] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.678035 28250 raft_consensus.cc:2272] T 9232f678266f497c8f5aa9b1c3334fd5 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.680132 28250 tablet_replica.cc:333] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.680707 28250 raft_consensus.cc:2243] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.681105 28250 raft_consensus.cc:2272] T 42f3659596894d8b8dc2937c11c2a8cb P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.683209 28250 tablet_replica.cc:333] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.683728 28250 raft_consensus.cc:2243] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.684084 28250 raft_consensus.cc:2272] T 0f9a21fadcd94d04b664457da232b137 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.686412 28250 tablet_replica.cc:333] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.687362 28250 raft_consensus.cc:2243] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.687971 28250 raft_consensus.cc:2272] T b8adbc138e3a482086d6d658376baa14 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.691118 28250 tablet_replica.cc:333] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.691946 28250 raft_consensus.cc:2243] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.693171 28250 raft_consensus.cc:2272] T 20da3e12c2504daa9c5864745baaa5fd P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.695878 28250 tablet_replica.cc:333] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.696412 28250 raft_consensus.cc:2243] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.696848 28250 raft_consensus.cc:2272] T 87d9b8357182495897ba580d2a2949a3 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.699038 28250 tablet_replica.cc:333] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.699559 28250 raft_consensus.cc:2243] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.700418 28250 raft_consensus.cc:2272] T cd9e6e9c0bbf4380ac17aff9aafbbce0 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.702550 28250 tablet_replica.cc:333] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.703182 28250 raft_consensus.cc:2243] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.703647 28250 raft_consensus.cc:2272] T e03783871be14ed0a80c20c2be3e1b73 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.705706 28250 tablet_replica.cc:333] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.706311 28250 raft_consensus.cc:2243] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.706848 28250 raft_consensus.cc:2272] T cac7eee9d52843488adb542293814e1e P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.709034 28250 tablet_replica.cc:333] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.709649 28250 raft_consensus.cc:2243] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.710621 28250 raft_consensus.cc:2272] T 62ae694390334d8583cdad82212fb301 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.712837 28250 tablet_replica.cc:333] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.713439 28250 raft_consensus.cc:2243] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.714305 28250 raft_consensus.cc:2272] T dba85e8b48b84b388c287165e85c21e3 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.716490 28250 tablet_replica.cc:333] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.717131 28250 raft_consensus.cc:2243] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.717590 28250 raft_consensus.cc:2272] T 521a8d971e3f46fba3f81a2410d8beea P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.719784 28250 tablet_replica.cc:333] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.720335 28250 raft_consensus.cc:2243] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.720758 28250 raft_consensus.cc:2272] T 2760edcad0614547b67102f65f6369fc P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.722971 28250 tablet_replica.cc:333] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.723548 28250 raft_consensus.cc:2243] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.723986 28250 raft_consensus.cc:2272] T 56b367f1f6e54c6cb98054e8c63ba9da P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.726271 28250 tablet_replica.cc:333] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.726842 28250 raft_consensus.cc:2243] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.727309 28250 raft_consensus.cc:2272] T 306de156a5b14b259e6a51aafedf1579 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.729628 28250 tablet_replica.cc:333] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.730226 28250 raft_consensus.cc:2243] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.730741 28250 raft_consensus.cc:2272] T 95ca8466f1d64370b2f629ed81d829b5 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.733493 28250 tablet_replica.cc:333] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.734277 28250 raft_consensus.cc:2243] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.734843 28250 raft_consensus.cc:2272] T 4ee33bfcb9bb41ab90d52e8af1e38459 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.737180 28250 tablet_replica.cc:333] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.737768 28250 raft_consensus.cc:2243] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.738785 28250 raft_consensus.cc:2272] T 3cc0678dd7da4af08ae4454d8b3e9f32 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.741020 28250 tablet_replica.cc:333] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.741582 28250 raft_consensus.cc:2243] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.742041 28250 raft_consensus.cc:2272] T 2e470b894b5f4fe6933870e43f2eb8bc P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.744205 28250 tablet_replica.cc:333] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.744771 28250 raft_consensus.cc:2243] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.745210 28250 raft_consensus.cc:2272] T 4742746a7270495f9cdbaef49775d3a8 P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.747309 28250 tablet_replica.cc:333] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.747848 28250 raft_consensus.cc:2243] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.748297 28250 raft_consensus.cc:2272] T 856fc57094a04df1b76480bda9d496b4 P 6861cafc7c054539ab0c01ec4986d417 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.750414 28250 tablet_replica.cc:333] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.750983 28250 raft_consensus.cc:2243] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.751415 28250 raft_consensus.cc:2272] T aa6845d090104ffea526fc245bcd9e0d P 6861cafc7c054539ab0c01ec4986d417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.753310 28250 tablet_replica.cc:333] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.753839 28250 raft_consensus.cc:2243] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.754825 28250 raft_consensus.cc:2272] T e1d5ccb77dd0428e957babbce39cf870 P 6861cafc7c054539ab0c01ec4986d417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.756915 28250 tablet_replica.cc:333] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417: stopping tablet replica
I20260709 13:16:00.757409 28250 raft_consensus.cc:2243] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.758278 28250 raft_consensus.cc:2272] T 40f35a48457c46878dc583515c065166 P 6861cafc7c054539ab0c01ec4986d417 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.860348 28250 tablet_server.cc:196] TabletServer@127.27.150.132:0 shutdown complete.
I20260709 13:16:00.952517 28250 master.cc:562] Master@127.27.150.190:35321 shutting down...
I20260709 13:16:00.990880 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:00.991648 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.991990 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P 852795779ba14b01b0367d0ab7581152: stopping tablet replica
I20260709 13:16:01.016652 28250 master.cc:584] Master@127.27.150.190:35321 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36859 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:16:01.133046 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:42809
I20260709 13:16:01.135195 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:01.142001  4562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:01.142023  4561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:01.143493  4564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:01.144492 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:01.145788 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:01.145982 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:01.146109 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602961146097 us; error 0 us; skew 500 ppm
I20260709 13:16:01.146713 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:01.149295 28250 webserver.cc:533] Webserver started at http://127.27.150.190:42509/ using document root <none> and password file <none>
I20260709 13:16:01.149847 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:01.150012 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:01.150269 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:01.151612 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "28892534bff74cf5835669cf232d6c1d"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.156518 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:16:01.160645  4569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.161516 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:01.161845 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "28892534bff74cf5835669cf232d6c1d"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.162168 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:01.186594 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:01.187983 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:01.235663 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:42809
I20260709 13:16:01.235821  4620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:42809 every 8 connection(s)
I20260709 13:16:01.240305  4621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.253619  4621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d: Bootstrap starting.
I20260709 13:16:01.259694  4621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.265012  4621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d: No bootstrap required, opened a new log
I20260709 13:16:01.267640  4621 raft_consensus.cc:359] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28892534bff74cf5835669cf232d6c1d" member_type: VOTER }
I20260709 13:16:01.268088  4621 raft_consensus.cc:385] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.268365  4621 raft_consensus.cc:740] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28892534bff74cf5835669cf232d6c1d, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.269106  4621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28892534bff74cf5835669cf232d6c1d" member_type: VOTER }
I20260709 13:16:01.269603  4621 raft_consensus.cc:399] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:01.269833  4621 raft_consensus.cc:493] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:01.270125  4621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.275574  4621 raft_consensus.cc:515] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28892534bff74cf5835669cf232d6c1d" member_type: VOTER }
I20260709 13:16:01.276131  4621 leader_election.cc:304] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28892534bff74cf5835669cf232d6c1d; no voters: 
I20260709 13:16:01.277472  4621 leader_election.cc:290] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:01.278092  4624 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.279779  4624 raft_consensus.cc:697] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 1 LEADER]: Becoming Leader. State: Replica: 28892534bff74cf5835669cf232d6c1d, State: Running, Role: LEADER
I20260709 13:16:01.280514  4624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28892534bff74cf5835669cf232d6c1d" member_type: VOTER }
I20260709 13:16:01.280921  4621 sys_catalog.cc:565] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:01.285522  4625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28892534bff74cf5835669cf232d6c1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28892534bff74cf5835669cf232d6c1d" member_type: VOTER } }
I20260709 13:16:01.285820  4626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28892534bff74cf5835669cf232d6c1d. Latest consensus state: current_term: 1 leader_uuid: "28892534bff74cf5835669cf232d6c1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28892534bff74cf5835669cf232d6c1d" member_type: VOTER } }
I20260709 13:16:01.286299  4625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:01.286913  4626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:01.289863  4630 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:01.295435  4630 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:01.300462 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:01.306386  4630 catalog_manager.cc:1383] Generated new cluster ID: a5ae675beedb460f9c2120f60e6cb532
I20260709 13:16:01.306715  4630 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:01.332754  4630 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:01.334353  4630 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:01.353224  4630 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d: Generated new TSK 0
I20260709 13:16:01.353897  4630 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:01.367549 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:01.375005  4642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:01.376274  4643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:01.377496  4645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:01.378684 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:01.380002 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:01.380205 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:01.380339 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602961380320 us; error 0 us; skew 500 ppm
I20260709 13:16:01.380883 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:01.383538 28250 webserver.cc:533] Webserver started at http://127.27.150.129:40671/ using document root <none> and password file <none>
I20260709 13:16:01.384045 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:01.384214 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:01.384455 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:01.385749 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "3e5365d238c24ce69afea80c43ccdc11"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.390621 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:01.394428  4650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.395339 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:16:01.395690 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "3e5365d238c24ce69afea80c43ccdc11"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.396008 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:01.409021 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:01.410552 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:01.412256 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:01.414947 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:01.415177 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.415446 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:01.415648 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.466723 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:36667
I20260709 13:16:01.466904  4712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:36667 every 8 connection(s)
I20260709 13:16:01.472832 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:01.480937  4717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:01.481339  4718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:01.484799  4720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:01.485483 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:01.486937 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:01.487196 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:01.487411 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602961487388 us; error 0 us; skew 500 ppm
I20260709 13:16:01.488224 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:01.490402  4713 heartbeater.cc:344] Connected to a master server at 127.27.150.190:42809
I20260709 13:16:01.490914  4713 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:01.491317 28250 webserver.cc:533] Webserver started at http://127.27.150.130:42597/ using document root <none> and password file <none>
I20260709 13:16:01.492156 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:01.492014  4713 heartbeater.cc:507] Master 127.27.150.190:42809 requested a full tablet report, sending...
I20260709 13:16:01.492547 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:01.492941 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:01.494695 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "789afb67752345e2a6a132a5303ed77d"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.494781  4586 ts_manager.cc:194] Registered new tserver with Master: 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667)
I20260709 13:16:01.496845  4586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36984
I20260709 13:16:01.500111 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:01.503978  4725 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.504796 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:16:01.505110 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "789afb67752345e2a6a132a5303ed77d"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.505370 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:01.523833 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:01.525214 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:01.526893 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:01.529516 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:01.529749 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.530042 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:01.530223 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.579363 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:39439
I20260709 13:16:01.579502  4787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:39439 every 8 connection(s)
I20260709 13:16:01.585228 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:01.593825  4791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:01.595021  4792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:01.598971 28250 server_base.cc:1061] running on GCE node
W20260709 13:16:01.599418  4794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:01.600248  4788 heartbeater.cc:344] Connected to a master server at 127.27.150.190:42809
I20260709 13:16:01.600701 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:16:01.600718  4788 heartbeater.cc:461] Registering TS with master...
W20260709 13:16:01.601078 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:01.601326 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602961601305 us; error 0 us; skew 500 ppm
I20260709 13:16:01.601886  4788 heartbeater.cc:507] Master 127.27.150.190:42809 requested a full tablet report, sending...
I20260709 13:16:01.602015 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:01.604782  4586 ts_manager.cc:194] Registered new tserver with Master: 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:01.605237 28250 webserver.cc:533] Webserver started at http://127.27.150.131:42899/ using document root <none> and password file <none>
I20260709 13:16:01.605945 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:01.606171 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:01.606542 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:01.606763  4586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36992
I20260709 13:16:01.608268 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "0a4658e811264329a2404b95e39f0841"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.613402 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:01.617290  4799 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.618110 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:01.618479 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "0a4658e811264329a2404b95e39f0841"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:01.618811 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:01.628154 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:01.629572 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:01.631317 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:01.633808 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:01.634075 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:01.634344 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:01.634577 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:16:01.686575 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:35199
I20260709 13:16:01.686714  4861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:35199 every 8 connection(s)
I20260709 13:16:01.702668  4862 heartbeater.cc:344] Connected to a master server at 127.27.150.190:42809
I20260709 13:16:01.703245  4862 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:01.704025  4862 heartbeater.cc:507] Master 127.27.150.190:42809 requested a full tablet report, sending...
I20260709 13:16:01.706312  4586 ts_manager.cc:194] Registered new tserver with Master: 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:01.706703 28250 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016584322s
I20260709 13:16:01.707979  4586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36996
I20260709 13:16:01.735378  4586 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37008:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:01.738867  4586 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:01.888473  4753 tablet_service.cc:1511] Processing CreateTablet for tablet deaf2c93e50640fbbd8eadc6f7d888fe (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:01.900261  4750 tablet_service.cc:1511] Processing CreateTablet for tablet ab63b0bc7e8c499c8128931be5f79716 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:01.902240  4824 tablet_service.cc:1511] Processing CreateTablet for tablet ab63b0bc7e8c499c8128931be5f79716 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:01.903353  4749 tablet_service.cc:1511] Processing CreateTablet for tablet 24dda9aa8ca24bf8a8cd76e37f29fac3 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:01.904628  4824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab63b0bc7e8c499c8128931be5f79716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.891566  4752 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5224a3c0bd4a659ae972ff65c5e684 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:01.893342  4827 tablet_service.cc:1511] Processing CreateTablet for tablet deaf2c93e50640fbbd8eadc6f7d888fe (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:01.907512  4678 tablet_service.cc:1511] Processing CreateTablet for tablet deaf2c93e50640fbbd8eadc6f7d888fe (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:01.908174  4827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deaf2c93e50640fbbd8eadc6f7d888fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.909576  4678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deaf2c93e50640fbbd8eadc6f7d888fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.895599  4826 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5224a3c0bd4a659ae972ff65c5e684 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:01.911633  4826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5224a3c0bd4a659ae972ff65c5e684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.912760  4748 tablet_service.cc:1511] Processing CreateTablet for tablet 793988d2aa5143f7842434dce61afd63 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:01.895928  4751 tablet_service.cc:1511] Processing CreateTablet for tablet 4e55a42b62e947aeb7c258b2aa3b18fc (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:01.899161  4825 tablet_service.cc:1511] Processing CreateTablet for tablet 4e55a42b62e947aeb7c258b2aa3b18fc (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:01.916021  4825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e55a42b62e947aeb7c258b2aa3b18fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.918421  4747 tablet_service.cc:1511] Processing CreateTablet for tablet 0763b4a0be1e4b9cbb4f4d4c1711e8cb (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:01.919564  4750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab63b0bc7e8c499c8128931be5f79716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.920431  4747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0763b4a0be1e4b9cbb4f4d4c1711e8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.922865  4753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deaf2c93e50640fbbd8eadc6f7d888fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.929842  4822 tablet_service.cc:1511] Processing CreateTablet for tablet 793988d2aa5143f7842434dce61afd63 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:01.930521  4823 tablet_service.cc:1511] Processing CreateTablet for tablet 24dda9aa8ca24bf8a8cd76e37f29fac3 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:01.931732  4822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793988d2aa5143f7842434dce61afd63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.932013  4746 tablet_service.cc:1511] Processing CreateTablet for tablet 5b68f1dee43449788e3449cef20924dd (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:01.933735  4746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b68f1dee43449788e3449cef20924dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.934914  4823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24dda9aa8ca24bf8a8cd76e37f29fac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.936661  4821 tablet_service.cc:1511] Processing CreateTablet for tablet 0763b4a0be1e4b9cbb4f4d4c1711e8cb (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:01.938422  4821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0763b4a0be1e4b9cbb4f4d4c1711e8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.940980  4748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793988d2aa5143f7842434dce61afd63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.943854  4752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5224a3c0bd4a659ae972ff65c5e684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.947288  4745 tablet_service.cc:1511] Processing CreateTablet for tablet 4e61e6caf18f4100baa32a98fdc83b55 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:01.947916  4751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e55a42b62e947aeb7c258b2aa3b18fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.948978  4745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e61e6caf18f4100baa32a98fdc83b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.948516  4677 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5224a3c0bd4a659ae972ff65c5e684 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:01.950695  4749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24dda9aa8ca24bf8a8cd76e37f29fac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.950758  4676 tablet_service.cc:1511] Processing CreateTablet for tablet 4e55a42b62e947aeb7c258b2aa3b18fc (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:01.951436  4677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5224a3c0bd4a659ae972ff65c5e684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.952543  4676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e55a42b62e947aeb7c258b2aa3b18fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.955256  4820 tablet_service.cc:1511] Processing CreateTablet for tablet 5b68f1dee43449788e3449cef20924dd (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:01.955993  4675 tablet_service.cc:1511] Processing CreateTablet for tablet ab63b0bc7e8c499c8128931be5f79716 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:01.956959  4820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b68f1dee43449788e3449cef20924dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.957672  4675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab63b0bc7e8c499c8128931be5f79716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.960103  4674 tablet_service.cc:1511] Processing CreateTablet for tablet 24dda9aa8ca24bf8a8cd76e37f29fac3 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:01.960619  4744 tablet_service.cc:1511] Processing CreateTablet for tablet 7206992a083644439f471e2f72695a02 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:01.961688  4674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24dda9aa8ca24bf8a8cd76e37f29fac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.962378  4744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7206992a083644439f471e2f72695a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.964035  4819 tablet_service.cc:1511] Processing CreateTablet for tablet 4e61e6caf18f4100baa32a98fdc83b55 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:01.965891  4819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e61e6caf18f4100baa32a98fdc83b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.965534  4672 tablet_service.cc:1511] Processing CreateTablet for tablet 0763b4a0be1e4b9cbb4f4d4c1711e8cb (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:01.964030  4673 tablet_service.cc:1511] Processing CreateTablet for tablet 793988d2aa5143f7842434dce61afd63 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:01.968245  4673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793988d2aa5143f7842434dce61afd63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.968047  4671 tablet_service.cc:1511] Processing CreateTablet for tablet 5b68f1dee43449788e3449cef20924dd (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:01.969632  4671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b68f1dee43449788e3449cef20924dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.975544  4672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0763b4a0be1e4b9cbb4f4d4c1711e8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.977995  4818 tablet_service.cc:1511] Processing CreateTablet for tablet 7206992a083644439f471e2f72695a02 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:01.979688  4818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7206992a083644439f471e2f72695a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.991711  4670 tablet_service.cc:1511] Processing CreateTablet for tablet 4e61e6caf18f4100baa32a98fdc83b55 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:01.993424  4670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e61e6caf18f4100baa32a98fdc83b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.004115  4669 tablet_service.cc:1511] Processing CreateTablet for tablet 7206992a083644439f471e2f72695a02 (DEFAULT_TABLE table=test-workload [id=539dee6954f0454e9787896f65b7b517]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:02.005752  4669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7206992a083644439f471e2f72695a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.069561  4878 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.143424  4879 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.149497  4878 tablet_bootstrap.cc:654] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.156888  4880 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.164216  4879 tablet_bootstrap.cc:654] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.165980  4880 tablet_bootstrap.cc:654] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.169241  4878 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.170063  4878 ts_tablet_manager.cc:1403] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.008s
I20260709 13:16:02.170341  4879 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.171023  4879 ts_tablet_manager.cc:1403] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:16:02.172806  4880 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.173349  4880 ts_tablet_manager.cc:1403] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.005s
I20260709 13:16:02.174276  4879 raft_consensus.cc:359] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.174197  4878 raft_consensus.cc:359] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.175493  4879 raft_consensus.cc:385] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.175560  4878 raft_consensus.cc:385] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.175853  4879 raft_consensus.cc:740] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.176000  4878 raft_consensus.cc:740] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.176831  4880 raft_consensus.cc:359] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.176911  4879 consensus_queue.cc:260] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.176978  4878 consensus_queue.cc:260] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.177803  4880 raft_consensus.cc:385] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.178172  4880 raft_consensus.cc:740] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.179247  4880 consensus_queue.cc:260] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.180560  4788 heartbeater.cc:499] Master 127.27.150.190:42809 was elected leader, sending a full tablet report...
I20260709 13:16:02.180944  4879 ts_tablet_manager.cc:1434] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:02.182163  4879 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.186751  4880 ts_tablet_manager.cc:1434] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.004s
I20260709 13:16:02.189072  4886 raft_consensus.cc:493] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.189339  4878 ts_tablet_manager.cc:1434] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.009s
I20260709 13:16:02.189320  4713 heartbeater.cc:499] Master 127.27.150.190:42809 was elected leader, sending a full tablet report...
I20260709 13:16:02.189774  4886 raft_consensus.cc:515] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
W20260709 13:16:02.191577  4863 tablet.cc:2406] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:02.193552  4862 heartbeater.cc:499] Master 127.27.150.190:42809 was elected leader, sending a full tablet report...
I20260709 13:16:02.194012  4878 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.193895  4886 leader_election.cc:290] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.206720  4879 tablet_bootstrap.cc:654] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.212049  4878 tablet_bootstrap.cc:654] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.215368  4880 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.221382  4878 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.222208  4878 ts_tablet_manager.cc:1403] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 13:16:02.227329  4880 tablet_bootstrap.cc:654] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.227257  4878 raft_consensus.cc:359] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.228502  4878 raft_consensus.cc:385] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.228919  4878 raft_consensus.cc:740] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.239919  4763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e55a42b62e947aeb7c258b2aa3b18fc" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
W20260709 13:16:02.242583  4654 leader_election.cc:343] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.243914  4878 consensus_queue.cc:260] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.246253  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e55a42b62e947aeb7c258b2aa3b18fc" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.247088  4879 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.247793  4879 ts_tablet_manager.cc:1403] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.030s
I20260709 13:16:02.247923  4878 ts_tablet_manager.cc:1434] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
W20260709 13:16:02.248241  4654 leader_election.cc:343] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.248795  4654 leader_election.cc:304] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11; no voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:02.249181  4878 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.250028  4887 raft_consensus.cc:2749] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.251736  4879 raft_consensus.cc:359] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.252640  4879 raft_consensus.cc:385] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.253010  4879 raft_consensus.cc:740] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.254154  4879 consensus_queue.cc:260] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.256739  4879 ts_tablet_manager.cc:1434] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:02.257970  4879 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.258287  4878 tablet_bootstrap.cc:654] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.265980  4879 tablet_bootstrap.cc:654] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.266469  4880 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.267130  4880 ts_tablet_manager.cc:1403] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.012s
I20260709 13:16:02.276800  4880 raft_consensus.cc:359] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.277596  4880 raft_consensus.cc:385] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.277878  4880 raft_consensus.cc:740] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.278764  4880 consensus_queue.cc:260] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.282111  4878 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.282604  4879 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.282941  4878 ts_tablet_manager.cc:1403] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.002s
I20260709 13:16:02.283241  4879 ts_tablet_manager.cc:1403] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 13:16:02.287087  4878 raft_consensus.cc:359] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.287408  4879 raft_consensus.cc:359] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.288004  4878 raft_consensus.cc:385] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.288224  4879 raft_consensus.cc:385] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.288432  4878 raft_consensus.cc:740] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.288637  4879 raft_consensus.cc:740] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.289399  4878 consensus_queue.cc:260] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.289572  4880 ts_tablet_manager.cc:1434] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:16:02.289587  4879 consensus_queue.cc:260] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.293404  4878 ts_tablet_manager.cc:1434] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:16:02.294350  4879 ts_tablet_manager.cc:1434] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:16:02.294664  4878 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.295590  4879 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
W20260709 13:16:02.296051  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:02.298599  4880 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.303659  4878 tablet_bootstrap.cc:654] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.304141  4879 tablet_bootstrap.cc:654] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.309738  4880 tablet_bootstrap.cc:654] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.310837  4885 raft_consensus.cc:493] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.311452  4885 raft_consensus.cc:515] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.317408  4879 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.318118  4879 ts_tablet_manager.cc:1403] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:16:02.321954  4885 leader_election.cc:290] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:02.323017  4879 raft_consensus.cc:359] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.323922  4879 raft_consensus.cc:385] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.324360  4879 raft_consensus.cc:740] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.325582  4879 consensus_queue.cc:260] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.329063  4879 ts_tablet_manager.cc:1434] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:16:02.330827  4879 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.338742  4878 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.339519  4878 ts_tablet_manager.cc:1403] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.012s
I20260709 13:16:02.341359  4879 tablet_bootstrap.cc:654] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.343449  4878 raft_consensus.cc:359] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.344354  4878 raft_consensus.cc:385] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.344641  4878 raft_consensus.cc:740] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.345649  4878 consensus_queue.cc:260] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.350481  4887 raft_consensus.cc:493] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.351102  4887 raft_consensus.cc:515] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.352993  4878 ts_tablet_manager.cc:1434] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:16:02.353696  4887 leader_election.cc:290] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.354242  4878 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.354909  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.356735  4884 raft_consensus.cc:493] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.357499  4884 raft_consensus.cc:515] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.357991  4763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:02.358829  4763 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e5365d238c24ce69afea80c43ccdc11 in term 0.
W20260709 13:16:02.360598  4800 leader_election.cc:343] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.362332  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.363098  4837 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e5365d238c24ce69afea80c43ccdc11 in term 0.
I20260709 13:16:02.363452  4885 raft_consensus.cc:493] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.363867  4878 tablet_bootstrap.cc:654] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.364220  4885 raft_consensus.cc:515] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.364815  4654 leader_election.cc:304] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:02.368043  4887 raft_consensus.cc:2804] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.368566  4887 raft_consensus.cc:493] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.368888  4885 leader_election.cc:290] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:02.370075  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.378806  4763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:02.369011  4887 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:02.380592  4803 leader_election.cc:343] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.381183  4803 leader_election.cc:304] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4658e811264329a2404b95e39f0841; no voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:02.381393  4884 leader_election.cc:290] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.383899  4879 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.384706  4885 raft_consensus.cc:2749] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.384593  4879 ts_tablet_manager.cc:1403] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.042s
I20260709 13:16:02.373220  4880 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.377175  4878 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.385932  4878 ts_tablet_manager.cc:1403] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.004s
I20260709 13:16:02.388798  4879 raft_consensus.cc:359] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.389109  4878 raft_consensus.cc:359] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.389649  4879 raft_consensus.cc:385] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.389851  4878 raft_consensus.cc:385] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.390013  4879 raft_consensus.cc:740] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.377996  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:02.390918  4879 consensus_queue.cc:260] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
W20260709 13:16:02.391701  4803 leader_election.cc:343] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.390213  4878 raft_consensus.cc:740] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
W20260709 13:16:02.392575  4800 leader_election.cc:343] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.393666  4879 ts_tablet_manager.cc:1434] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:16:02.393045  4878 consensus_queue.cc:260] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.395265  4879 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.396070  4878 ts_tablet_manager.cc:1434] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:16:02.398319  4880 ts_tablet_manager.cc:1403] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.013s
I20260709 13:16:02.393157  4800 leader_election.cc:304] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4658e811264329a2404b95e39f0841; no voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:02.402310  4880 raft_consensus.cc:359] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.403152  4880 raft_consensus.cc:385] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.402948  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.403637  4880 raft_consensus.cc:740] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.403935  4879 tablet_bootstrap.cc:654] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:02.405675  4729 leader_election.cc:343] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.397245  4878 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.406519  4885 raft_consensus.cc:2749] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.417080  4887 raft_consensus.cc:515] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.419538  4887 leader_election.cc:290] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 election: Requested vote from peers 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.421383  4880 consensus_queue.cc:260] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.423623  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:02.421967  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:02.424199  4880 ts_tablet_manager.cc:1434] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:16:02.424782  4762 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.425567  4880 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.430202  4878 tablet_bootstrap.cc:654] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.439461  4879 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.440101  4879 ts_tablet_manager.cc:1403] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.017s
I20260709 13:16:02.440680  4880 tablet_bootstrap.cc:654] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.440510  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.441726  4688 raft_consensus.cc:2468] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.443264  4726 leader_election.cc:304] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 0a4658e811264329a2404b95e39f0841
I20260709 13:16:02.443683  4879 raft_consensus.cc:359] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.444501  4879 raft_consensus.cc:385] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.444759  4884 raft_consensus.cc:2804] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.444818  4879 raft_consensus.cc:740] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.445349  4884 raft_consensus.cc:493] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.445746  4884 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.446066  4879 consensus_queue.cc:260] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.450968  4837 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.456126  4879 ts_tablet_manager.cc:1434] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:16:02.460459  4879 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.468250  4879 tablet_bootstrap.cc:654] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.471606  4885 raft_consensus.cc:493] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.472424  4885 raft_consensus.cc:515] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.477201  4763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:02.478579  4885 leader_election.cc:290] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
W20260709 13:16:02.480155  4803 leader_election.cc:343] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.480638  4879 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.481235  4879 ts_tablet_manager.cc:1403] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:16:02.481652  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
W20260709 13:16:02.483417  4800 leader_election.cc:343] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.483891  4800 leader_election.cc:304] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4658e811264329a2404b95e39f0841; no voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:02.484779  4879 raft_consensus.cc:359] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.485152  4885 raft_consensus.cc:2749] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.486073  4879 raft_consensus.cc:385] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.486397  4879 raft_consensus.cc:740] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.487340  4879 consensus_queue.cc:260] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.490330  4879 ts_tablet_manager.cc:1434] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:16:02.491485  4879 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.498652  4879 tablet_bootstrap.cc:654] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.504520  4837 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e5365d238c24ce69afea80c43ccdc11 in term 1.
I20260709 13:16:02.506465  4654 leader_election.cc:304] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:02.507700  4887 raft_consensus.cc:2804] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.508383  4887 raft_consensus.cc:697] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 LEADER]: Becoming Leader. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Running, Role: LEADER
I20260709 13:16:02.509728  4887 consensus_queue.cc:237] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.510958  4884 raft_consensus.cc:515] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.515229  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.516115  4688 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.516726  4836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
W20260709 13:16:02.519109  4729 leader_election.cc:343] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.519930  4884 leader_election.cc:290] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.510026  4762 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e5365d238c24ce69afea80c43ccdc11 in term 1.
I20260709 13:16:02.527827  4878 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.528721  4878 ts_tablet_manager.cc:1403] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.132s	user 0.031s	sys 0.055s
I20260709 13:16:02.532084  4688 raft_consensus.cc:2468] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:02.534639  4878 raft_consensus.cc:359] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.535509  4880 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.537117  4880 ts_tablet_manager.cc:1403] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.112s	user 0.024s	sys 0.051s
I20260709 13:16:02.537191  4726 leader_election.cc:304] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 0a4658e811264329a2404b95e39f0841
I20260709 13:16:02.538735  4884 raft_consensus.cc:2804] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.538854  4879 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.539487  4879 ts_tablet_manager.cc:1403] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.035s
I20260709 13:16:02.540304  4884 raft_consensus.cc:697] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:02.540946  4880 raft_consensus.cc:359] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.541745  4880 raft_consensus.cc:385] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.541325  4884 consensus_queue.cc:237] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.542064  4880 raft_consensus.cc:740] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.542744  4879 raft_consensus.cc:359] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.543511  4879 raft_consensus.cc:385] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.543157  4880 consensus_queue.cc:260] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.543838  4879 raft_consensus.cc:740] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.544912  4879 consensus_queue.cc:260] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.545814  4878 raft_consensus.cc:385] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.546239  4878 raft_consensus.cc:740] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.545429  4586 catalog_manager.cc:5697] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "3e5365d238c24ce69afea80c43ccdc11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.547257  4878 consensus_queue.cc:260] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.548012  4879 ts_tablet_manager.cc:1434] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:02.549959  4879 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.551080  4878 ts_tablet_manager.cc:1434] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:16:02.552700  4878 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.556962  4879 tablet_bootstrap.cc:654] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.548520  4880 ts_tablet_manager.cc:1434] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:16:02.559482  4880 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.561210  4878 tablet_bootstrap.cc:654] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.567725  4880 tablet_bootstrap.cc:654] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.579303  4585 catalog_manager.cc:5697] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 0 to 1, leader changed from <none> to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 1 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.586822  4878 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.587548  4878 ts_tablet_manager.cc:1403] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.011s
I20260709 13:16:02.591156  4878 raft_consensus.cc:359] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.591957  4878 raft_consensus.cc:385] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.592324  4878 raft_consensus.cc:740] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.593302  4878 consensus_queue.cc:260] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.600031  4878 ts_tablet_manager.cc:1434] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:02.601296  4878 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.619062  4878 tablet_bootstrap.cc:654] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.623785  4879 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.624485  4879 ts_tablet_manager.cc:1403] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.037s
I20260709 13:16:02.626261  4880 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.626953  4880 ts_tablet_manager.cc:1403] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.068s	user 0.043s	sys 0.011s
I20260709 13:16:02.627225  4879 raft_consensus.cc:359] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.628031  4879 raft_consensus.cc:385] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.628328  4879 raft_consensus.cc:740] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.628857  4878 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.629396  4878 ts_tablet_manager.cc:1403] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 13:16:02.629194  4879 consensus_queue.cc:260] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.630301  4880 raft_consensus.cc:359] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.631229  4880 raft_consensus.cc:385] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.631531  4880 raft_consensus.cc:740] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.631788  4879 ts_tablet_manager.cc:1434] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:02.632544  4880 consensus_queue.cc:260] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.632730  4878 raft_consensus.cc:359] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.633284  4879 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: Bootstrap starting.
I20260709 13:16:02.633479  4878 raft_consensus.cc:385] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.633771  4878 raft_consensus.cc:740] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.634534  4878 consensus_queue.cc:260] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.636863  4878 ts_tablet_manager.cc:1434] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:16:02.637995  4878 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.643190  4880 ts_tablet_manager.cc:1434] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:16:02.644974  4878 tablet_bootstrap.cc:654] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.648617  4880 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.656275  4880 tablet_bootstrap.cc:654] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.656606  4879 tablet_bootstrap.cc:654] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.657991  4885 raft_consensus.cc:493] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.658660  4885 raft_consensus.cc:515] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.659762  4878 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.660377  4878 ts_tablet_manager.cc:1403] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:16:02.663507  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.663709  4878 raft_consensus.cc:359] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.663925  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:02.664611  4878 raft_consensus.cc:385] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.664973  4878 raft_consensus.cc:740] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
W20260709 13:16:02.665298  4800 leader_election.cc:343] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.664937  4762 raft_consensus.cc:2468] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 0.
I20260709 13:16:02.666164  4885 leader_election.cc:290] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:02.666255  4878 consensus_queue.cc:260] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.667343  4803 leader_election.cc:304] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:02.669114  4885 raft_consensus.cc:2804] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.669395  4878 ts_tablet_manager.cc:1434] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:02.669615  4885 raft_consensus.cc:493] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.670164  4885 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.670740  4878 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841: Bootstrap starting.
I20260709 13:16:02.679261  4878 tablet_bootstrap.cc:654] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.684471  4884 raft_consensus.cc:493] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.685317  4884 raft_consensus.cc:515] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.687546  4885 raft_consensus.cc:515] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.689507  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.690573  4879 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: No bootstrap required, opened a new log
I20260709 13:16:02.691320  4879 ts_tablet_manager.cc:1403] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.026s
I20260709 13:16:02.691711  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
W20260709 13:16:02.693524  4800 leader_election.cc:343] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.695922  4879 raft_consensus.cc:359] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.696261  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:02.696776  4879 raft_consensus.cc:385] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.697074  4879 raft_consensus.cc:740] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.697224  4762 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:02.697943  4726 leader_election.cc:343] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.698910  4879 consensus_queue.cc:260] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.701622  4879 ts_tablet_manager.cc:1434] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:16:02.702064  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.702941  4837 raft_consensus.cc:2468] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.704562  4729 leader_election.cc:304] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:02.705191  4884 leader_election.cc:290] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.705770  4906 raft_consensus.cc:2804] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.706369  4880 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.706805  4906 raft_consensus.cc:493] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.707216  4906 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.707376  4880 ts_tablet_manager.cc:1403] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.004s
I20260709 13:16:02.706044  4878 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841: No bootstrap required, opened a new log
I20260709 13:16:02.711181  4878 ts_tablet_manager.cc:1403] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.012s
I20260709 13:16:02.711300  4885 leader_election.cc:290] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:02.713304  4762 raft_consensus.cc:2468] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 1.
I20260709 13:16:02.714553  4803 leader_election.cc:304] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:02.714917  4878 raft_consensus.cc:359] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.715508  4885 raft_consensus.cc:2804] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.715687  4878 raft_consensus.cc:385] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.716029  4878 raft_consensus.cc:740] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.717053  4878 consensus_queue.cc:260] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.718850  4906 raft_consensus.cc:515] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.720899  4880 raft_consensus.cc:359] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.721738  4880 raft_consensus.cc:385] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.722090  4880 raft_consensus.cc:740] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.722159  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.723232  4880 consensus_queue.cc:260] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
W20260709 13:16:02.723891  4726 leader_election.cc:343] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.726027  4880 ts_tablet_manager.cc:1434] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.007s
I20260709 13:16:02.726805  4884 raft_consensus.cc:493] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.727406  4884 raft_consensus.cc:515] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.731339  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.732095  4837 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.732256  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.733706  4729 leader_election.cc:304] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:02.735255  4884 leader_election.cc:290] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.736140  4884 raft_consensus.cc:493] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.736258  4726 leader_election.cc:343] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.736775  4884 raft_consensus.cc:515] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.739392  4884 leader_election.cc:290] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199), 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667)
I20260709 13:16:02.742497  4884 raft_consensus.cc:2804] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.743598  4884 raft_consensus.cc:493] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.744592  4884 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.749264  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deaf2c93e50640fbbd8eadc6f7d888fe" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.750133  4687 raft_consensus.cc:2468] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.751573  4726 leader_election.cc:304] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:02.752626  4906 leader_election.cc:290] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.753412  4906 raft_consensus.cc:493] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.753993  4906 raft_consensus.cc:515] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.756569  4906 leader_election.cc:290] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.757167  4878 ts_tablet_manager.cc:1434] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841: Time spent starting tablet: real 0.046s	user 0.013s	sys 0.025s
I20260709 13:16:02.757411  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.727370  4880 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.758515  4687 raft_consensus.cc:2468] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.760027  4726 leader_election.cc:304] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:02.761046  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deaf2c93e50640fbbd8eadc6f7d888fe" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.761862  4837 raft_consensus.cc:2468] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.762872  4927 raft_consensus.cc:2804] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.763541  4927 raft_consensus.cc:493] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.764029  4927 raft_consensus.cc:3060] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.757091  4906 raft_consensus.cc:2804] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.764978  4885 raft_consensus.cc:697] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:02.765296  4906 raft_consensus.cc:493] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.764221  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:02.765831  4906 raft_consensus.cc:3060] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.766247  4837 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.768800  4836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.769513  4836 raft_consensus.cc:2468] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.767653  4880 tablet_bootstrap.cc:654] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.766147  4885 consensus_queue.cc:237] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.778131  4925 raft_consensus.cc:493] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.777609  4884 raft_consensus.cc:515] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.782075  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.782757  4884 leader_election.cc:290] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
W20260709 13:16:02.783914  4726 leader_election.cc:343] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.778712  4925 raft_consensus.cc:515] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.785808  4836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:02.786556  4836 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.787953  4925 leader_election.cc:290] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:02.790766  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e55a42b62e947aeb7c258b2aa3b18fc" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:02.790869  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e55a42b62e947aeb7c258b2aa3b18fc" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.793155  4762 raft_consensus.cc:2468] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 0.
I20260709 13:16:02.793344  4687 raft_consensus.cc:2468] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 0.
I20260709 13:16:02.795341  4800 leader_election.cc:304] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:02.798170  4927 raft_consensus.cc:515] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.799017  4924 raft_consensus.cc:2804] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.799536  4924 raft_consensus.cc:493] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.799889  4924 raft_consensus.cc:3060] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.801823  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.802512  4687 raft_consensus.cc:3060] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.803287  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:02.804497  4835 raft_consensus.cc:3060] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.811334  4586 catalog_manager.cc:5697] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.812367  4687 raft_consensus.cc:2468] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:02.813328  4836 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:02.813872  4726 leader_election.cc:304] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:02.814707  4837 raft_consensus.cc:2468] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:02.815066  4729 leader_election.cc:304] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:02.817847  4884 raft_consensus.cc:2804] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.818096  4926 raft_consensus.cc:2804] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.819212  4906 raft_consensus.cc:515] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.819715  4729 leader_election.cc:304] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:02.821868  4906 leader_election.cc:290] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Requested vote from peers 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199), 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667)
I20260709 13:16:02.822831  4906 raft_consensus.cc:2804] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.823354  4906 raft_consensus.cc:697] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:02.824361  4906 consensus_queue.cc:237] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.803421  4927 leader_election.cc:290] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.828935  4927 raft_consensus.cc:493] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.829449  4927 raft_consensus.cc:515] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.831799  4927 leader_election.cc:290] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.832713  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.833693  4688 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.834707  4880 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.835510  4880 ts_tablet_manager.cc:1403] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.108s	user 0.028s	sys 0.009s
I20260709 13:16:02.835409  4726 leader_election.cc:304] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:02.839850  4835 raft_consensus.cc:2468] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:02.840709  4880 raft_consensus.cc:359] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.841818  4880 raft_consensus.cc:385] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.842199  4880 raft_consensus.cc:740] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.844197  4927 raft_consensus.cc:2804] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.844764  4927 raft_consensus.cc:493] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.845221  4927 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.843549  4880 consensus_queue.cc:260] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.851751  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deaf2c93e50640fbbd8eadc6f7d888fe" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.847265  4884 raft_consensus.cc:697] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:02.859570  4926 raft_consensus.cc:697] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:02.858973  4687 raft_consensus.cc:3060] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.860596  4926 consensus_queue.cc:237] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.866726  4880 ts_tablet_manager.cc:1434] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:16:02.867317  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deaf2c93e50640fbbd8eadc6f7d888fe" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:02.867178  4884 consensus_queue.cc:237] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.868063  4835 raft_consensus.cc:3060] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.868194  4880 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:02.871964  4924 raft_consensus.cc:515] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.875720  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e55a42b62e947aeb7c258b2aa3b18fc" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.876415  4688 raft_consensus.cc:3060] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.877266  4880 tablet_bootstrap.cc:654] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.883261  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:02.883997  4837 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.885334  4835 raft_consensus.cc:2468] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:02.889874  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e55a42b62e947aeb7c258b2aa3b18fc" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:02.890551  4762 raft_consensus.cc:3060] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.892304  4729 leader_election.cc:304] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:02.895908  4926 raft_consensus.cc:493] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.896008  4932 raft_consensus.cc:2804] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.893895  4924 leader_election.cc:290] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:02.898669  4926 raft_consensus.cc:515] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.899784  4688 raft_consensus.cc:2468] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 1.
I20260709 13:16:02.898523  4932 raft_consensus.cc:697] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:02.901093  4800 leader_election.cc:304] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:02.902155  4924 raft_consensus.cc:2804] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.902608  4932 consensus_queue.cc:237] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:02.903491  4924 raft_consensus.cc:697] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:02.905529  4924 consensus_queue.cc:237] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.911103  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.912811  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
W20260709 13:16:02.914640  4726 leader_election.cc:343] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.914887  4835 raft_consensus.cc:2468] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 0.
I20260709 13:16:02.916786  4762 raft_consensus.cc:2468] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 1.
I20260709 13:16:02.917207  4729 leader_election.cc:304] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:02.920185  4884 raft_consensus.cc:2804] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.920909  4884 raft_consensus.cc:493] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.919685  4585 catalog_manager.cc:5697] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 0 to 1, leader changed from <none> to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 1 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.921412  4884 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.922410  4585 catalog_manager.cc:5697] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 0 to 1, leader changed from <none> to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 1 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.924232  4926 leader_election.cc:290] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.902740  4927 raft_consensus.cc:515] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.935672  4687 raft_consensus.cc:2468] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:02.942148  4927 leader_election.cc:290] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.945509  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:02.948768  4835 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.959372  4880 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:02.960105  4880 ts_tablet_manager.cc:1403] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.027s
I20260709 13:16:02.962004  4687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.962404  4586 catalog_manager.cc:5697] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 1 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.965739  4924 raft_consensus.cc:493] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.967061  4924 raft_consensus.cc:515] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.968990  4924 leader_election.cc:290] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:02.969852  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11" is_pre_election: true
I20260709 13:16:02.970865  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:02.972091  4884 raft_consensus.cc:515] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.973085  4688 raft_consensus.cc:2393] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a4658e811264329a2404b95e39f0841 in current term 1: Already voted for candidate 789afb67752345e2a6a132a5303ed77d in this term.
I20260709 13:16:02.973599  4585 catalog_manager.cc:5697] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 0 to 1, leader changed from <none> to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 1 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.974608  4800 leader_election.cc:304] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4658e811264329a2404b95e39f0841; no voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:02.975531  4884 leader_election.cc:290] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:02.975997  4585 catalog_manager.cc:5697] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 0 to 1, leader changed from <none> to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 1 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.962791  4687 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.963516  4880 raft_consensus.cc:359] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.977201  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:02.978282  4880 raft_consensus.cc:385] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.977201  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:02.978685  4880 raft_consensus.cc:740] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.978708  4837 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.979923  4880 consensus_queue.cc:260] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:02.981719  4880 ts_tablet_manager.cc:1434] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:16:02.977392  4924 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.983131  4880 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
W20260709 13:16:02.987221  4726 leader_election.cc:343] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.991061  4884 consensus_queue.cc:1048] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:02.991642  4880 tablet_bootstrap.cc:654] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.992559  4924 raft_consensus.cc:2749] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.011953  4835 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:03.013156  4837 raft_consensus.cc:2468] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:03.013671  4880 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:03.013688  4729 leader_election.cc:304] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:03.014381  4880 ts_tablet_manager.cc:1403] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.011s
I20260709 13:16:03.015470  4729 leader_election.cc:304] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:03.016456  4932 raft_consensus.cc:2804] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:03.016868  4884 raft_consensus.cc:2804] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:03.017045  4932 raft_consensus.cc:697] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:03.017511  4884 raft_consensus.cc:697] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:03.018522  4884 consensus_queue.cc:237] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.018219  4932 consensus_queue.cc:237] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.021059  4687 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:03.021195  4880 raft_consensus.cc:359] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.022030  4880 raft_consensus.cc:385] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.022338  4880 raft_consensus.cc:740] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.023157  4880 consensus_queue.cc:260] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.025717  4880 ts_tablet_manager.cc:1434] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:16:03.026945  4880 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:03.034978  4880 tablet_bootstrap.cc:654] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.051466  4927 consensus_queue.cc:1048] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:03.051854  4880 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: No bootstrap required, opened a new log
I20260709 13:16:03.052650  4880 ts_tablet_manager.cc:1403] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.009s
I20260709 13:16:03.056082  4880 raft_consensus.cc:359] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.056818  4880 raft_consensus.cc:385] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.057101  4880 raft_consensus.cc:740] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.057235  4585 catalog_manager.cc:5697] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 0 to 1, leader changed from <none> to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 1 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.057978  4880 consensus_queue.cc:260] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.059319  4585 catalog_manager.cc:5697] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 0 to 1, leader changed from <none> to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 1 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.060873  4880 ts_tablet_manager.cc:1434] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:03.061362  4887 consensus_queue.cc:1048] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:03.085449  4887 consensus_queue.cc:1048] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:03.097615  4887 raft_consensus.cc:493] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.098385  4887 raft_consensus.cc:515] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.103332  4887 leader_election.cc:290] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:03.104022  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:03.104557  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:03.105528  4835 raft_consensus.cc:2393] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e5365d238c24ce69afea80c43ccdc11 in current term 1: Already voted for candidate 789afb67752345e2a6a132a5303ed77d in this term.
I20260709 13:16:03.106559  4654 leader_election.cc:304] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11; no voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:03.107323  4887 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.113945  4887 raft_consensus.cc:2749] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.133970  4887 raft_consensus.cc:493] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.134626  4887 raft_consensus.cc:515] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.136693  4887 leader_election.cc:290] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:03.137746  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:03.137912  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:03.138703  4762 raft_consensus.cc:2393] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e5365d238c24ce69afea80c43ccdc11 in current term 1: Already voted for candidate 0a4658e811264329a2404b95e39f0841 in this term.
I20260709 13:16:03.139763  4654 leader_election.cc:304] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11; no voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:03.140527  4887 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.147358  4887 raft_consensus.cc:2749] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.221459  4932 consensus_queue.cc:1048] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:03.222513  4887 raft_consensus.cc:493] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.223212  4887 raft_consensus.cc:515] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:03.225665  4887 leader_election.cc:290] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:03.226377  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:03.227428  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:03.228407  4837 raft_consensus.cc:2393] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e5365d238c24ce69afea80c43ccdc11 in current term 1: Already voted for candidate 789afb67752345e2a6a132a5303ed77d in this term.
I20260709 13:16:03.229564  4654 leader_election.cc:304] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11; no voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:03.230525  4887 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.241770  4887 raft_consensus.cc:2749] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.242830  4884 consensus_queue.cc:1048] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:03.249567 28250 ts_manager.cc:295] Set tserver state for 3e5365d238c24ce69afea80c43ccdc11 to MAINTENANCE_MODE
I20260709 13:16:03.251075 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
I20260709 13:16:03.252785  4884 consensus_queue.cc:1048] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:03.262351  4726 consensus_peers.cc:597] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.288730  4924 consensus_queue.cc:1048] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:03.297284  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:03.299286 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:03.301645 28250 tablet_replica.cc:333] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.302757 28250 raft_consensus.cc:2243] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.303318 28250 raft_consensus.cc:2272] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.313040 28250 tablet_replica.cc:333] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.314049 28250 raft_consensus.cc:2243] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.314786 28250 raft_consensus.cc:2272] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.319352 28250 tablet_replica.cc:333] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.320137 28250 raft_consensus.cc:2243] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.320657 28250 raft_consensus.cc:2272] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:03.321009  4800 consensus_peers.cc:597] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.323019 28250 tablet_replica.cc:333] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.323830 28250 raft_consensus.cc:2243] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.324255 28250 raft_consensus.cc:2272] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.326689 28250 tablet_replica.cc:333] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.327338 28250 raft_consensus.cc:2243] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.327809 28250 raft_consensus.cc:2272] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.330204 28250 tablet_replica.cc:333] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.330874 28250 raft_consensus.cc:2243] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.331290 28250 raft_consensus.cc:2272] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.333683 28250 tablet_replica.cc:333] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.334421 28250 raft_consensus.cc:2243] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.334925 28250 raft_consensus.cc:2272] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:03.336375  4726 consensus_peers.cc:597] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.337323 28250 tablet_replica.cc:333] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.338029 28250 raft_consensus.cc:2243] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:03.339023 28250 raft_consensus.cc:2272] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.341343 28250 tablet_replica.cc:333] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.341919 28250 raft_consensus.cc:2243] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.342324 28250 raft_consensus.cc:2272] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.344412 28250 tablet_replica.cc:333] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: stopping tablet replica
I20260709 13:16:03.344949 28250 raft_consensus.cc:2243] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.345357 28250 raft_consensus.cc:2272] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.370610  4884 consensus_queue.cc:1048] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:03.383868 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
W20260709 13:16:03.390247  4726 consensus_peers.cc:597] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.405296  4956 consensus_queue.cc:1048] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:03.412889  4800 consensus_peers.cc:597] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:03.415318  4726 consensus_peers.cc:597] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:03.453754  4726 consensus_peers.cc:597] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.486652  4884 consensus_queue.cc:1048] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:03.486990  4932 consensus_queue.cc:1048] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:03.527262  4932 consensus_queue.cc:1048] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:03.568336  4726 consensus_peers.cc:597] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.647703  4932 consensus_queue.cc:1048] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:03.655382  4726 consensus_peers.cc:597] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:04.023586  4726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111) [suppressed 165 similar messages]
W20260709 13:16:04.298570  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:04.579660  4970 raft_consensus.cc:493] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e5365d238c24ce69afea80c43ccdc11)
I20260709 13:16:04.580317  4970 raft_consensus.cc:515] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:04.582345  4970 leader_election.cc:290] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:04.583858  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
W20260709 13:16:04.586724  4800 leader_election.cc:336] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111)
I20260709 13:16:04.587270  4800 leader_election.cc:304] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a4658e811264329a2404b95e39f0841; no voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:04.588029  4970 raft_consensus.cc:2749] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:04.588979  4884 raft_consensus.cc:493] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e5365d238c24ce69afea80c43ccdc11)
I20260709 13:16:04.589658  4884 raft_consensus.cc:515] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:04.591741  4884 leader_election.cc:290] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:04.592842  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:04.593523  4835 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 1.
I20260709 13:16:04.594817  4729 leader_election.cc:304] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:04.595620  4884 raft_consensus.cc:2804] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:04.595625  4726 leader_election.cc:336] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111)
I20260709 13:16:04.596027  4884 raft_consensus.cc:493] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e5365d238c24ce69afea80c43ccdc11)
I20260709 13:16:04.596429  4884 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.602841  4884 raft_consensus.cc:515] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:04.604660  4884 leader_election.cc:290] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:04.605731  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:04.606351  4835 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:04.608192  4726 leader_election.cc:336] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111)
I20260709 13:16:04.612622  4835 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 2.
I20260709 13:16:04.613682  4729 leader_election.cc:304] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 3e5365d238c24ce69afea80c43ccdc11
I20260709 13:16:04.614374  4884 raft_consensus.cc:2804] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:04.614874  4884 raft_consensus.cc:697] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:04.615576  4884 consensus_queue.cc:237] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:04.623358  4586 catalog_manager.cc:5697] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 1 to 2, leader changed from 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129) to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 2 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.207113  4835 raft_consensus.cc:1275] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.209408  4884 consensus_queue.cc:1048] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:05.226362  4726 consensus_peers.cc:597] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.299880  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:05.533278  4726 consensus_peers.cc:597] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:05.771813  4726 consensus_peers.cc:597] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:05.841249  4726 consensus_peers.cc:597] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:05.903908  4726 consensus_peers.cc:597] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:05.921838  4800 consensus_peers.cc:597] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:05.946175  4726 consensus_peers.cc:597] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:05.946321  4800 consensus_peers.cc:597] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:06.045964  4726 consensus_peers.cc:597] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:06.289700  4726 consensus_peers.cc:597] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:06.301218  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:07.302367  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:07.557173  4726 consensus_peers.cc:597] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.144646  4726 consensus_peers.cc:597] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:08.147163  4726 consensus_peers.cc:597] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:08.287242  4726 consensus_peers.cc:597] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:08.303536  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:08.421332 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:08.430152  4987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:08.431288  4988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:08.435079  4990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:08.438668 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:08.440176 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:08.440469 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:08.440685 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602968440648 us; error 0 us; skew 500 ppm
I20260709 13:16:08.441339 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:08.444655 28250 webserver.cc:533] Webserver started at http://127.27.150.129:40671/ using document root <none> and password file <none>
I20260709 13:16:08.445221 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:08.445433 28250 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:16:08.449958 28250 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:16:08.454085  4995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:08.454990 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:16:08.455313 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "3e5365d238c24ce69afea80c43ccdc11"
format_stamp: "Formatted at 2026-07-09 13:16:01 on dist-test-slave-nvvq"
I20260709 13:16:08.455755 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:08.472064 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:08.473453 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:08.475260 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:08.479197  5002 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:16:08.532171 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:16:08.532591 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.000s	sys 0.002s
I20260709 13:16:08.532953 28250 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:16:08.538702  5002 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
W20260709 13:16:08.542362  4800 consensus_peers.cc:597] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:08.556345  5002 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.557426  5002 tablet_bootstrap.cc:492] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.558100  5002 ts_tablet_manager.cc:1403] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:16:08.560600  5002 raft_consensus.cc:359] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.561196  5002 raft_consensus.cc:740] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.561861  5002 consensus_queue.cc:260] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.564474  5002 ts_tablet_manager.cc:1434] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:16:08.565320  5002 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.579205 28250 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:16:08.579485 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.047s	user 0.041s	sys 0.005s
I20260709 13:16:08.579871  5002 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.580912  5002 tablet_bootstrap.cc:492] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.581554  5002 ts_tablet_manager.cc:1403] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:16:08.584165  5002 raft_consensus.cc:359] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.584818  5002 raft_consensus.cc:740] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.585454  5002 consensus_queue.cc:260] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.587327  5002 ts_tablet_manager.cc:1434] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:16:08.588243  5002 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.609037  5002 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.610200  5002 tablet_bootstrap.cc:492] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.611143  5002 ts_tablet_manager.cc:1403] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.016s
I20260709 13:16:08.614307  5002 raft_consensus.cc:359] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:08.615103  5002 raft_consensus.cc:740] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.615924  5002 consensus_queue.cc:260] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } }
I20260709 13:16:08.618260  5002 ts_tablet_manager.cc:1434] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:08.619071  5002 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
W20260709 13:16:08.622905  4800 consensus_peers.cc:597] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:08.631538  5002 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.632274  5002 tablet_bootstrap.cc:492] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.632987  5002 ts_tablet_manager.cc:1403] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:16:08.636658  5002 raft_consensus.cc:359] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
W20260709 13:16:08.636861  4726 consensus_peers.cc:597] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:08.637272  5002 raft_consensus.cc:740] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
W20260709 13:16:08.637665  4726 consensus_peers.cc:597] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:08.638162  5002 consensus_queue.cc:260] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.640537  5002 ts_tablet_manager.cc:1434] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:08.641360  5002 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.654954  5002 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.655715  5002 tablet_bootstrap.cc:492] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.656323  5002 ts_tablet_manager.cc:1403] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:16:08.658887  5002 raft_consensus.cc:359] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.659466  5002 raft_consensus.cc:740] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.660287  5002 consensus_queue.cc:260] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.661805  5002 ts_tablet_manager.cc:1434] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:08.662492 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:36667
I20260709 13:16:08.662604  5002 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.662638  5064 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:36667 every 8 connection(s)
I20260709 13:16:08.668426 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:08.689985  5002 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.691133  5002 tablet_bootstrap.cc:492] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.692050  5002 ts_tablet_manager.cc:1403] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260709 13:16:08.695551  5002 raft_consensus.cc:359] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.697237  5002 raft_consensus.cc:740] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.698415  5002 consensus_queue.cc:260] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.700611  5002 ts_tablet_manager.cc:1434] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:08.701526  5002 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.708681  5065 heartbeater.cc:344] Connected to a master server at 127.27.150.190:42809
I20260709 13:16:08.709218  5065 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:08.710194  5065 heartbeater.cc:507] Master 127.27.150.190:42809 requested a full tablet report, sending...
I20260709 13:16:08.713450  4762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:08.714787  4762 raft_consensus.cc:606] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:08.718014  4762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:08.718647  4762 raft_consensus.cc:606] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:08.719097  5002 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.719445  4585 ts_manager.cc:194] Re-registered known tserver with Master: 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667)
I20260709 13:16:08.720002  5002 tablet_bootstrap.cc:492] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.720782  5002 ts_tablet_manager.cc:1403] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:16:08.721664  4763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7206992a083644439f471e2f72695a02"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:08.722359  4763 raft_consensus.cc:606] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:08.723562  5002 raft_consensus.cc:359] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.724344  5002 raft_consensus.cc:740] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.725168  5002 consensus_queue.cc:260] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.727151  5002 ts_tablet_manager.cc:1434] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:08.727875  5002 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.728372  4762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793988d2aa5143f7842434dce61afd63"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:08.729068  4762 raft_consensus.cc:606] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:08.730639 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:08.731684 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:08.732580 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:08.734982  4585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37020
I20260709 13:16:08.739217  5065 heartbeater.cc:499] Master 127.27.150.190:42809 was elected leader, sending a full tablet report...
I20260709 13:16:08.757009  5002 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.758100  5002 tablet_bootstrap.cc:492] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.758848  5002 ts_tablet_manager.cc:1403] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 13:16:08.761448  5002 raft_consensus.cc:359] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.762145  5002 raft_consensus.cc:740] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.762943  5002 consensus_queue.cc:260] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.765278  5002 ts_tablet_manager.cc:1434] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:08.766124  5002 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.779155  5002 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.780042  5002 tablet_bootstrap.cc:492] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.780601  5002 ts_tablet_manager.cc:1403] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:16:08.782601  5002 raft_consensus.cc:359] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.783181  5002 raft_consensus.cc:740] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.783753  5002 consensus_queue.cc:260] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.785799  5002 ts_tablet_manager.cc:1434] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:08.786721  5002 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap starting.
I20260709 13:16:08.800127  5002 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.800884  5002 tablet_bootstrap.cc:492] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Bootstrap complete.
I20260709 13:16:08.801501  5002 ts_tablet_manager.cc:1403] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:16:08.803550  5002 raft_consensus.cc:359] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.804075  5002 raft_consensus.cc:385] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.804304  5002 raft_consensus.cc:740] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5365d238c24ce69afea80c43ccdc11, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.804925  5002 consensus_queue.cc:260] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.806708  5002 ts_tablet_manager.cc:1434] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:16:08.872895  4982 raft_consensus.cc:993] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:08.873457  5080 raft_consensus.cc:1081] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:08.875212  4835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793988d2aa5143f7842434dce61afd63"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:08.875686  4835 raft_consensus.cc:493] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:08.875926  4835 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.881469  4835 raft_consensus.cc:515] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.883128  4835 leader_election.cc:290] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:08.884501  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:08.885290  4762 raft_consensus.cc:3055] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:08.885649  4762 raft_consensus.cc:740] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:08.886567  4762 consensus_queue.cc:260] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.887713  4762 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.893520  5037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:08.894266  5037 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.894527  4762 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:08.895905  4803 leader_election.cc:304] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:08.896690  4970 raft_consensus.cc:2804] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:08.898211  4970 raft_consensus.cc:697] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:08.899317  4970 consensus_queue.cc:237] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.902669  5037 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:08.909009  4585 catalog_manager.cc:5697] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 1 to 2, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.928503  5074 raft_consensus.cc:493] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.929216  5074 raft_consensus.cc:515] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:08.931835  5074 leader_election.cc:290] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:08.943255  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789afb67752345e2a6a132a5303ed77d" is_pre_election: true
I20260709 13:16:08.945621  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "3e5365d238c24ce69afea80c43ccdc11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4658e811264329a2404b95e39f0841" is_pre_election: true
I20260709 13:16:08.946990  4999 leader_election.cc:304] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11; no voters: 0a4658e811264329a2404b95e39f0841, 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:08.947839  5074 raft_consensus.cc:2749] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:08.988734  5037 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.000478  4982 raft_consensus.cc:993] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.004591  5080 raft_consensus.cc:1081] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.009310  4837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:09.010006  4837 raft_consensus.cc:493] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.010439  4837 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.011270  5090 raft_consensus.cc:993] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.012068  5091 raft_consensus.cc:1081] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.013978  4835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7206992a083644439f471e2f72695a02"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:09.014667  4835 raft_consensus.cc:493] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.015043  4835 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.018659  4837 raft_consensus.cc:515] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.020913  4837 leader_election.cc:290] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:09.021013  4835 raft_consensus.cc:515] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.021678  5037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:09.022192  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:09.022495  5037 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.022962  4762 raft_consensus.cc:3055] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.023306  4835 leader_election.cc:290] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:09.023355  4762 raft_consensus.cc:740] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:09.024125  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:09.024887  5038 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.024616  4762 consensus_queue.cc:260] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.024616  4763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:09.026027  4763 raft_consensus.cc:3055] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.026363  4763 raft_consensus.cc:740] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:09.026335  4762 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.027402  4763 consensus_queue.cc:260] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.028980  4763 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.031755  5037 raft_consensus.cc:2468] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.033031  4800 leader_election.cc:304] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:09.033949  4970 raft_consensus.cc:2804] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.033962  5038 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.034688  4970 raft_consensus.cc:697] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:09.035537  4800 leader_election.cc:304] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:09.035681  4970 consensus_queue.cc:237] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.036556  4762 raft_consensus.cc:2468] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.037089  4763 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.038944  5093 raft_consensus.cc:2804] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.044718  5093 raft_consensus.cc:697] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:09.045740  5093 consensus_queue.cc:237] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.047897  4585 catalog_manager.cc:5697] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 1 to 2, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.064772  4586 catalog_manager.cc:5697] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 1 to 2, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.128070  5090 raft_consensus.cc:993] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.128585  5091 raft_consensus.cc:1081] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.130096  4835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:09.130700  4835 raft_consensus.cc:493] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.130952  4835 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.136668  4835 raft_consensus.cc:515] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.138281  4835 leader_election.cc:290] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:09.139271  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:09.139424  4763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:09.140002  5038 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.140130  4763 raft_consensus.cc:3055] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.140615  4763 raft_consensus.cc:740] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:09.141398  4763 consensus_queue.cc:260] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.142571  4763 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.146189  5038 raft_consensus.cc:2468] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.147630  4800 leader_election.cc:304] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:09.148527  5093 raft_consensus.cc:2804] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.148983  5093 raft_consensus.cc:697] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:09.149806  4763 raft_consensus.cc:2468] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.149740  5093 consensus_queue.cc:237] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.158368  4586 catalog_manager.cc:5697] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 1 to 2, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:09.304598  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:09.412655  4763 raft_consensus.cc:1275] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.414388  5093 consensus_queue.cc:1048] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:09.426133  5038 raft_consensus.cc:1275] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.428680  4970 consensus_queue.cc:1048] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:09.487895  5038 raft_consensus.cc:1275] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.489442  4970 consensus_queue.cc:1048] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:09.500277  4763 raft_consensus.cc:1275] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.501839  5095 consensus_queue.cc:1048] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:09.563858  5038 raft_consensus.cc:1275] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.565537  4970 consensus_queue.cc:1048] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:09.571323  4763 raft_consensus.cc:1275] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.572969  4970 consensus_queue.cc:1048] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:09.580852  4762 raft_consensus.cc:1275] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.583568  5081 consensus_queue.cc:1048] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:09.587059  5038 raft_consensus.cc:1275] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.592377  5081 consensus_queue.cc:1048] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:09.743320 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:09.751214  4762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:09.751804  4762 raft_consensus.cc:606] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:09.767338  4835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7206992a083644439f471e2f72695a02"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
mode: GRACEFUL
new_leader_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:38256
I20260709 13:16:09.767966  4835 raft_consensus.cc:606] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Received request to transfer leadership to TS 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:09.770944  4835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
mode: GRACEFUL
new_leader_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:38256
I20260709 13:16:09.771410  4835 raft_consensus.cc:606] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 LEADER]: Received request to transfer leadership to TS 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:09.772470 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:09.773065 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:09.773763 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:09.830296  5112 raft_consensus.cc:993] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.831070  5090 raft_consensus.cc:1081] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:09.832685  4835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:09.833194  4835 raft_consensus.cc:493] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.833490  4835 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.840042  4835 raft_consensus.cc:515] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.842567  4835 leader_election.cc:290] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:09.842871  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:09.843218  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:09.843710  5038 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.844038  4762 raft_consensus.cc:3055] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.844451  4762 raft_consensus.cc:740] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:09.845260  4762 consensus_queue.cc:260] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.846570  4762 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.850603  5038 raft_consensus.cc:2468] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.851822  4800 leader_election.cc:304] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:09.852726  5081 raft_consensus.cc:2804] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.852910  4762 raft_consensus.cc:2468] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:09.853150  5081 raft_consensus.cc:697] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:09.854153  5081 consensus_queue.cc:237] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:09.861759  4583 catalog_manager.cc:5697] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 1 to 2, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.024307  5095 raft_consensus.cc:993] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841: : Instructing follower 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:10.024989  5081 raft_consensus.cc:1081] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Signalling peer 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:10.026799  4762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7206992a083644439f471e2f72695a02"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:16:10.027818  4762 raft_consensus.cc:493] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.028326  4762 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.035893  4762 raft_consensus.cc:515] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.038362  4762 leader_election.cc:290] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:10.038796  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:10.038960  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:10.039721  5038 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.039772  4835 raft_consensus.cc:3055] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.040251  4835 raft_consensus.cc:740] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:10.041108  4835 consensus_queue.cc:260] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.042809  4835 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.048166  5038 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:10.049602  4726 leader_election.cc:304] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:10.050496  5090 raft_consensus.cc:2804] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:10.050994  5090 raft_consensus.cc:697] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:10.051126  4835 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:10.051937  5090 consensus_queue.cc:237] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.059329  4583 catalog_manager.cc:5697] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 2 to 3, leader changed from 0a4658e811264329a2404b95e39f0841 (127.27.150.131) to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 3 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.108469  4970 raft_consensus.cc:993] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841: : Instructing follower 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:10.108992  5081 raft_consensus.cc:1081] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 LEADER]: Signalling peer 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:10.110579  4762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:16:10.111243  4762 raft_consensus.cc:493] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.111662  4762 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.118718  4762 raft_consensus.cc:515] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.120455  4762 leader_election.cc:290] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:10.121212  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:10.121611  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:10.121919  5038 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.122237  4835 raft_consensus.cc:3055] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.122661  4835 raft_consensus.cc:740] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:10.123391  4835 consensus_queue.cc:260] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.124374  4835 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.128472  5038 raft_consensus.cc:2468] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 2.
I20260709 13:16:10.130023  4726 leader_election.cc:304] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:10.131038  5090 raft_consensus.cc:2804] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.131587  5090 raft_consensus.cc:697] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:10.131860  4835 raft_consensus.cc:2468] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 2.
I20260709 13:16:10.132618  5090 consensus_queue.cc:237] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.140692  4583 catalog_manager.cc:5697] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 1 to 2, leader changed from 0a4658e811264329a2404b95e39f0841 (127.27.150.131) to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 2 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:10.305761  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:10.319710  5038 raft_consensus.cc:1275] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.321848  5081 consensus_queue.cc:1048] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.338789  4762 raft_consensus.cc:1275] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.340685  5081 consensus_queue.cc:1048] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.482000  4835 raft_consensus.cc:1275] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:10.483497  5090 consensus_queue.cc:1048] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.492477  5038 raft_consensus.cc:1275] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:10.494112  5090 consensus_queue.cc:1048] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.592887  4835 raft_consensus.cc:1275] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.595374  5090 consensus_queue.cc:1048] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.606036  5038 raft_consensus.cc:1275] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.608319  5090 consensus_queue.cc:1048] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.780541 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.790844  4835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
mode: GRACEFUL
new_leader_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:38256
I20260709 13:16:10.791478  4835 raft_consensus.cc:606] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Received request to transfer leadership to TS 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:10.794493  4762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7206992a083644439f471e2f72695a02"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:10.795085  4762 raft_consensus.cc:606] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:10.797600  4762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:10.798120  4762 raft_consensus.cc:606] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:10.799172 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:10.799706 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:10.800379 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.967519  5130 raft_consensus.cc:993] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841: : Instructing follower 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:10.968195  5081 raft_consensus.cc:1081] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Signalling peer 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:10.969880  4762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:16:10.970489  4762 raft_consensus.cc:493] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.970853  4762 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.977779  4762 raft_consensus.cc:515] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.979462  4762 leader_election.cc:290] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:10.980744  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:10.981751  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24dda9aa8ca24bf8a8cd76e37f29fac3" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:10.982440  4835 raft_consensus.cc:3055] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.982481  5038 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.982965  4835 raft_consensus.cc:740] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:10.983971  4835 consensus_queue.cc:260] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:10.985417  4835 raft_consensus.cc:3060] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.991431  5038 raft_consensus.cc:2468] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:10.992717  4726 leader_election.cc:304] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:10.993443  5090 raft_consensus.cc:2804] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:10.993629  4835 raft_consensus.cc:2468] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:10.993933  5090 raft_consensus.cc:697] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:10.995174  5090 consensus_queue.cc:237] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.003579  4585 catalog_manager.cc:5697] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 2 to 3, leader changed from 0a4658e811264329a2404b95e39f0841 (127.27.150.131) to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 3 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.063930  5127 raft_consensus.cc:993] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:11.064591  5090 raft_consensus.cc:1081] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:11.066618  4835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7206992a083644439f471e2f72695a02"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:11.067287  4835 raft_consensus.cc:493] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.067688  4835 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.077118  4835 raft_consensus.cc:515] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.079563  4835 leader_election.cc:290] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 4 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:11.080525  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:11.080879  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7206992a083644439f471e2f72695a02" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:11.081388  5038 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.081473  4762 raft_consensus.cc:3055] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.081930  4762 raft_consensus.cc:740] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:11.082934  4762 consensus_queue.cc:260] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.084338  4762 raft_consensus.cc:3060] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.089604  5038 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 4.
I20260709 13:16:11.092017  4800 leader_election.cc:304] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:11.092711  4762 raft_consensus.cc:2468] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 4.
I20260709 13:16:11.092919  5081 raft_consensus.cc:2804] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.093614  5081 raft_consensus.cc:697] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 4 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:11.094672  5081 consensus_queue.cc:237] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.102753  4585 catalog_manager.cc:5697] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 3 to 4, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 4 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.120812  5090 raft_consensus.cc:993] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:11.121538  5112 raft_consensus.cc:1081] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:11.123430  4835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:11.124229  4835 raft_consensus.cc:493] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.124730  4835 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.131506  4835 raft_consensus.cc:515] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.133786  4835 leader_election.cc:290] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 3 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:11.134660  5038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:11.135545  5038 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.135725  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab63b0bc7e8c499c8128931be5f79716" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:11.136422  4762 raft_consensus.cc:3055] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:11.136679  4762 raft_consensus.cc:740] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:11.137427  4762 consensus_queue.cc:260] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.138526  4762 raft_consensus.cc:3060] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.141780  5038 raft_consensus.cc:2468] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 3.
I20260709 13:16:11.143011  4800 leader_election.cc:304] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:11.143819  5081 raft_consensus.cc:2804] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:11.143975  4762 raft_consensus.cc:2468] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 3.
I20260709 13:16:11.144305  5081 raft_consensus.cc:697] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 3 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:11.145690  5081 consensus_queue.cc:237] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.152212  4585 catalog_manager.cc:5697] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 2 to 3, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 3 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:11.307039  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:11.451599  4835 raft_consensus.cc:1275] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.453372  5090 consensus_queue.cc:1048] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.464293  5038 raft_consensus.cc:1275] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.466332  5112 consensus_queue.cc:1048] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.507131  5037 raft_consensus.cc:1275] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:11.508847  5081 consensus_queue.cc:1048] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:11.519230  4762 raft_consensus.cc:1275] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:11.520727  5141 consensus_queue.cc:1048] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:11.524703  5037 raft_consensus.cc:1275] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.526131  5141 consensus_queue.cc:1048] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.548794  4762 raft_consensus.cc:1275] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.553381  5130 consensus_queue.cc:1048] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.807394 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.816551  4760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:11.817306  4760 raft_consensus.cc:606] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:11.864117  4835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
mode: GRACEFUL
new_leader_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:38256
I20260709 13:16:11.866289  4835 raft_consensus.cc:606] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Received request to transfer leadership to TS 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:11.872103  4835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793988d2aa5143f7842434dce61afd63"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
mode: GRACEFUL
new_leader_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:38256
I20260709 13:16:11.873010  4835 raft_consensus.cc:606] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Received request to transfer leadership to TS 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:11.875000 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:11.876307 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:11.877436 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.918856  5141 raft_consensus.cc:993] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841: : Instructing follower 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:11.919764  5130 raft_consensus.cc:1081] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Signalling peer 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:11.922046  4760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:16:11.922940  4760 raft_consensus.cc:493] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.923483  4760 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.938405  4760 raft_consensus.cc:515] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.941144  4760 leader_election.cc:290] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:11.942827  4835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:11.942744  5037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61e6caf18f4100baa32a98fdc83b55" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:11.943907  4835 raft_consensus.cc:3055] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:11.944442  4835 raft_consensus.cc:740] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:11.944483  5037 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.946084  4835 consensus_queue.cc:260] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.948480  4835 raft_consensus.cc:3060] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.954998  5037 raft_consensus.cc:2468] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:11.956543  4726 leader_election.cc:304] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:11.957880  5090 raft_consensus.cc:2804] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:11.958534  5090 raft_consensus.cc:697] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:11.958617  4835 raft_consensus.cc:2468] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:11.960268  5090 consensus_queue.cc:237] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:11.968766  4586 catalog_manager.cc:5697] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 2 to 3, leader changed from 0a4658e811264329a2404b95e39f0841 (127.27.150.131) to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 3 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.119900  5081 raft_consensus.cc:993] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: : Instructing follower 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:12.120537  5130 raft_consensus.cc:1081] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Signalling peer 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:12.122225  4760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793988d2aa5143f7842434dce61afd63"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:16:12.122815  4760 raft_consensus.cc:493] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.123131  4760 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.133066  4760 raft_consensus.cc:515] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:12.135049  4760 leader_election.cc:290] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:12.135728  5037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:12.136511  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:12.137580  5037 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.137706  4837 raft_consensus.cc:3055] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:12.138332  4837 raft_consensus.cc:740] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:12.139751  4837 consensus_queue.cc:260] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:12.141999  4837 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.146632  5037 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:12.148030  4726 leader_election.cc:304] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:12.148813  5090 raft_consensus.cc:2804] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:12.149263  5090 raft_consensus.cc:697] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:12.150751  5090 consensus_queue.cc:237] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:12.153321  4837 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:12.158179  4586 catalog_manager.cc:5697] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 2 to 3, leader changed from 0a4658e811264329a2404b95e39f0841 (127.27.150.131) to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 3 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.299347  5112 raft_consensus.cc:993] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:12.300021  5090 raft_consensus.cc:1081] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:12.301690  4837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:12.302273  4837 raft_consensus.cc:493] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.302654  4837 raft_consensus.cc:3060] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:12.308574  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:12.309886  4837 raft_consensus.cc:515] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:12.312050  4837 leader_election.cc:290] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:12.313040  5037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:12.313375  4760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0763b4a0be1e4b9cbb4f4d4c1711e8cb" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:12.313835  5037 raft_consensus.cc:3060] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.314594  4760 raft_consensus.cc:3055] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.315106  4760 raft_consensus.cc:740] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:12.316217  4760 consensus_queue.cc:260] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:12.317940  4760 raft_consensus.cc:3060] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.320369  5037 raft_consensus.cc:2468] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:12.322893  4800 leader_election.cc:304] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:12.323791  5130 raft_consensus.cc:2804] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.324286  5130 raft_consensus.cc:697] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:12.325443  5130 consensus_queue.cc:237] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:12.325726  4760 raft_consensus.cc:2468] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 2.
I20260709 13:16:12.338581  4586 catalog_manager.cc:5697] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 1 to 2, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 2 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.387461  4837 raft_consensus.cc:1275] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:12.389312  5090 consensus_queue.cc:1048] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.402323  5037 raft_consensus.cc:1275] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:12.404050  5090 consensus_queue.cc:1048] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.537017  5036 raft_consensus.cc:1275] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:12.538776  5090 consensus_queue.cc:1048] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.549990  4837 raft_consensus.cc:1275] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:12.551729  5127 consensus_queue.cc:1048] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.777848  4760 raft_consensus.cc:1275] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.779409  5130 consensus_queue.cc:1048] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.791152  5036 raft_consensus.cc:1275] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.793026  5161 consensus_queue.cc:1048] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:12.886729 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.896653  4837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
mode: GRACEFUL
new_leader_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:38256
I20260709 13:16:12.897374  4837 raft_consensus.cc:606] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Received request to transfer leadership to TS 789afb67752345e2a6a132a5303ed77d
I20260709 13:16:12.900738  4760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793988d2aa5143f7842434dce61afd63"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:12.901301  4760 raft_consensus.cc:606] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:12.904057  4760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
mode: GRACEFUL
new_leader_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:50838
I20260709 13:16:12.904575  4760 raft_consensus.cc:606] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Received request to transfer leadership to TS 0a4658e811264329a2404b95e39f0841
I20260709 13:16:12.905803 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:12.906373 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:12.907074 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.999501  5090 raft_consensus.cc:993] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:13.000301  5127 raft_consensus.cc:1081] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:13.001892  4837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793988d2aa5143f7842434dce61afd63"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:13.002537  4837 raft_consensus.cc:493] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.002899  4837 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.010040  4837 raft_consensus.cc:515] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.012006  4837 leader_election.cc:290] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 4 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:13.012917  5036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:13.013084  4760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793988d2aa5143f7842434dce61afd63" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:13.013746  5036 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.013797  4760 raft_consensus.cc:3055] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.014340  4760 raft_consensus.cc:740] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:13.015393  4760 consensus_queue.cc:260] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.016976  4760 raft_consensus.cc:3060] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.024121  5036 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 4.
I20260709 13:16:13.025914  4800 leader_election.cc:304] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:13.026278  4760 raft_consensus.cc:2468] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 4.
I20260709 13:16:13.026815  5161 raft_consensus.cc:2804] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.027449  5161 raft_consensus.cc:697] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 4 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:13.028429  5161 consensus_queue.cc:237] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.035499  4586 catalog_manager.cc:5697] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 3 to 4, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 4 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.085619  5112 raft_consensus.cc:993] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d: : Instructing follower 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:13.086207  5127 raft_consensus.cc:1081] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Signalling peer 0a4658e811264329a2404b95e39f0841 to start an election
I20260709 13:16:13.087743  4837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684"
dest_uuid: "0a4658e811264329a2404b95e39f0841"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:16:13.088354  4837 raft_consensus.cc:493] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.088685  4837 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.095914  4837 raft_consensus.cc:515] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.097654  4837 leader_election.cc:290] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 3 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439)
I20260709 13:16:13.098740  5036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:13.099040  4760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5224a3c0bd4a659ae972ff65c5e684" candidate_uuid: "0a4658e811264329a2404b95e39f0841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "789afb67752345e2a6a132a5303ed77d"
I20260709 13:16:13.099669  5036 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.099728  4760 raft_consensus.cc:3055] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:13.100226  4760 raft_consensus.cc:740] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:13.101394  4760 consensus_queue.cc:260] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.103188  4760 raft_consensus.cc:3060] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.109256  5036 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 3.
I20260709 13:16:13.110702  4800 leader_election.cc:304] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4658e811264329a2404b95e39f0841, 3e5365d238c24ce69afea80c43ccdc11; no voters: 
I20260709 13:16:13.111581  5161 raft_consensus.cc:2804] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:13.112152  5161 raft_consensus.cc:697] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 3 LEADER]: Becoming Leader. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:13.113417  4760 raft_consensus.cc:2468] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4658e811264329a2404b95e39f0841 in term 3.
I20260709 13:16:13.113431  5161 consensus_queue.cc:237] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.122690  4586 catalog_manager.cc:5697] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 reported cstate change: term changed from 2 to 3, leader changed from 789afb67752345e2a6a132a5303ed77d (127.27.150.130) to 0a4658e811264329a2404b95e39f0841 (127.27.150.131). New cstate: current_term: 3 leader_uuid: "0a4658e811264329a2404b95e39f0841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:13.309826  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:13.427661  5141 raft_consensus.cc:993] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841: : Instructing follower 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:13.428400  5167 raft_consensus.cc:1081] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Signalling peer 789afb67752345e2a6a132a5303ed77d to start an election
I20260709 13:16:13.430167  4760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd"
dest_uuid: "789afb67752345e2a6a132a5303ed77d"
 from {username='slave'} at 127.0.0.1:50822
I20260709 13:16:13.430787  4760 raft_consensus.cc:493] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.431138  4760 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.438591  4760 raft_consensus.cc:515] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.440402  4760 leader_election.cc:290] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Requested vote from peers 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667), 0a4658e811264329a2404b95e39f0841 (127.27.150.131:35199)
I20260709 13:16:13.441345  5036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e5365d238c24ce69afea80c43ccdc11"
I20260709 13:16:13.441416  4837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b68f1dee43449788e3449cef20924dd" candidate_uuid: "789afb67752345e2a6a132a5303ed77d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a4658e811264329a2404b95e39f0841"
I20260709 13:16:13.442238  5036 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.442278  4837 raft_consensus.cc:3055] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:13.442776  4837 raft_consensus.cc:740] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a4658e811264329a2404b95e39f0841, State: Running, Role: LEADER
I20260709 13:16:13.443634  4837 consensus_queue.cc:260] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.444826  4837 raft_consensus.cc:3060] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.449429  5036 raft_consensus.cc:2468] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:13.450866  4726 leader_election.cc:304] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5365d238c24ce69afea80c43ccdc11, 789afb67752345e2a6a132a5303ed77d; no voters: 
I20260709 13:16:13.451299  4837 raft_consensus.cc:2468] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789afb67752345e2a6a132a5303ed77d in term 3.
I20260709 13:16:13.451771  5127 raft_consensus.cc:2804] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:13.452378  5127 raft_consensus.cc:697] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Becoming Leader. State: Replica: 789afb67752345e2a6a132a5303ed77d, State: Running, Role: LEADER
I20260709 13:16:13.453435  5127 consensus_queue.cc:237] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } }
I20260709 13:16:13.462056  4586 catalog_manager.cc:5697] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d reported cstate change: term changed from 2 to 3, leader changed from 0a4658e811264329a2404b95e39f0841 (127.27.150.131) to 789afb67752345e2a6a132a5303ed77d (127.27.150.130). New cstate: current_term: 3 leader_uuid: "789afb67752345e2a6a132a5303ed77d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.466039  5036 raft_consensus.cc:1275] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:13.467648  5167 consensus_queue.cc:1048] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.471683  4760 raft_consensus.cc:1275] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:13.473634  5167 consensus_queue.cc:1048] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.495164  4760 raft_consensus.cc:1275] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:13.497407  5141 consensus_queue.cc:1048] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789afb67752345e2a6a132a5303ed77d" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.509243  5037 raft_consensus.cc:1275] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Refusing update from remote peer 0a4658e811264329a2404b95e39f0841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:13.511768  5141 consensus_queue.cc:1048] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.869534  4837 raft_consensus.cc:1275] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:13.871264  5112 consensus_queue.cc:1048] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4658e811264329a2404b95e39f0841" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.881309  5037 raft_consensus.cc:1275] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Refusing update from remote peer 789afb67752345e2a6a132a5303ed77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:13.883574  5112 consensus_queue.cc:1048] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5365d238c24ce69afea80c43ccdc11" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.913694 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:13.951124 28250 tablet_server.cc:179] TabletServer@127.27.150.129:36667 shutting down...
W20260709 13:16:13.956331  4800 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 92 similar messages]
W20260709 13:16:13.960457  4800 consensus_peers.cc:597] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.986850 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:13.987841 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.989022 28250 raft_consensus.cc:2243] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.989632 28250 raft_consensus.cc:2272] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.992933 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.993619 28250 raft_consensus.cc:2243] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.994130 28250 raft_consensus.cc:2272] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 3e5365d238c24ce69afea80c43ccdc11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.996881 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.997493 28250 raft_consensus.cc:2243] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.997998 28250 raft_consensus.cc:2272] T 4e55a42b62e947aeb7c258b2aa3b18fc P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.000759 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:14.001477 28250 raft_consensus.cc:2243] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.001991 28250 raft_consensus.cc:2272] T 7d5224a3c0bd4a659ae972ff65c5e684 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.005519 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:14.006206 28250 raft_consensus.cc:2243] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.006769 28250 raft_consensus.cc:2272] T 793988d2aa5143f7842434dce61afd63 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.010087 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:14.010874 28250 raft_consensus.cc:2243] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.011417 28250 raft_consensus.cc:2272] T deaf2c93e50640fbbd8eadc6f7d888fe P 3e5365d238c24ce69afea80c43ccdc11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.014005 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:14.014732 28250 raft_consensus.cc:2243] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.015194 28250 raft_consensus.cc:2272] T 4e61e6caf18f4100baa32a98fdc83b55 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.018122 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:14.018844 28250 raft_consensus.cc:2243] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.019541 28250 raft_consensus.cc:2272] T ab63b0bc7e8c499c8128931be5f79716 P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.024529 28250 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:14.024577  4800 consensus_peers.cc:597] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.025365 28250 raft_consensus.cc:2243] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.026121 28250 raft_consensus.cc:2272] T 7206992a083644439f471e2f72695a02 P 3e5365d238c24ce69afea80c43ccdc11 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.029618 28250 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:14.030234 28250 raft_consensus.cc:2243] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.030732 28250 raft_consensus.cc:2272] T 5b68f1dee43449788e3449cef20924dd P 3e5365d238c24ce69afea80c43ccdc11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.071048 28250 tablet_server.cc:196] TabletServer@127.27.150.129:36667 shutdown complete.
W20260709 13:16:14.102573  4800 consensus_peers.cc:597] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 -> Peer 3e5365d238c24ce69afea80c43ccdc11 (127.27.150.129:36667): Couldn't send request to peer 3e5365d238c24ce69afea80c43ccdc11. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.108192 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
I20260709 13:16:14.144140 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:14.145052 28250 tablet_replica.cc:333] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.146277 28250 raft_consensus.cc:2243] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.147086 28250 raft_consensus.cc:2272] T 7206992a083644439f471e2f72695a02 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.150578 28250 tablet_replica.cc:333] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.151279 28250 raft_consensus.cc:2243] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.152354 28250 raft_consensus.cc:2272] T 5b68f1dee43449788e3449cef20924dd P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.155558 28250 tablet_replica.cc:333] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.156289 28250 raft_consensus.cc:2243] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.157308 28250 raft_consensus.cc:2272] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.160290 28250 tablet_replica.cc:333] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.160975 28250 raft_consensus.cc:2243] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.161510 28250 raft_consensus.cc:2272] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 789afb67752345e2a6a132a5303ed77d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.164155 28250 tablet_replica.cc:333] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.164824 28250 raft_consensus.cc:2243] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.165364 28250 raft_consensus.cc:2272] T 4e55a42b62e947aeb7c258b2aa3b18fc P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.167958 28250 tablet_replica.cc:333] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.168545 28250 raft_consensus.cc:2243] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.169128 28250 raft_consensus.cc:2272] T ab63b0bc7e8c499c8128931be5f79716 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.171454 28250 tablet_replica.cc:333] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.171988 28250 raft_consensus.cc:2243] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.172871 28250 raft_consensus.cc:2272] T 4e61e6caf18f4100baa32a98fdc83b55 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.175462 28250 tablet_replica.cc:333] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.175962 28250 raft_consensus.cc:2243] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.176909 28250 raft_consensus.cc:2272] T deaf2c93e50640fbbd8eadc6f7d888fe P 789afb67752345e2a6a132a5303ed77d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.179198 28250 tablet_replica.cc:333] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.179668 28250 raft_consensus.cc:2243] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.180080 28250 raft_consensus.cc:2272] T 793988d2aa5143f7842434dce61afd63 P 789afb67752345e2a6a132a5303ed77d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.182804 28250 tablet_replica.cc:333] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d: stopping tablet replica
I20260709 13:16:14.183415 28250 raft_consensus.cc:2243] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.183902 28250 raft_consensus.cc:2272] T 7d5224a3c0bd4a659ae972ff65c5e684 P 789afb67752345e2a6a132a5303ed77d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.217180 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
I20260709 13:16:14.253590 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
W20260709 13:16:14.266901  4803 consensus_peers.cc:597] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 -> Peer 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439): Couldn't send request to peer 789afb67752345e2a6a132a5303ed77d. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.291473 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:14.292464 28250 tablet_replica.cc:333] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.293490 28250 raft_consensus.cc:2243] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.294643 28250 raft_consensus.cc:2272] T 0763b4a0be1e4b9cbb4f4d4c1711e8cb P 0a4658e811264329a2404b95e39f0841 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.296525  4803 consensus_peers.cc:597] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 -> Peer 789afb67752345e2a6a132a5303ed77d (127.27.150.130:39439): Couldn't send request to peer 789afb67752345e2a6a132a5303ed77d. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:39439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.298194 28250 tablet_replica.cc:333] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.299044 28250 raft_consensus.cc:2243] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.299580 28250 raft_consensus.cc:2272] T deaf2c93e50640fbbd8eadc6f7d888fe P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.302212 28250 tablet_replica.cc:333] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.302977 28250 raft_consensus.cc:2243] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.303961 28250 raft_consensus.cc:2272] T 4e55a42b62e947aeb7c258b2aa3b18fc P 0a4658e811264329a2404b95e39f0841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.306694 28250 tablet_replica.cc:333] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.307319 28250 raft_consensus.cc:2243] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.307844 28250 raft_consensus.cc:2272] T 24dda9aa8ca24bf8a8cd76e37f29fac3 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.310222 28250 tablet_replica.cc:333] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.310871 28250 raft_consensus.cc:2243] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:16:14.311185  4634 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:14.311906 28250 raft_consensus.cc:2272] T 793988d2aa5143f7842434dce61afd63 P 0a4658e811264329a2404b95e39f0841 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.315796 28250 tablet_replica.cc:333] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.316550 28250 raft_consensus.cc:2243] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.317576 28250 raft_consensus.cc:2272] T 7d5224a3c0bd4a659ae972ff65c5e684 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.321151 28250 tablet_replica.cc:333] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.321836 28250 raft_consensus.cc:2243] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.322288 28250 raft_consensus.cc:2272] T 5b68f1dee43449788e3449cef20924dd P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.325604 28250 tablet_replica.cc:333] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.326238 28250 raft_consensus.cc:2243] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.327235 28250 raft_consensus.cc:2272] T 7206992a083644439f471e2f72695a02 P 0a4658e811264329a2404b95e39f0841 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.329878 28250 tablet_replica.cc:333] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.330426 28250 raft_consensus.cc:2243] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.330950 28250 raft_consensus.cc:2272] T 4e61e6caf18f4100baa32a98fdc83b55 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.333248 28250 tablet_replica.cc:333] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841: stopping tablet replica
I20260709 13:16:14.333752 28250 raft_consensus.cc:2243] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.334797 28250 raft_consensus.cc:2272] T ab63b0bc7e8c499c8128931be5f79716 P 0a4658e811264329a2404b95e39f0841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.372391 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
I20260709 13:16:14.404745 28250 master.cc:562] Master@127.27.150.190:42809 shutting down...
I20260709 13:16:14.435554 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.436372 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.436828 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P 28892534bff74cf5835669cf232d6c1d: stopping tablet replica
I20260709 13:16:14.464733 28250 master.cc:584] Master@127.27.150.190:42809 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13385 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:16:14.518011 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:38635
I20260709 13:16:14.519583 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:14.527086  5186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:14.527714  5185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:14.528102 28250 server_base.cc:1061] running on GCE node
W20260709 13:16:14.528050  5188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:14.529794 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:14.529986 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:14.530102 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602974530090 us; error 0 us; skew 500 ppm
I20260709 13:16:14.530704 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:14.533486 28250 webserver.cc:533] Webserver started at http://127.27.150.190:35727/ using document root <none> and password file <none>
I20260709 13:16:14.533993 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:14.534160 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:14.534416 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:14.535807 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "9141581abd8c48f4bf038328abeeea69"
format_stamp: "Formatted at 2026-07-09 13:16:14 on dist-test-slave-nvvq"
I20260709 13:16:14.540917 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:16:14.544934  5193 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:14.545745 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:14.546151 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "9141581abd8c48f4bf038328abeeea69"
format_stamp: "Formatted at 2026-07-09 13:16:14 on dist-test-slave-nvvq"
I20260709 13:16:14.546479 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:14.561681 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:14.563517 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:14.610351 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:38635
I20260709 13:16:14.610545  5244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:38635 every 8 connection(s)
I20260709 13:16:14.615041  5245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:14.629226  5245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69: Bootstrap starting.
I20260709 13:16:14.635315  5245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:14.640487  5245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69: No bootstrap required, opened a new log
I20260709 13:16:14.643338  5245 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9141581abd8c48f4bf038328abeeea69" member_type: VOTER }
I20260709 13:16:14.643784  5245 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:14.644044  5245 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9141581abd8c48f4bf038328abeeea69, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.644788  5245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9141581abd8c48f4bf038328abeeea69" member_type: VOTER }
I20260709 13:16:14.645337  5245 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:14.645579  5245 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:14.645882  5245 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:14.652249  5245 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9141581abd8c48f4bf038328abeeea69" member_type: VOTER }
I20260709 13:16:14.652834  5245 leader_election.cc:304] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9141581abd8c48f4bf038328abeeea69; no voters: 
I20260709 13:16:14.654215  5245 leader_election.cc:290] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:14.654711  5248 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:14.656332  5248 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 1 LEADER]: Becoming Leader. State: Replica: 9141581abd8c48f4bf038328abeeea69, State: Running, Role: LEADER
I20260709 13:16:14.657068  5248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9141581abd8c48f4bf038328abeeea69" member_type: VOTER }
I20260709 13:16:14.657707  5245 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:14.662313  5249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9141581abd8c48f4bf038328abeeea69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9141581abd8c48f4bf038328abeeea69" member_type: VOTER } }
I20260709 13:16:14.663733  5249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:14.663559  5250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9141581abd8c48f4bf038328abeeea69. Latest consensus state: current_term: 1 leader_uuid: "9141581abd8c48f4bf038328abeeea69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9141581abd8c48f4bf038328abeeea69" member_type: VOTER } }
I20260709 13:16:14.664721  5250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:14.668319  5255 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:14.674487  5255 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:14.677407 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:14.685099  5255 catalog_manager.cc:1383] Generated new cluster ID: f6add50f4ac74b33ad03686b9f55a72b
I20260709 13:16:14.685434  5255 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:14.710011  5255 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:14.711715  5255 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:14.725806  5255 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69: Generated new TSK 0
I20260709 13:16:14.726588  5255 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:14.744534 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:14.752172  5266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:14.753551  5267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:14.755604  5269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:14.756289 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:14.757550 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:14.757798 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:14.757982 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602974757962 us; error 0 us; skew 500 ppm
I20260709 13:16:14.758639 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:14.761273 28250 webserver.cc:533] Webserver started at http://127.27.150.129:40261/ using document root <none> and password file <none>
I20260709 13:16:14.761826 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:14.762059 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:14.762360 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:14.763827 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "e2ad74ee42004aa787e095361f8d1d59"
format_stamp: "Formatted at 2026-07-09 13:16:14 on dist-test-slave-nvvq"
I20260709 13:16:14.768975 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:16:14.772921  5274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:14.773705 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:14.774022 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "e2ad74ee42004aa787e095361f8d1d59"
format_stamp: "Formatted at 2026-07-09 13:16:14 on dist-test-slave-nvvq"
I20260709 13:16:14.774333 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:14.808008 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:14.809471 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:14.811349 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:14.813956 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:14.814210 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:14.814487 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:14.814688 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:14.865844 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:36887
I20260709 13:16:14.866045  5336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:36887 every 8 connection(s)
I20260709 13:16:14.872257 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:14.881014  5341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:14.882144  5342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:14.884776  5344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:14.885854 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:14.886976  5337 heartbeater.cc:344] Connected to a master server at 127.27.150.190:38635
I20260709 13:16:14.887458  5337 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:14.887712 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:14.887991 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:14.888175 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602974888140 us; error 0 us; skew 500 ppm
I20260709 13:16:14.888451  5337 heartbeater.cc:507] Master 127.27.150.190:38635 requested a full tablet report, sending...
I20260709 13:16:14.888972 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:14.891171  5210 ts_manager.cc:194] Registered new tserver with Master: e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887)
I20260709 13:16:14.892423 28250 webserver.cc:533] Webserver started at http://127.27.150.130:39719/ using document root <none> and password file <none>
I20260709 13:16:14.893051 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:14.893277 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:14.893563 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:14.893491  5210 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51416
I20260709 13:16:14.895509 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
format_stamp: "Formatted at 2026-07-09 13:16:14 on dist-test-slave-nvvq"
I20260709 13:16:14.900576 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:14.905159  5349 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:14.906090 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:16:14.906392 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
format_stamp: "Formatted at 2026-07-09 13:16:14 on dist-test-slave-nvvq"
I20260709 13:16:14.906765 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:14.923121 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:14.924566 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:14.926239 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:14.928834 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:14.929078 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:14.929332 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:14.929517 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:14.982583 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:43253
I20260709 13:16:14.982766  5411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:43253 every 8 connection(s)
I20260709 13:16:14.989497 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:14.997646  5415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:14.999185  5416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:15.003762 28250 server_base.cc:1061] running on GCE node
W20260709 13:16:15.004674  5418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:15.005227  5412 heartbeater.cc:344] Connected to a master server at 127.27.150.190:38635
I20260709 13:16:15.005864  5412 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:15.006186 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:15.006567 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:15.006799 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602975006778 us; error 0 us; skew 500 ppm
I20260709 13:16:15.007015  5412 heartbeater.cc:507] Master 127.27.150.190:38635 requested a full tablet report, sending...
I20260709 13:16:15.007730 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:15.010146  5210 ts_manager.cc:194] Registered new tserver with Master: 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253)
I20260709 13:16:15.010936 28250 webserver.cc:533] Webserver started at http://127.27.150.131:41491/ using document root <none> and password file <none>
I20260709 13:16:15.011586 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:15.011826 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:15.012135 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:15.012337  5210 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51418
I20260709 13:16:15.013839 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "66bddd0328874d198a2d35cac0054f5e"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-nvvq"
I20260709 13:16:15.019603 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:16:15.023361  5423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.024267 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:16:15.024618 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "66bddd0328874d198a2d35cac0054f5e"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-nvvq"
I20260709 13:16:15.024880 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:15.049338 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:15.050860 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:15.052364 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:15.055052 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:15.055284 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.055563 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:15.055810 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.106115 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:36561
I20260709 13:16:15.106231  5485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:36561 every 8 connection(s)
I20260709 13:16:15.123490  5486 heartbeater.cc:344] Connected to a master server at 127.27.150.190:38635
I20260709 13:16:15.124104  5486 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:15.125022  5486 heartbeater.cc:507] Master 127.27.150.190:38635 requested a full tablet report, sending...
I20260709 13:16:15.127525  5210 ts_manager.cc:194] Registered new tserver with Master: 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561)
I20260709 13:16:15.127744 28250 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017756477s
I20260709 13:16:15.129252  5210 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51430
I20260709 13:16:15.158105  5210 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51436:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:15.161110  5210 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:15.224444  5451 tablet_service.cc:1511] Processing CreateTablet for tablet 2149d37cac4f454eaefefb7475944ca2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=481ad490722a4f4cb77ed24c854ee6ef]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:15.224812  5376 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3f484165d8475c84f21b80c27c4c74 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=481ad490722a4f4cb77ed24c854ee6ef]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:15.224838  5377 tablet_service.cc:1511] Processing CreateTablet for tablet 2149d37cac4f454eaefefb7475944ca2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=481ad490722a4f4cb77ed24c854ee6ef]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:15.226341  5451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2149d37cac4f454eaefefb7475944ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.226368  5376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3f484165d8475c84f21b80c27c4c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.225052  5450 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3f484165d8475c84f21b80c27c4c74 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=481ad490722a4f4cb77ed24c854ee6ef]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:15.227900  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2149d37cac4f454eaefefb7475944ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.229961  5450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3f484165d8475c84f21b80c27c4c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.237651  5302 tablet_service.cc:1511] Processing CreateTablet for tablet 2149d37cac4f454eaefefb7475944ca2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=481ad490722a4f4cb77ed24c854ee6ef]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:15.239367  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2149d37cac4f454eaefefb7475944ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.243867  5301 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3f484165d8475c84f21b80c27c4c74 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=481ad490722a4f4cb77ed24c854ee6ef]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:15.245503  5301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3f484165d8475c84f21b80c27c4c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.258186  5501 tablet_bootstrap.cc:492] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16: Bootstrap starting.
I20260709 13:16:15.269002  5501 tablet_bootstrap.cc:654] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.270905  5502 tablet_bootstrap.cc:492] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: Bootstrap starting.
I20260709 13:16:15.281230  5503 tablet_bootstrap.cc:492] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59: Bootstrap starting.
I20260709 13:16:15.282617  5501 tablet_bootstrap.cc:492] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16: No bootstrap required, opened a new log
I20260709 13:16:15.283353  5501 ts_tablet_manager.cc:1403] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 13:16:15.285274  5502 tablet_bootstrap.cc:654] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.287118  5501 raft_consensus.cc:359] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.288045  5501 raft_consensus.cc:385] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.288475  5501 raft_consensus.cc:740] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d3e70ddf1d400fbbae6da5720c9b16, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.289501  5501 consensus_queue.cc:260] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.290036  5503 tablet_bootstrap.cc:654] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.291085  5502 tablet_bootstrap.cc:492] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: No bootstrap required, opened a new log
I20260709 13:16:15.291728  5502 ts_tablet_manager.cc:1403] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:16:15.292805  5412 heartbeater.cc:499] Master 127.27.150.190:38635 was elected leader, sending a full tablet report...
I20260709 13:16:15.293339  5501 ts_tablet_manager.cc:1434] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:16:15.294581  5501 tablet_bootstrap.cc:492] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16: Bootstrap starting.
I20260709 13:16:15.297504  5502 raft_consensus.cc:359] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.298324  5502 raft_consensus.cc:385] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.298754  5502 raft_consensus.cc:740] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.299621  5502 consensus_queue.cc:260] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.303990  5501 tablet_bootstrap.cc:654] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.305605  5503 tablet_bootstrap.cc:492] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59: No bootstrap required, opened a new log
I20260709 13:16:15.306344  5503 ts_tablet_manager.cc:1403] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.011s
I20260709 13:16:15.311271  5503 raft_consensus.cc:359] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.312314  5503 raft_consensus.cc:385] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.312697  5503 raft_consensus.cc:740] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.313767  5503 consensus_queue.cc:260] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.341691  5502 ts_tablet_manager.cc:1434] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: Time spent starting tablet: real 0.050s	user 0.026s	sys 0.020s
I20260709 13:16:15.342559  5486 heartbeater.cc:499] Master 127.27.150.190:38635 was elected leader, sending a full tablet report...
I20260709 13:16:15.343775  5502 tablet_bootstrap.cc:492] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e: Bootstrap starting.
I20260709 13:16:15.345237  5501 tablet_bootstrap.cc:492] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16: No bootstrap required, opened a new log
I20260709 13:16:15.345956  5501 ts_tablet_manager.cc:1403] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.024s
I20260709 13:16:15.347187  5337 heartbeater.cc:499] Master 127.27.150.190:38635 was elected leader, sending a full tablet report...
I20260709 13:16:15.347965  5503 ts_tablet_manager.cc:1434] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.002s
I20260709 13:16:15.351401  5501 raft_consensus.cc:359] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.352306  5501 raft_consensus.cc:385] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.352564  5501 raft_consensus.cc:740] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d3e70ddf1d400fbbae6da5720c9b16, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.353574  5501 consensus_queue.cc:260] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.354344  5502 tablet_bootstrap.cc:654] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.355963  5501 ts_tablet_manager.cc:1434] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:16:15.358335  5503 tablet_bootstrap.cc:492] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59: Bootstrap starting.
I20260709 13:16:15.367211  5503 tablet_bootstrap.cc:654] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.367835  5502 tablet_bootstrap.cc:492] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e: No bootstrap required, opened a new log
I20260709 13:16:15.368563  5502 ts_tablet_manager.cc:1403] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.016s
I20260709 13:16:15.372431  5502 raft_consensus.cc:359] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.373312  5502 raft_consensus.cc:385] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.373626  5502 raft_consensus.cc:740] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.374598  5502 consensus_queue.cc:260] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.376948  5502 ts_tablet_manager.cc:1434] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:15.377707  5503 tablet_bootstrap.cc:492] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59: No bootstrap required, opened a new log
I20260709 13:16:15.378262  5503 ts_tablet_manager.cc:1403] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 13:16:15.380906  5503 raft_consensus.cc:359] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.381477  5503 raft_consensus.cc:385] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.381742  5503 raft_consensus.cc:740] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.382560  5503 consensus_queue.cc:260] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.384548  5503 ts_tablet_manager.cc:1434] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:15.467329  5508 raft_consensus.cc:493] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.468140  5508 raft_consensus.cc:515] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.470881  5508 leader_election.cc:290] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253), e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887)
I20260709 13:16:15.481091  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" is_pre_election: true
I20260709 13:16:15.482313  5387 raft_consensus.cc:2468] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 0.
I20260709 13:16:15.483446  5510 raft_consensus.cc:493] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.483243  5312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2ad74ee42004aa787e095361f8d1d59" is_pre_election: true
I20260709 13:16:15.483857  5425 leader_election.cc:304] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, 84d3e70ddf1d400fbbae6da5720c9b16; no voters: 
I20260709 13:16:15.484268  5312 raft_consensus.cc:2468] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 0.
I20260709 13:16:15.484092  5510 raft_consensus.cc:515] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.485056  5508 raft_consensus.cc:2804] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:15.485438  5508 raft_consensus.cc:493] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.485843  5508 raft_consensus.cc:3060] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.487253  5510 leader_election.cc:290] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253), 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561)
I20260709 13:16:15.498696  5508 raft_consensus.cc:515] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.502094  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" is_pre_election: true
I20260709 13:16:15.502581  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66bddd0328874d198a2d35cac0054f5e" is_pre_election: true
I20260709 13:16:15.503060  5387 raft_consensus.cc:2468] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 0.
I20260709 13:16:15.503489  5461 raft_consensus.cc:2468] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 0.
I20260709 13:16:15.503612  5508 leader_election.cc:290] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 election: Requested vote from peers 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253), e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887)
I20260709 13:16:15.504909  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
I20260709 13:16:15.505034  5275 leader_election.cc:304] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, e2ad74ee42004aa787e095361f8d1d59; no voters: 
I20260709 13:16:15.505208  5312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
I20260709 13:16:15.505645  5387 raft_consensus.cc:3060] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.505873  5312 raft_consensus.cc:3060] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.506582  5510 raft_consensus.cc:2804] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:15.506987  5510 raft_consensus.cc:493] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.507296  5510 raft_consensus.cc:3060] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.514689  5510 raft_consensus.cc:515] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.515395  5312 raft_consensus.cc:2468] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 1.
I20260709 13:16:15.515395  5387 raft_consensus.cc:2468] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 1.
I20260709 13:16:15.517289  5510 leader_election.cc:290] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 election: Requested vote from peers 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253), 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561)
I20260709 13:16:15.517246  5425 leader_election.cc:304] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, 84d3e70ddf1d400fbbae6da5720c9b16; no voters: 
I20260709 13:16:15.517856  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
I20260709 13:16:15.518344  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
I20260709 13:16:15.518671  5387 raft_consensus.cc:3060] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.518764  5508 raft_consensus.cc:2804] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:15.519057  5461 raft_consensus.cc:3060] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.520370  5508 raft_consensus.cc:697] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Becoming Leader. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Running, Role: LEADER
I20260709 13:16:15.521342  5508 consensus_queue.cc:237] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:15.527089  5387 raft_consensus.cc:2468] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 1.
I20260709 13:16:15.528496  5276 leader_election.cc:304] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d3e70ddf1d400fbbae6da5720c9b16, e2ad74ee42004aa787e095361f8d1d59; no voters: 
I20260709 13:16:15.529414  5510 raft_consensus.cc:2804] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:15.530473  5461 raft_consensus.cc:2468] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 1.
I20260709 13:16:15.530952  5510 raft_consensus.cc:697] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 LEADER]: Becoming Leader. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Running, Role: LEADER
I20260709 13:16:15.532662  5510 consensus_queue.cc:237] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.532595  5208 catalog_manager.cc:5697] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 66bddd0328874d198a2d35cac0054f5e (127.27.150.131). New cstate: current_term: 1 leader_uuid: "66bddd0328874d198a2d35cac0054f5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.541882  5210 catalog_manager.cc:5697] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "e2ad74ee42004aa787e095361f8d1d59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.581081  5210 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51438:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:15.583626  5210 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:15.611280  5301 tablet_service.cc:1511] Processing CreateTablet for tablet 15ec62e9a45146d79bf4b19003c6bdac (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1cc1b459af134e2abd711943dff5ff66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:15.612881  5301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ec62e9a45146d79bf4b19003c6bdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.612516  5376 tablet_service.cc:1511] Processing CreateTablet for tablet 15ec62e9a45146d79bf4b19003c6bdac (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1cc1b459af134e2abd711943dff5ff66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:15.614105  5376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ec62e9a45146d79bf4b19003c6bdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.614768  5451 tablet_service.cc:1511] Processing CreateTablet for tablet 15ec62e9a45146d79bf4b19003c6bdac (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1cc1b459af134e2abd711943dff5ff66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:15.616135  5451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ec62e9a45146d79bf4b19003c6bdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.620095  5450 tablet_service.cc:1511] Processing CreateTablet for tablet b8f51de1a7ec4398a70aef055a23316f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1cc1b459af134e2abd711943dff5ff66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:15.620584  5377 tablet_service.cc:1511] Processing CreateTablet for tablet b8f51de1a7ec4398a70aef055a23316f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1cc1b459af134e2abd711943dff5ff66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:15.621603  5450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f51de1a7ec4398a70aef055a23316f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.621946  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f51de1a7ec4398a70aef055a23316f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.625639  5302 tablet_service.cc:1511] Processing CreateTablet for tablet b8f51de1a7ec4398a70aef055a23316f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1cc1b459af134e2abd711943dff5ff66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:15.627043  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f51de1a7ec4398a70aef055a23316f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.633333  5503 tablet_bootstrap.cc:492] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59: Bootstrap starting.
I20260709 13:16:15.640744  5503 tablet_bootstrap.cc:654] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.651419  5501 tablet_bootstrap.cc:492] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: Bootstrap starting.
I20260709 13:16:15.657796  5503 tablet_bootstrap.cc:492] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59: No bootstrap required, opened a new log
I20260709 13:16:15.658684  5503 ts_tablet_manager.cc:1403] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:16:15.659233  5501 tablet_bootstrap.cc:654] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.664505  5502 tablet_bootstrap.cc:492] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e: Bootstrap starting.
I20260709 13:16:15.664690  5503 raft_consensus.cc:359] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.665578  5503 raft_consensus.cc:385] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.665882  5503 raft_consensus.cc:740] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.667104  5503 consensus_queue.cc:260] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
W20260709 13:16:15.671768  5258 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:15.669739  5503 ts_tablet_manager.cc:1434] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:16:15.673400  5503 tablet_bootstrap.cc:492] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59: Bootstrap starting.
I20260709 13:16:15.675238  5502 tablet_bootstrap.cc:654] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.679113  5501 tablet_bootstrap.cc:492] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: No bootstrap required, opened a new log
I20260709 13:16:15.679893  5501 ts_tablet_manager.cc:1403] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.005s
I20260709 13:16:15.683658  5503 tablet_bootstrap.cc:654] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.684423  5501 raft_consensus.cc:359] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.685613  5501 raft_consensus.cc:385] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.685998  5501 raft_consensus.cc:740] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d3e70ddf1d400fbbae6da5720c9b16, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.689616  5501 consensus_queue.cc:260] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.693033  5502 tablet_bootstrap.cc:492] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e: No bootstrap required, opened a new log
I20260709 13:16:15.693992  5502 ts_tablet_manager.cc:1403] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.005s
I20260709 13:16:15.694095  5501 ts_tablet_manager.cc:1434] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:16:15.695283  5503 tablet_bootstrap.cc:492] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59: No bootstrap required, opened a new log
I20260709 13:16:15.695473  5501 tablet_bootstrap.cc:492] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16: Bootstrap starting.
I20260709 13:16:15.695873  5503 ts_tablet_manager.cc:1403] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:16:15.699154  5502 raft_consensus.cc:359] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.700021  5502 raft_consensus.cc:385] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.700554  5502 raft_consensus.cc:740] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.701869  5502 consensus_queue.cc:260] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.702419  5503 raft_consensus.cc:359] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.703576  5503 raft_consensus.cc:385] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.703889  5501 tablet_bootstrap.cc:654] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.703931  5503 raft_consensus.cc:740] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.709271  5502 ts_tablet_manager.cc:1434] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:16:15.711032  5502 tablet_bootstrap.cc:492] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e: Bootstrap starting.
I20260709 13:16:15.722324  5502 tablet_bootstrap.cc:654] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.722486  5503 consensus_queue.cc:260] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.723625  5501 tablet_bootstrap.cc:492] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16: No bootstrap required, opened a new log
I20260709 13:16:15.724355  5501 ts_tablet_manager.cc:1403] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260709 13:16:15.728629  5502 tablet_bootstrap.cc:492] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e: No bootstrap required, opened a new log
I20260709 13:16:15.728186  5501 raft_consensus.cc:359] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.729390  5502 ts_tablet_manager.cc:1403] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:16:15.729840  5501 raft_consensus.cc:385] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.730091  5503 ts_tablet_manager.cc:1434] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:16:15.730276  5501 raft_consensus.cc:740] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d3e70ddf1d400fbbae6da5720c9b16, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.731417  5501 consensus_queue.cc:260] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.734392  5501 ts_tablet_manager.cc:1434] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:16:15.734699  5502 raft_consensus.cc:359] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.735518  5502 raft_consensus.cc:385] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.735832  5502 raft_consensus.cc:740] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.736728  5502 consensus_queue.cc:260] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.739528  5502 ts_tablet_manager.cc:1434] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:16:15.786202  5508 raft_consensus.cc:493] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.787184  5508 raft_consensus.cc:515] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.789853  5508 leader_election.cc:290] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887), 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253)
I20260709 13:16:15.791436  5312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2ad74ee42004aa787e095361f8d1d59" is_pre_election: true
I20260709 13:16:15.791975  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" is_pre_election: true
I20260709 13:16:15.792366  5312 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 0.
I20260709 13:16:15.792778  5387 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 0.
I20260709 13:16:15.794046  5425 leader_election.cc:304] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, 84d3e70ddf1d400fbbae6da5720c9b16; no voters: 
I20260709 13:16:15.795091  5508 raft_consensus.cc:2804] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:15.795445  5508 raft_consensus.cc:493] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.795760  5508 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.803180  5508 raft_consensus.cc:515] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.806136  5312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
I20260709 13:16:15.805258  5508 leader_election.cc:290] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 election: Requested vote from peers e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887), 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253)
I20260709 13:16:15.806998  5312 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.807353  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
I20260709 13:16:15.807968  5387 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.813994  5312 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 1.
I20260709 13:16:15.814499  5387 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 1.
I20260709 13:16:15.815351  5425 leader_election.cc:304] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, e2ad74ee42004aa787e095361f8d1d59; no voters: 
I20260709 13:16:15.816298  5508 raft_consensus.cc:2804] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:15.816758  5508 raft_consensus.cc:697] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Becoming Leader. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Running, Role: LEADER
I20260709 13:16:15.817692  5508 consensus_queue.cc:237] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.825603  5209 catalog_manager.cc:5697] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 66bddd0328874d198a2d35cac0054f5e (127.27.150.131). New cstate: current_term: 1 leader_uuid: "66bddd0328874d198a2d35cac0054f5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:15.925205  5510 raft_consensus.cc:493] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.926055  5510 raft_consensus.cc:515] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.928637  5510 leader_election.cc:290] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253), 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561)
I20260709 13:16:15.929627  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f51de1a7ec4398a70aef055a23316f" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" is_pre_election: true
I20260709 13:16:15.929924  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f51de1a7ec4398a70aef055a23316f" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66bddd0328874d198a2d35cac0054f5e" is_pre_election: true
I20260709 13:16:15.930423  5387 raft_consensus.cc:2468] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 0.
I20260709 13:16:15.930696  5461 raft_consensus.cc:2468] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 0.
I20260709 13:16:15.931658  5276 leader_election.cc:304] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d3e70ddf1d400fbbae6da5720c9b16, e2ad74ee42004aa787e095361f8d1d59; no voters: 
I20260709 13:16:15.932511  5510 raft_consensus.cc:2804] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:15.932857  5510 raft_consensus.cc:493] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.933167  5510 raft_consensus.cc:3060] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.940027  5510 raft_consensus.cc:515] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.941888  5510 leader_election.cc:290] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 election: Requested vote from peers 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253), 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561)
I20260709 13:16:15.943081  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f51de1a7ec4398a70aef055a23316f" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
I20260709 13:16:15.943089  5387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f51de1a7ec4398a70aef055a23316f" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
I20260709 13:16:15.943866  5461 raft_consensus.cc:3060] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.944049  5387 raft_consensus.cc:3060] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.946528  5508 consensus_queue.cc:1048] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:15.950981  5510 consensus_queue.cc:1048] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:15.952296  5461 raft_consensus.cc:2468] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 1.
I20260709 13:16:15.953675  5275 leader_election.cc:304] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, e2ad74ee42004aa787e095361f8d1d59; no voters: 
I20260709 13:16:15.954752  5518 raft_consensus.cc:2804] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:15.963371  5387 raft_consensus.cc:2468] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 1.
I20260709 13:16:15.966161  5518 raft_consensus.cc:697] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 1 LEADER]: Becoming Leader. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Running, Role: LEADER
I20260709 13:16:15.967360  5518 consensus_queue.cc:237] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:15.991899  5508 consensus_queue.cc:1048] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:15.999850  5207 catalog_manager.cc:5697] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "e2ad74ee42004aa787e095361f8d1d59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.003145  5533 consensus_queue.cc:1048] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:16.048051  5461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2"
dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
mode: GRACEFUL
new_leader_uuid: "e2ad74ee42004aa787e095361f8d1d59"
 from {username='slave'} at 127.0.0.1:57848
I20260709 13:16:16.048703  5461 raft_consensus.cc:606] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Received request to transfer leadership to TS e2ad74ee42004aa787e095361f8d1d59
I20260709 13:16:16.064075  5312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74"
dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
mode: GRACEFUL
new_leader_uuid: "66bddd0328874d198a2d35cac0054f5e"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:16:16.064786  5312 raft_consensus.cc:606] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 LEADER]: Received request to transfer leadership to TS 66bddd0328874d198a2d35cac0054f5e
I20260709 13:16:16.071537  5461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac"
dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
mode: GRACEFUL
new_leader_uuid: "e2ad74ee42004aa787e095361f8d1d59"
 from {username='slave'} at 127.0.0.1:57848
I20260709 13:16:16.072378  5461 raft_consensus.cc:606] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Received request to transfer leadership to TS e2ad74ee42004aa787e095361f8d1d59
I20260709 13:16:16.328042  5508 consensus_queue.cc:1048] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:16.329222  5516 consensus_queue.cc:1048] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:16.338349  5547 raft_consensus.cc:993] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e: : Instructing follower e2ad74ee42004aa787e095361f8d1d59 to start an election
I20260709 13:16:16.339130  5516 raft_consensus.cc:1081] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Signalling peer e2ad74ee42004aa787e095361f8d1d59 to start an election
I20260709 13:16:16.341859  5311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac"
dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
 from {username='slave'} at 127.0.0.1:44072
I20260709 13:16:16.342588  5311 raft_consensus.cc:493] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:16.343029  5311 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.352461  5311 raft_consensus.cc:515] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.355428  5311 leader_election.cc:290] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 2 election: Requested vote from peers 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253), 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561)
I20260709 13:16:16.357100  5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
I20260709 13:16:16.358028  5385 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.361268  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
I20260709 13:16:16.362037  5461 raft_consensus.cc:3055] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:16.362406  5461 raft_consensus.cc:740] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Running, Role: LEADER
I20260709 13:16:16.363909  5461 consensus_queue.cc:260] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.366052  5461 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.372674  5385 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 2.
I20260709 13:16:16.374097  5276 leader_election.cc:304] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d3e70ddf1d400fbbae6da5720c9b16, e2ad74ee42004aa787e095361f8d1d59; no voters: 
I20260709 13:16:16.375095  5533 raft_consensus.cc:2804] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:16.375629  5533 raft_consensus.cc:697] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 LEADER]: Becoming Leader. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Running, Role: LEADER
I20260709 13:16:16.376345  5461 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 2.
I20260709 13:16:16.376607  5533 consensus_queue.cc:237] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.385329  5207 catalog_manager.cc:5697] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 reported cstate change: term changed from 1 to 2, leader changed from 66bddd0328874d198a2d35cac0054f5e (127.27.150.131) to e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e2ad74ee42004aa787e095361f8d1d59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.405239  5533 consensus_queue.cc:1048] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:16.426702  5518 consensus_queue.cc:1048] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:16.426882  5547 raft_consensus.cc:993] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e: : Instructing follower e2ad74ee42004aa787e095361f8d1d59 to start an election
I20260709 13:16:16.427960  5516 raft_consensus.cc:1081] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Signalling peer e2ad74ee42004aa787e095361f8d1d59 to start an election
I20260709 13:16:16.429956  5311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2"
dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
 from {username='slave'} at 127.0.0.1:44072
I20260709 13:16:16.430656  5311 raft_consensus.cc:493] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:16.431073  5311 raft_consensus.cc:3060] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.439291  5311 raft_consensus.cc:515] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:16.441681  5311 leader_election.cc:290] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 2 election: Requested vote from peers 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561), 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253)
I20260709 13:16:16.443055  5385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
I20260709 13:16:16.443077  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2149d37cac4f454eaefefb7475944ca2" candidate_uuid: "e2ad74ee42004aa787e095361f8d1d59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
I20260709 13:16:16.443836  5385 raft_consensus.cc:3060] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.444015  5461 raft_consensus.cc:3055] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:16.444494  5461 raft_consensus.cc:740] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Running, Role: LEADER
I20260709 13:16:16.445518  5461 consensus_queue.cc:260] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:16.447110  5461 raft_consensus.cc:3060] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.451411  5385 raft_consensus.cc:2468] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 2.
I20260709 13:16:16.452572  5386 raft_consensus.cc:1240] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Rejecting Update request from peer 66bddd0328874d198a2d35cac0054f5e for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:16.452634  5276 leader_election.cc:304] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d3e70ddf1d400fbbae6da5720c9b16, e2ad74ee42004aa787e095361f8d1d59; no voters: 
I20260709 13:16:16.453671  5518 raft_consensus.cc:2804] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:16.454252  5518 raft_consensus.cc:697] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 2 LEADER]: Becoming Leader. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Running, Role: LEADER
I20260709 13:16:16.455336  5518 consensus_queue.cc:237] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } }
I20260709 13:16:16.456549  5461 raft_consensus.cc:2468] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ad74ee42004aa787e095361f8d1d59 in term 2.
I20260709 13:16:16.462570  5207 catalog_manager.cc:5697] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 reported cstate change: term changed from 1 to 2, leader changed from 66bddd0328874d198a2d35cac0054f5e (127.27.150.131) to e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "e2ad74ee42004aa787e095361f8d1d59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:16.513036  5550 raft_consensus.cc:993] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59: : Instructing follower 66bddd0328874d198a2d35cac0054f5e to start an election
I20260709 13:16:16.513644  5518 raft_consensus.cc:1081] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 LEADER]: Signalling peer 66bddd0328874d198a2d35cac0054f5e to start an election
I20260709 13:16:16.515621  5461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74"
dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
 from {username='slave'} at 127.0.0.1:57842
I20260709 13:16:16.516314  5461 raft_consensus.cc:493] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:16.516705  5461 raft_consensus.cc:3060] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.525063  5461 raft_consensus.cc:515] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.527302  5461 leader_election.cc:290] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 2 election: Requested vote from peers e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887), 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253)
I20260709 13:16:16.528031  5311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
I20260709 13:16:16.528496  5386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3f484165d8475c84f21b80c27c4c74" candidate_uuid: "66bddd0328874d198a2d35cac0054f5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
I20260709 13:16:16.528924  5311 raft_consensus.cc:3055] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:16.529266  5386 raft_consensus.cc:3060] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.529337  5311 raft_consensus.cc:740] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Running, Role: LEADER
I20260709 13:16:16.530508  5311 consensus_queue.cc:260] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.531854  5311 raft_consensus.cc:3060] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.537933  5386 raft_consensus.cc:2468] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 2.
I20260709 13:16:16.539146  5311 raft_consensus.cc:2468] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66bddd0328874d198a2d35cac0054f5e in term 2.
I20260709 13:16:16.539317  5425 leader_election.cc:304] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, 84d3e70ddf1d400fbbae6da5720c9b16; no voters: 
I20260709 13:16:16.540331  5516 raft_consensus.cc:2804] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:16.540758  5516 raft_consensus.cc:697] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 2 LEADER]: Becoming Leader. State: Replica: 66bddd0328874d198a2d35cac0054f5e, State: Running, Role: LEADER
I20260709 13:16:16.541507  5516 consensus_queue.cc:237] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.548254  5209 catalog_manager.cc:5697] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e reported cstate change: term changed from 1 to 2, leader changed from e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129) to 66bddd0328874d198a2d35cac0054f5e (127.27.150.131). New cstate: current_term: 2 leader_uuid: "66bddd0328874d198a2d35cac0054f5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:16.815630 28250 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:16:16.817416 28250 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:16:16.817874 28250 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:16:16.831014  5311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac"
dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
mode: GRACEFUL
new_leader_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:16:16.831683  5311 raft_consensus.cc:606] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 LEADER]: Received request to transfer leadership to TS 84d3e70ddf1d400fbbae6da5720c9b16
I20260709 13:16:16.832942 28250 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:16:16.849637  5386 raft_consensus.cc:1275] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Refusing update from remote peer e2ad74ee42004aa787e095361f8d1d59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:16.851317  5518 consensus_queue.cc:1048] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.857365  5550 raft_consensus.cc:993] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59: : Instructing follower 84d3e70ddf1d400fbbae6da5720c9b16 to start an election
I20260709 13:16:16.857873  5550 raft_consensus.cc:1081] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 LEADER]: Signalling peer 84d3e70ddf1d400fbbae6da5720c9b16 to start an election
I20260709 13:16:16.860615  5385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac"
dest_uuid: "84d3e70ddf1d400fbbae6da5720c9b16"
 from {username='slave'} at 127.0.0.1:35602
I20260709 13:16:16.861318  5385 raft_consensus.cc:493] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:16.861701  5385 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.864048  5461 raft_consensus.cc:1275] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Refusing update from remote peer e2ad74ee42004aa787e095361f8d1d59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:16.865790  5550 consensus_queue.cc:1048] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.871914  5385 raft_consensus.cc:515] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.878510  5386 raft_consensus.cc:1240] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 FOLLOWER]: Rejecting Update request from peer e2ad74ee42004aa787e095361f8d1d59 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:16.882170  5550 consensus_queue.cc:1059] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.883080  5550 raft_consensus.cc:3055] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:16.883396  5550 raft_consensus.cc:740] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2ad74ee42004aa787e095361f8d1d59, State: Running, Role: LEADER
I20260709 13:16:16.884289  5550 consensus_queue.cc:260] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.885284  5550 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.894188  5385 leader_election.cc:290] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [CANDIDATE]: Term 3 election: Requested vote from peers e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887), 66bddd0328874d198a2d35cac0054f5e (127.27.150.131:36561)
I20260709 13:16:16.894467  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66bddd0328874d198a2d35cac0054f5e"
I20260709 13:16:16.895169  5461 raft_consensus.cc:3060] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.896312  5311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec62e9a45146d79bf4b19003c6bdac" candidate_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2ad74ee42004aa787e095361f8d1d59"
I20260709 13:16:16.903160  5461 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d3e70ddf1d400fbbae6da5720c9b16 in term 3.
I20260709 13:16:16.904753  5350 leader_election.cc:304] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66bddd0328874d198a2d35cac0054f5e, 84d3e70ddf1d400fbbae6da5720c9b16; no voters: 
I20260709 13:16:16.905917  5506 raft_consensus.cc:2804] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:16.906880  5311 raft_consensus.cc:2468] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d3e70ddf1d400fbbae6da5720c9b16 in term 3.
I20260709 13:16:16.914151  5506 raft_consensus.cc:697] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 LEADER]: Becoming Leader. State: Replica: 84d3e70ddf1d400fbbae6da5720c9b16, State: Running, Role: LEADER
I20260709 13:16:16.915313  5506 consensus_queue.cc:237] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } }
I20260709 13:16:16.918251  5385 raft_consensus.cc:1275] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Refusing update from remote peer e2ad74ee42004aa787e095361f8d1d59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:16.920189  5550 consensus_queue.cc:1048] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.924769  5207 catalog_manager.cc:5697] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 reported cstate change: term changed from 2 to 3, leader changed from e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129) to 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130). New cstate: current_term: 3 leader_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ad74ee42004aa787e095361f8d1d59" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d3e70ddf1d400fbbae6da5720c9b16" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 43253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.930603  5461 raft_consensus.cc:1275] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Refusing update from remote peer e2ad74ee42004aa787e095361f8d1d59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:16.932243  5550 consensus_queue.cc:1048] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66bddd0328874d198a2d35cac0054f5e" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.964679 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
I20260709 13:16:16.997519 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:16.998315 28250 tablet_replica.cc:333] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59: stopping tablet replica
I20260709 13:16:16.999296 28250 raft_consensus.cc:2243] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.000290 28250 raft_consensus.cc:2272] T b8f51de1a7ec4398a70aef055a23316f P e2ad74ee42004aa787e095361f8d1d59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.003100 28250 tablet_replica.cc:333] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59: stopping tablet replica
I20260709 13:16:17.003690 28250 raft_consensus.cc:2243] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.004155 28250 raft_consensus.cc:2272] T 15ec62e9a45146d79bf4b19003c6bdac P e2ad74ee42004aa787e095361f8d1d59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.006850 28250 tablet_replica.cc:333] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59: stopping tablet replica
I20260709 13:16:17.007452 28250 raft_consensus.cc:2243] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.008463 28250 raft_consensus.cc:2272] T 2149d37cac4f454eaefefb7475944ca2 P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.011047 28250 tablet_replica.cc:333] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59: stopping tablet replica
I20260709 13:16:17.011598 28250 raft_consensus.cc:2243] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.012030 28250 raft_consensus.cc:2272] T 6f3f484165d8475c84f21b80c27c4c74 P e2ad74ee42004aa787e095361f8d1d59 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:17.031265  5425 consensus_peers.cc:597] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e -> Peer e2ad74ee42004aa787e095361f8d1d59 (127.27.150.129:36887): Couldn't send request to peer e2ad74ee42004aa787e095361f8d1d59. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:17.037863 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
I20260709 13:16:17.055444 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
I20260709 13:16:17.078130 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:17.078997 28250 tablet_replica.cc:333] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16: stopping tablet replica
I20260709 13:16:17.079958 28250 raft_consensus.cc:2243] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.080475 28250 raft_consensus.cc:2272] T b8f51de1a7ec4398a70aef055a23316f P 84d3e70ddf1d400fbbae6da5720c9b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.083305 28250 tablet_replica.cc:333] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: stopping tablet replica
I20260709 13:16:17.083922 28250 raft_consensus.cc:2243] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.084890 28250 pending_rounds.cc:70] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: Trying to abort 2 pending ops.
I20260709 13:16:17.085155 28250 pending_rounds.cc:77] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637793454817280 op_type: NO_OP noop_request { }
I20260709 13:16:17.085542 28250 raft_consensus.cc:2889] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:17.085846 28250 pending_rounds.cc:77] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637791254437888 op_type: NO_OP noop_request { }
I20260709 13:16:17.086184 28250 raft_consensus.cc:2889] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:17.086584 28250 raft_consensus.cc:2272] T 15ec62e9a45146d79bf4b19003c6bdac P 84d3e70ddf1d400fbbae6da5720c9b16 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:17.088928  5425 consensus_peers.cc:597] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e -> Peer 84d3e70ddf1d400fbbae6da5720c9b16 (127.27.150.130:43253): Couldn't send request to peer 84d3e70ddf1d400fbbae6da5720c9b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:17.089774 28250 tablet_replica.cc:333] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16: stopping tablet replica
I20260709 13:16:17.090492 28250 raft_consensus.cc:2243] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.090926 28250 raft_consensus.cc:2272] T 2149d37cac4f454eaefefb7475944ca2 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.093593 28250 tablet_replica.cc:333] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16: stopping tablet replica
I20260709 13:16:17.094105 28250 raft_consensus.cc:2243] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.094611 28250 raft_consensus.cc:2272] T 6f3f484165d8475c84f21b80c27c4c74 P 84d3e70ddf1d400fbbae6da5720c9b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.120085 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
I20260709 13:16:17.137769 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
I20260709 13:16:17.163080 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:17.163877 28250 tablet_replica.cc:333] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e: stopping tablet replica
I20260709 13:16:17.164652 28250 raft_consensus.cc:2243] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.165239 28250 raft_consensus.cc:2272] T b8f51de1a7ec4398a70aef055a23316f P 66bddd0328874d198a2d35cac0054f5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.168177 28250 tablet_replica.cc:333] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e: stopping tablet replica
I20260709 13:16:17.168826 28250 raft_consensus.cc:2243] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.169325 28250 raft_consensus.cc:2272] T 15ec62e9a45146d79bf4b19003c6bdac P 66bddd0328874d198a2d35cac0054f5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.172462 28250 tablet_replica.cc:333] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e: stopping tablet replica
I20260709 13:16:17.173055 28250 raft_consensus.cc:2243] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.173529 28250 raft_consensus.cc:2272] T 2149d37cac4f454eaefefb7475944ca2 P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.176299 28250 tablet_replica.cc:333] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: stopping tablet replica
I20260709 13:16:17.176857 28250 raft_consensus.cc:2243] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.177788 28250 pending_rounds.cc:70] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: Trying to abort 1 pending ops.
I20260709 13:16:17.178002 28250 pending_rounds.cc:77] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637791921823744 op_type: NO_OP noop_request { }
I20260709 13:16:17.178321 28250 raft_consensus.cc:2889] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:17.178681 28250 raft_consensus.cc:2272] T 6f3f484165d8475c84f21b80c27c4c74 P 66bddd0328874d198a2d35cac0054f5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.205294 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
I20260709 13:16:17.223162 28250 master.cc:562] Master@127.27.150.190:38635 shutting down...
I20260709 13:16:17.242566 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.243261 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.243595 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9141581abd8c48f4bf038328abeeea69: stopping tablet replica
I20260709 13:16:17.264050 28250 master.cc:584] Master@127.27.150.190:38635 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2782 ms)
[----------] 6 tests from LeaderRebalancerTest (308005 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:16:17.300165 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:42597
I20260709 13:16:17.301568 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:17.307888  5562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:17.308786  5561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:17.309592  5564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:17.310297 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:17.311637 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:17.311837 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:17.312028 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602977311996 us; error 0 us; skew 500 ppm
I20260709 13:16:17.312614 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:17.315351 28250 webserver.cc:533] Webserver started at http://127.27.150.190:35777/ using document root <none> and password file <none>
I20260709 13:16:17.315896 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:17.316118 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:17.316401 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:17.317655 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "329f80056fe8496d9b7dfcc3a2a84b5a"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.322674 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:16:17.326660  5569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.327507 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:17.327867 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "329f80056fe8496d9b7dfcc3a2a84b5a"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.328202 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:17.353578 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:17.355031 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:17.399958 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:42597
I20260709 13:16:17.400115  5620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:42597 every 8 connection(s)
I20260709 13:16:17.404825  5621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:17.417850  5621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a: Bootstrap starting.
I20260709 13:16:17.423204  5621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:17.427829  5621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a: No bootstrap required, opened a new log
I20260709 13:16:17.430421  5621 raft_consensus.cc:359] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" member_type: VOTER }
I20260709 13:16:17.430883  5621 raft_consensus.cc:385] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:17.431083  5621 raft_consensus.cc:740] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329f80056fe8496d9b7dfcc3a2a84b5a, State: Initialized, Role: FOLLOWER
I20260709 13:16:17.431717  5621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" member_type: VOTER }
I20260709 13:16:17.432217  5621 raft_consensus.cc:399] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:17.432418  5621 raft_consensus.cc:493] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:17.432657  5621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.438490  5621 raft_consensus.cc:515] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" member_type: VOTER }
I20260709 13:16:17.439070  5621 leader_election.cc:304] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 329f80056fe8496d9b7dfcc3a2a84b5a; no voters: 
I20260709 13:16:17.440347  5621 leader_election.cc:290] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:17.440799  5624 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:17.442414  5624 raft_consensus.cc:697] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 1 LEADER]: Becoming Leader. State: Replica: 329f80056fe8496d9b7dfcc3a2a84b5a, State: Running, Role: LEADER
I20260709 13:16:17.443243  5624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" member_type: VOTER }
I20260709 13:16:17.443728  5621 sys_catalog.cc:565] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:17.446521  5625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" member_type: VOTER } }
I20260709 13:16:17.446560  5626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 329f80056fe8496d9b7dfcc3a2a84b5a. Latest consensus state: current_term: 1 leader_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329f80056fe8496d9b7dfcc3a2a84b5a" member_type: VOTER } }
I20260709 13:16:17.447443  5625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:17.447535  5626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:17.451601  5629 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:17.458979  5629 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:17.460284 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:17.469493  5629 catalog_manager.cc:1383] Generated new cluster ID: d137daee74264abc913b78a8f7c17986
I20260709 13:16:17.469771  5629 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:17.486121  5629 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:17.487754  5629 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:17.504176  5629 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a: Generated new TSK 0
I20260709 13:16:17.504936  5629 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:17.527474 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:17.535252  5642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:17.536698  5643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:17.538329  5645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:17.538774 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:17.540015 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:17.540259 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:17.540445 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602977540424 us; error 0 us; skew 500 ppm
I20260709 13:16:17.541054 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:17.543836 28250 webserver.cc:533] Webserver started at http://127.27.150.129:41645/ using document root <none> and password file <none>
I20260709 13:16:17.544384 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:17.544610 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:17.544960 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:17.546386 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "5a7401e4a5d24132baf8d796e2662d36"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.551419 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:16:17.555645  5650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.556615 28250 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:17.556937 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "5a7401e4a5d24132baf8d796e2662d36"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.557258 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:17.578847 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:17.580296 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:17.581969 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:17.584647 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:17.584877 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.585129 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:17.585330 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.632802 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:33441
I20260709 13:16:17.632979  5712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:33441 every 8 connection(s)
I20260709 13:16:17.638751 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:17.647450  5717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:17.648694  5718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:17.653139 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:17.654006  5713 heartbeater.cc:344] Connected to a master server at 127.27.150.190:42597
W20260709 13:16:17.654284  5721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:17.654654  5713 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:17.655738  5713 heartbeater.cc:507] Master 127.27.150.190:42597 requested a full tablet report, sending...
I20260709 13:16:17.655835 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:17.656208 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:17.656389 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602977656359 us; error 0 us; skew 500 ppm
I20260709 13:16:17.657089 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:17.658349  5586 ts_manager.cc:194] Registered new tserver with Master: 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441)
I20260709 13:16:17.660148 28250 webserver.cc:533] Webserver started at http://127.27.150.130:34357/ using document root <none> and password file <none>
I20260709 13:16:17.660772 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:17.660815  5586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46912
I20260709 13:16:17.661008 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:17.661396 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:17.662951 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.667877 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:17.671828  5725 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.672652 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:16:17.672967 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.673274 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:17.690209 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:17.691431 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:17.693085 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:17.695564 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:17.695786 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.696028 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:17.696208 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.742883 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:40223
I20260709 13:16:17.743029  5787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:40223 every 8 connection(s)
I20260709 13:16:17.748849 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:17.758122  5791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:17.760861  5792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:17.762387  5794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:17.763409 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:17.764588  5788 heartbeater.cc:344] Connected to a master server at 127.27.150.190:42597
I20260709 13:16:17.764806 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:16:17.765132  5788 heartbeater.cc:461] Registering TS with master...
W20260709 13:16:17.765177 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:17.765511 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602977765482 us; error 0 us; skew 500 ppm
I20260709 13:16:17.766111  5788 heartbeater.cc:507] Master 127.27.150.190:42597 requested a full tablet report, sending...
I20260709 13:16:17.766224 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:17.768887  5586 ts_manager.cc:194] Registered new tserver with Master: ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:17.769425 28250 webserver.cc:533] Webserver started at http://127.27.150.131:35049/ using document root <none> and password file <none>
I20260709 13:16:17.770205 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:17.770489 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:17.770843 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:17.771122  5586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46916
I20260709 13:16:17.772578 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.777827 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:16:17.781481  5799 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.782380 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:17.782757 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
format_stamp: "Formatted at 2026-07-09 13:16:17 on dist-test-slave-nvvq"
I20260709 13:16:17.783048 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:17.824287 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:17.825794 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:17.827337 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:17.830137 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:17.830358 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.830672 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:17.830856 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:17.879053 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:34975
I20260709 13:16:17.879251  5861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:34975 every 8 connection(s)
I20260709 13:16:17.895099  5862 heartbeater.cc:344] Connected to a master server at 127.27.150.190:42597
I20260709 13:16:17.895706  5862 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:17.896663  5862 heartbeater.cc:507] Master 127.27.150.190:42597 requested a full tablet report, sending...
I20260709 13:16:17.899129  5586 ts_manager.cc:194] Registered new tserver with Master: ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:17.900060 28250 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017219046s
I20260709 13:16:17.901068  5586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46922
I20260709 13:16:17.929926  5586 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46928:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:17.932907  5586 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:18.005712  5678 tablet_service.cc:1511] Processing CreateTablet for tablet 663ec201952e45a597e7b91d5d4b1e0d (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:18.007500  5678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663ec201952e45a597e7b91d5d4b1e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.012223  5677 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc2af8629b64a0485ed32eeefbd5018 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:18.013983  5677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc2af8629b64a0485ed32eeefbd5018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.015607  5676 tablet_service.cc:1511] Processing CreateTablet for tablet 17918d5cb5064b149b51886b78b6afd4 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:18.017254  5676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17918d5cb5064b149b51886b78b6afd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.017951  5675 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9eda4cb9d4688bb812e68834073dc (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:18.018821  5674 tablet_service.cc:1511] Processing CreateTablet for tablet 44fac40839f246dbac6642b9ec140018 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:18.019956  5675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9eda4cb9d4688bb812e68834073dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.023766  5674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fac40839f246dbac6642b9ec140018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.027647  5673 tablet_service.cc:1511] Processing CreateTablet for tablet 53139aac7c8d4a1797facf74523f2106 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:18.029176  5673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53139aac7c8d4a1797facf74523f2106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.034554  5672 tablet_service.cc:1511] Processing CreateTablet for tablet ea77ad41ef444dcdafe165724bea5920 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:18.036260  5672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea77ad41ef444dcdafe165724bea5920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.068758  5671 tablet_service.cc:1511] Processing CreateTablet for tablet 9061b29a602b48da9fba20b71503c213 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:18.071161  5671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9061b29a602b48da9fba20b71503c213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.080307  5751 tablet_service.cc:1511] Processing CreateTablet for tablet 17918d5cb5064b149b51886b78b6afd4 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:18.081609  5753 tablet_service.cc:1511] Processing CreateTablet for tablet 663ec201952e45a597e7b91d5d4b1e0d (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:18.082150  5751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17918d5cb5064b149b51886b78b6afd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.083262  5753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663ec201952e45a597e7b91d5d4b1e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.084569  5750 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9eda4cb9d4688bb812e68834073dc (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:18.085729  5752 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc2af8629b64a0485ed32eeefbd5018 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:18.086130  5750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9eda4cb9d4688bb812e68834073dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.087495  5752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc2af8629b64a0485ed32eeefbd5018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.087904  5749 tablet_service.cc:1511] Processing CreateTablet for tablet 44fac40839f246dbac6642b9ec140018 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:18.089377  5749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fac40839f246dbac6642b9ec140018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.091554  5748 tablet_service.cc:1511] Processing CreateTablet for tablet 53139aac7c8d4a1797facf74523f2106 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:18.093041  5748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53139aac7c8d4a1797facf74523f2106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.093375  5877 tablet_bootstrap.cc:492] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.099709  5747 tablet_service.cc:1511] Processing CreateTablet for tablet ea77ad41ef444dcdafe165724bea5920 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:18.101246  5747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea77ad41ef444dcdafe165724bea5920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.102664  5677 tablet_service.cc:1511] Processing CreateTablet for tablet e13f513f4a9443c1ba392d85e007b6d2 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:18.104163  5677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13f513f4a9443c1ba392d85e007b6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.104247  5746 tablet_service.cc:1511] Processing CreateTablet for tablet 9061b29a602b48da9fba20b71503c213 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:18.105726  5746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9061b29a602b48da9fba20b71503c213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.110349  5745 tablet_service.cc:1511] Processing CreateTablet for tablet e13f513f4a9443c1ba392d85e007b6d2 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:18.111809  5745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13f513f4a9443c1ba392d85e007b6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.129645  5827 tablet_service.cc:1511] Processing CreateTablet for tablet 663ec201952e45a597e7b91d5d4b1e0d (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:18.131316  5827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663ec201952e45a597e7b91d5d4b1e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.135674  5826 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc2af8629b64a0485ed32eeefbd5018 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:18.137235  5826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc2af8629b64a0485ed32eeefbd5018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.139626  5825 tablet_service.cc:1511] Processing CreateTablet for tablet 17918d5cb5064b149b51886b78b6afd4 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:18.143671  5823 tablet_service.cc:1511] Processing CreateTablet for tablet 44fac40839f246dbac6642b9ec140018 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:18.147553  5821 tablet_service.cc:1511] Processing CreateTablet for tablet ea77ad41ef444dcdafe165724bea5920 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:18.150252  5820 tablet_service.cc:1511] Processing CreateTablet for tablet 9061b29a602b48da9fba20b71503c213 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:18.142073  5824 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9eda4cb9d4688bb812e68834073dc (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:18.146018  5822 tablet_service.cc:1511] Processing CreateTablet for tablet 53139aac7c8d4a1797facf74523f2106 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:18.153316  5819 tablet_service.cc:1511] Processing CreateTablet for tablet e13f513f4a9443c1ba392d85e007b6d2 (DEFAULT_TABLE table=test-workload [id=93d481ada4e04286b73e29ad9596b3d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:18.157987  5821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea77ad41ef444dcdafe165724bea5920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.180521  5819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13f513f4a9443c1ba392d85e007b6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.185074  5820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9061b29a602b48da9fba20b71503c213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.190810  5823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fac40839f246dbac6642b9ec140018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.194808  5825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17918d5cb5064b149b51886b78b6afd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.196076  5822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53139aac7c8d4a1797facf74523f2106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.197708  5824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9eda4cb9d4688bb812e68834073dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:18.250056  5879 tablet_bootstrap.cc:492] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.175292  5877 tablet_bootstrap.cc:654] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.259096  5879 tablet_bootstrap.cc:654] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.270337  5879 tablet_bootstrap.cc:492] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.271036  5879 ts_tablet_manager.cc:1403] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:16:18.274748  5879 raft_consensus.cc:359] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.275609  5879 raft_consensus.cc:385] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.275969  5879 raft_consensus.cc:740] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.277014  5879 consensus_queue.cc:260] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.286893  5862 heartbeater.cc:499] Master 127.27.150.190:42597 was elected leader, sending a full tablet report...
I20260709 13:16:18.293426  5877 tablet_bootstrap.cc:492] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.294124  5877 ts_tablet_manager.cc:1403] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.201s	user 0.010s	sys 0.011s
I20260709 13:16:18.297677  5877 raft_consensus.cc:359] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.298475  5877 raft_consensus.cc:385] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.298802  5877 raft_consensus.cc:740] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.299858  5877 consensus_queue.cc:260] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.301187  5879 ts_tablet_manager.cc:1434] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.004s
I20260709 13:16:18.311228  5879 tablet_bootstrap.cc:492] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.320461  5879 tablet_bootstrap.cc:654] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.324677  5713 heartbeater.cc:499] Master 127.27.150.190:42597 was elected leader, sending a full tablet report...
I20260709 13:16:18.325161  5877 ts_tablet_manager.cc:1434] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.031s	user 0.018s	sys 0.010s
I20260709 13:16:18.326330  5877 tablet_bootstrap.cc:492] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.333994  5877 tablet_bootstrap.cc:654] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.336510  5878 tablet_bootstrap.cc:492] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.346741  5878 tablet_bootstrap.cc:654] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.361474  5878 tablet_bootstrap.cc:492] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.361969  5878 ts_tablet_manager.cc:1403] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.005s
I20260709 13:16:18.364763  5879 tablet_bootstrap.cc:492] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.365271  5877 tablet_bootstrap.cc:492] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.365372  5879 ts_tablet_manager.cc:1403] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.018s
I20260709 13:16:18.365216  5878 raft_consensus.cc:359] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.366333  5877 ts_tablet_manager.cc:1403] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.013s
I20260709 13:16:18.366555  5878 raft_consensus.cc:385] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.366922  5878 raft_consensus.cc:740] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.367813  5878 consensus_queue.cc:260] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.368773  5879 raft_consensus.cc:359] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.369477  5879 raft_consensus.cc:385] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.369767  5879 raft_consensus.cc:740] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.369938  5877 raft_consensus.cc:359] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.371111  5877 raft_consensus.cc:385] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.370820  5879 consensus_queue.cc:260] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.373354  5879 ts_tablet_manager.cc:1434] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:18.371555  5877 raft_consensus.cc:740] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.374782  5788 heartbeater.cc:499] Master 127.27.150.190:42597 was elected leader, sending a full tablet report...
I20260709 13:16:18.374612  5877 consensus_queue.cc:260] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.377012  5877 ts_tablet_manager.cc:1434] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 13:16:18.378140  5877 tablet_bootstrap.cc:492] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.380801  5878 ts_tablet_manager.cc:1434] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.005s
I20260709 13:16:18.382144  5878 tablet_bootstrap.cc:492] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.385344  5877 tablet_bootstrap.cc:654] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.389273  5878 tablet_bootstrap.cc:654] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.395937  5879 tablet_bootstrap.cc:492] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.398231  5877 tablet_bootstrap.cc:492] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.398944  5878 tablet_bootstrap.cc:492] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.398972  5877 ts_tablet_manager.cc:1403] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 13:16:18.399778  5878 ts_tablet_manager.cc:1403] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.011s
I20260709 13:16:18.402829  5877 raft_consensus.cc:359] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.403677  5877 raft_consensus.cc:385] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.403519  5878 raft_consensus.cc:359] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.404241  5877 raft_consensus.cc:740] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.404320  5879 tablet_bootstrap.cc:654] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.404775  5878 raft_consensus.cc:385] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.405234  5878 raft_consensus.cc:740] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.406068  5878 consensus_queue.cc:260] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.405593  5877 consensus_queue.cc:260] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.407392  5883 raft_consensus.cc:493] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.407909  5883 raft_consensus.cc:515] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.409329  5878 ts_tablet_manager.cc:1434] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:18.410794  5878 tablet_bootstrap.cc:492] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.419463  5878 tablet_bootstrap.cc:654] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.421430  5883 leader_election.cc:290] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.424530  5881 raft_consensus.cc:493] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.425259  5881 raft_consensus.cc:515] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.440704  5877 ts_tablet_manager.cc:1434] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:16:18.442137  5877 tablet_bootstrap.cc:492] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.455420  5881 leader_election.cc:290] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
W20260709 13:16:18.459017  5634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:18.466703  5877 tablet_bootstrap.cc:654] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.479125  5879 tablet_bootstrap.cc:492] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.480031  5879 ts_tablet_manager.cc:1403] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.084s	user 0.042s	sys 0.039s
I20260709 13:16:18.484851  5879 raft_consensus.cc:359] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.486002  5879 raft_consensus.cc:385] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.486498  5879 raft_consensus.cc:740] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.487602  5879 consensus_queue.cc:260] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.493225  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc2af8629b64a0485ed32eeefbd5018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:18.501142  5898 raft_consensus.cc:493] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.501658  5653 leader_election.cc:343] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:18.502628  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc2af8629b64a0485ed32eeefbd5018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:18.503466  5837 raft_consensus.cc:2468] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:18.502959  5879 ts_tablet_manager.cc:1434] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:16:18.505551  5879 tablet_bootstrap.cc:492] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.506255  5878 tablet_bootstrap.cc:492] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.506932  5878 ts_tablet_manager.cc:1403] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.096s	user 0.031s	sys 0.050s
I20260709 13:16:18.510563  5878 raft_consensus.cc:359] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.511351  5878 raft_consensus.cc:385] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.511663  5878 raft_consensus.cc:740] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.512362  5879 tablet_bootstrap.cc:654] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.512470  5878 consensus_queue.cc:260] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.513372  5654 leader_election.cc:304] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:18.514918  5883 raft_consensus.cc:2804] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:18.515336  5878 ts_tablet_manager.cc:1434] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:16:18.515347  5883 raft_consensus.cc:493] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.516111  5883 raft_consensus.cc:3060] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.516595  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:18.517022  5878 tablet_bootstrap.cc:492] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.517396  5763 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:18.501797  5898 raft_consensus.cc:515] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.523296  5802 leader_election.cc:304] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:18.524385  5881 raft_consensus.cc:2804] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:18.524842  5881 raft_consensus.cc:493] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.525228  5881 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.527251  5877 tablet_bootstrap.cc:492] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.527913  5877 ts_tablet_manager.cc:1403] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.007s
I20260709 13:16:18.531427  5877 raft_consensus.cc:359] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.532753  5877 raft_consensus.cc:385] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.535460  5877 raft_consensus.cc:740] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.533845  5878 tablet_bootstrap.cc:654] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.534814  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:18.538260  5688 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:18.524688  5898 leader_election.cc:290] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:18.536031  5881 raft_consensus.cc:515] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.537137  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:18.546105  5877 consensus_queue.cc:260] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.546897  5763 raft_consensus.cc:2468] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:18.545048  5883 raft_consensus.cc:515] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.537066  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:18.548285  5687 raft_consensus.cc:2468] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:18.549548  5802 leader_election.cc:304] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:18.550567  5898 raft_consensus.cc:2804] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:18.551018  5898 raft_consensus.cc:493] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.551450  5898 raft_consensus.cc:3060] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.552174  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc2af8629b64a0485ed32eeefbd5018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
W20260709 13:16:18.553866  5653 leader_election.cc:343] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:18.555220  5878 tablet_bootstrap.cc:492] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.556026  5878 ts_tablet_manager.cc:1403] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.002s
I20260709 13:16:18.557534  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:18.557535  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:18.559172  5687 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.560187  5878 raft_consensus.cc:359] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.558248  5763 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.562698  5883 leader_election.cc:290] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.562726  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc2af8629b64a0485ed32eeefbd5018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:18.566120  5837 raft_consensus.cc:3060] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.569041  5898 raft_consensus.cc:515] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.561208  5878 raft_consensus.cc:385] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.572867  5878 raft_consensus.cc:740] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.574146  5878 consensus_queue.cc:260] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.575769  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:18.576467  5688 raft_consensus.cc:3060] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.577149  5878 ts_tablet_manager.cc:1434] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:16:18.578361  5878 tablet_bootstrap.cc:492] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.579650  5879 tablet_bootstrap.cc:492] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.580286  5879 ts_tablet_manager.cc:1403] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.031s
I20260709 13:16:18.576867  5837 raft_consensus.cc:2468] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:18.585812  5688 raft_consensus.cc:2468] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 1.
I20260709 13:16:18.586115  5654 leader_election.cc:304] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:18.588433  5800 leader_election.cc:304] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:18.592866  5881 leader_election.cc:290] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:18.593818  5878 tablet_bootstrap.cc:654] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.584174  5879 raft_consensus.cc:359] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:18.594300  5879 raft_consensus.cc:385] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.594662  5879 raft_consensus.cc:740] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.596536  5879 consensus_queue.cc:260] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:18.596907  5898 leader_election.cc:290] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:18.597193  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:18.598169  5762 raft_consensus.cc:3060] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.599625  5879 ts_tablet_manager.cc:1434] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 13:16:18.601228  5879 tablet_bootstrap.cc:492] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.609133  5878 tablet_bootstrap.cc:492] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.609697  5879 tablet_bootstrap.cc:654] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.609774  5878 ts_tablet_manager.cc:1403] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.002s
I20260709 13:16:18.614888  5887 raft_consensus.cc:493] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.615634  5887 raft_consensus.cc:515] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.628870  5887 leader_election.cc:290] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.618280  5878 raft_consensus.cc:359] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.637703  5878 raft_consensus.cc:385] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.593689  5881 raft_consensus.cc:2804] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:18.638195  5878 raft_consensus.cc:740] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.639479  5878 consensus_queue.cc:260] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.642603  5881 raft_consensus.cc:697] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:18.644064  5881 consensus_queue.cc:237] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.646289  5879 tablet_bootstrap.cc:492] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.647064  5879 ts_tablet_manager.cc:1403] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.025s
I20260709 13:16:18.648268  5878 ts_tablet_manager.cc:1434] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:16:18.649534  5878 tablet_bootstrap.cc:492] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.650642  5879 raft_consensus.cc:359] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.651467  5879 raft_consensus.cc:385] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.651773  5879 raft_consensus.cc:740] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.652822  5879 consensus_queue.cc:260] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.656132  5879 ts_tablet_manager.cc:1434] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:18.657864  5879 tablet_bootstrap.cc:492] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.666014  5879 tablet_bootstrap.cc:654] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.667248  5900 raft_consensus.cc:2804] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:18.668094  5900 raft_consensus.cc:697] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:18.666014  5878 tablet_bootstrap.cc:654] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.642104  5687 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 1.
I20260709 13:16:18.678619  5763 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 1.
I20260709 13:16:18.679137  5883 raft_consensus.cc:493] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.679801  5877 ts_tablet_manager.cc:1434] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.152s	user 0.027s	sys 0.062s
I20260709 13:16:18.679641  5883 raft_consensus.cc:515] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.680251  5802 leader_election.cc:304] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:18.669384  5900 consensus_queue.cc:237] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.681526  5877 tablet_bootstrap.cc:492] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.681506  5903 raft_consensus.cc:2804] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:18.683537  5903 raft_consensus.cc:697] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:18.684612  5903 consensus_queue.cc:237] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.685667  5762 raft_consensus.cc:2468] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 1.
I20260709 13:16:18.688382  5879 tablet_bootstrap.cc:492] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.692716  5883 leader_election.cc:290] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.691357  5879 ts_tablet_manager.cc:1403] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.007s
I20260709 13:16:18.694543  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:18.711710  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:18.712698  5762 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:18.712989  5879 raft_consensus.cc:359] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.713835  5879 raft_consensus.cc:385] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.713882  5653 leader_election.cc:304] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:18.714236  5879 raft_consensus.cc:740] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.715366  5883 raft_consensus.cc:2804] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.715142  5879 consensus_queue.cc:260] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.715778  5883 raft_consensus.cc:493] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.716177  5883 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.717682  5879 ts_tablet_manager.cc:1434] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.006s
I20260709 13:16:18.720124  5879 tablet_bootstrap.cc:492] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.726200  5878 tablet_bootstrap.cc:492] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.726871  5878 ts_tablet_manager.cc:1403] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.006s
I20260709 13:16:18.718313  5877 tablet_bootstrap.cc:654] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.727607  5883 raft_consensus.cc:515] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.733567  5878 raft_consensus.cc:359] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.734398  5878 raft_consensus.cc:385] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.734735  5878 raft_consensus.cc:740] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.735895  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:18.736598  5762 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.738029  5879 tablet_bootstrap.cc:654] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.745694  5903 raft_consensus.cc:493] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.747447  5903 raft_consensus.cc:515] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:18.748281  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:18.749382  5687 raft_consensus.cc:2468] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:18.735651  5878 consensus_queue.cc:260] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.771333  5878 ts_tablet_manager.cc:1434] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 13:16:18.756220  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663ec201952e45a597e7b91d5d4b1e0d" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:18.772653  5878 tablet_bootstrap.cc:492] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
W20260709 13:16:18.773177  5800 leader_election.cc:343] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:18.763047  5877 tablet_bootstrap.cc:492] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.774603  5877 ts_tablet_manager.cc:1403] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.001s
I20260709 13:16:18.768653  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663ec201952e45a597e7b91d5d4b1e0d" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:18.769085  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:18.763274  5726 leader_election.cc:304] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
W20260709 13:16:18.776656  5802 leader_election.cc:343] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:18.777168  5802 leader_election.cc:304] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:18.778103  5879 tablet_bootstrap.cc:492] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.778725  5879 ts_tablet_manager.cc:1403] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.015s
I20260709 13:16:18.778293  5877 raft_consensus.cc:359] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:18.779124  5887 raft_consensus.cc:2804] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:18.779438  5877 raft_consensus.cc:385] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.779631  5887 raft_consensus.cc:493] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.780052  5877 raft_consensus.cc:740] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.780156  5887 raft_consensus.cc:3060] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.767318  5903 leader_election.cc:290] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:18.782591  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:18.782357  5879 raft_consensus.cc:359] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.781579  5877 consensus_queue.cc:260] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:18.783331  5879 raft_consensus.cc:385] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.783378  5837 raft_consensus.cc:2468] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:18.783861  5879 raft_consensus.cc:740] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.785171  5879 consensus_queue.cc:260] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.783116  5903 raft_consensus.cc:2749] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:18.786525  5877 ts_tablet_manager.cc:1434] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:16:18.787706  5877 tablet_bootstrap.cc:492] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.787317  5586 catalog_manager.cc:5697] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 0 to 1, leader changed from <none> to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 1 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:18.788376  5879 ts_tablet_manager.cc:1434] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:16:18.753731  5762 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 2.
I20260709 13:16:18.789861  5879 tablet_bootstrap.cc:492] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.789908  5653 leader_election.cc:304] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:18.791121  5900 raft_consensus.cc:2804] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.791618  5900 raft_consensus.cc:697] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:18.792555  5900 consensus_queue.cc:237] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.770164  5883 leader_election.cc:290] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.798401  5879 tablet_bootstrap.cc:654] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.799979  5584 catalog_manager.cc:5697] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.801712  5878 tablet_bootstrap.cc:654] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.802574  5887 raft_consensus.cc:515] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.806043  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:18.806878  5687 raft_consensus.cc:3060] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.809644  5877 tablet_bootstrap.cc:654] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.820528  5879 tablet_bootstrap.cc:492] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.821209  5879 ts_tablet_manager.cc:1403] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.004s
I20260709 13:16:18.823360  5687 raft_consensus.cc:2468] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:18.824894  5726 leader_election.cc:304] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:18.825459  5879 raft_consensus.cc:359] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.830998  5879 raft_consensus.cc:385] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.831277  5879 raft_consensus.cc:740] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.831415  5887 leader_election.cc:290] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.832162  5887 raft_consensus.cc:2804] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:18.832196  5878 tablet_bootstrap.cc:492] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.832252  5879 consensus_queue.cc:260] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.834051  5887 raft_consensus.cc:697] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:18.834096  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:18.834287  5878 ts_tablet_manager.cc:1403] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.004s
I20260709 13:16:18.835178  5837 raft_consensus.cc:3060] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.837508  5877 tablet_bootstrap.cc:492] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.838124  5877 ts_tablet_manager.cc:1403] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.016s
I20260709 13:16:18.841243  5878 raft_consensus.cc:359] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.841511  5877 raft_consensus.cc:359] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.842415  5887 consensus_queue.cc:237] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.843266  5877 raft_consensus.cc:385] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.843613  5877 raft_consensus.cc:740] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.844005  5878 raft_consensus.cc:385] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.845098  5878 raft_consensus.cc:740] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.844578  5877 consensus_queue.cc:260] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.844281  5879 ts_tablet_manager.cc:1434] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:16:18.848532  5879 tablet_bootstrap.cc:492] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:18.847365  5878 consensus_queue.cc:260] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.852943  5837 raft_consensus.cc:2468] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:18.855629  5921 raft_consensus.cc:493] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.856143  5877 ts_tablet_manager.cc:1434] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 13:16:18.856192  5921 raft_consensus.cc:515] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.863600  5877 tablet_bootstrap.cc:492] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.864974  5878 ts_tablet_manager.cc:1434] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 13:16:18.865788  5921 leader_election.cc:290] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.866778  5878 tablet_bootstrap.cc:492] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.867377  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77ad41ef444dcdafe165724bea5920" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:18.867722  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77ad41ef444dcdafe165724bea5920" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:18.868402  5837 raft_consensus.cc:2468] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:18.870808  5729 leader_election.cc:304] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:18.868491  5687 raft_consensus.cc:2468] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:18.872210  5921 raft_consensus.cc:2804] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:18.872566  5921 raft_consensus.cc:493] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.872921  5921 raft_consensus.cc:3060] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.882112  5877 tablet_bootstrap.cc:654] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.885854  5879 tablet_bootstrap.cc:654] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.894531  5878 tablet_bootstrap.cc:654] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.895635  5921 raft_consensus.cc:515] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.904454  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77ad41ef444dcdafe165724bea5920" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:18.905196  5687 raft_consensus.cc:3060] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.908597  5583 catalog_manager.cc:5697] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 0 to 1, leader changed from <none> to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 1 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:18.914707  5887 raft_consensus.cc:493] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.915772  5921 leader_election.cc:290] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.917423  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77ad41ef444dcdafe165724bea5920" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:18.918105  5837 raft_consensus.cc:3060] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.915778  5887 raft_consensus.cc:515] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.922848  5887 leader_election.cc:290] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.923688  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53139aac7c8d4a1797facf74523f2106" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:18.924929  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53139aac7c8d4a1797facf74523f2106" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
W20260709 13:16:18.925406  5726 leader_election.cc:343] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:18.925962  5836 raft_consensus.cc:2468] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:18.927695  5729 leader_election.cc:304] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 5a7401e4a5d24132baf8d796e2662d36
I20260709 13:16:18.929028  5887 raft_consensus.cc:2804] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:18.929471  5887 raft_consensus.cc:493] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.929886  5887 raft_consensus.cc:3060] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.930662  5687 raft_consensus.cc:2468] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:18.931900  5726 leader_election.cc:304] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:18.934887  5879 tablet_bootstrap.cc:492] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:18.935719  5879 ts_tablet_manager.cc:1403] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.009s
I20260709 13:16:18.934983  5584 catalog_manager.cc:5697] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.936929  5877 tablet_bootstrap.cc:492] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.937547  5877 ts_tablet_manager.cc:1403] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.025s
I20260709 13:16:18.939294  5879 raft_consensus.cc:359] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.940071  5879 raft_consensus.cc:385] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.940383  5879 raft_consensus.cc:740] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.941051  5877 raft_consensus.cc:359] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.941179  5887 raft_consensus.cc:515] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.941371  5879 consensus_queue.cc:260] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.941977  5877 raft_consensus.cc:385] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.942344  5877 raft_consensus.cc:740] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.943293  5877 consensus_queue.cc:260] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.944689  5879 ts_tablet_manager.cc:1434] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:18.944895  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53139aac7c8d4a1797facf74523f2106" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
W20260709 13:16:18.946182  5726 leader_election.cc:343] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:18.946317  5877 ts_tablet_manager.cc:1434] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:16:18.947227  5887 leader_election.cc:290] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.947629  5877 tablet_bootstrap.cc:492] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.948441  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53139aac7c8d4a1797facf74523f2106" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:18.949384  5878 tablet_bootstrap.cc:492] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:18.949285  5837 raft_consensus.cc:2468] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:18.948438  5586 catalog_manager.cc:5697] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 1 to 2, leader changed from ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131) to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.950026  5878 ts_tablet_manager.cc:1403] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.023s
I20260709 13:16:18.933871  5921 raft_consensus.cc:2804] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:18.951663  5921 raft_consensus.cc:697] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:18.952613  5921 consensus_queue.cc:237] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.953362  5878 raft_consensus.cc:359] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.949450  5836 raft_consensus.cc:3060] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:18.957996  5877 tablet_bootstrap.cc:654] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.954164  5878 raft_consensus.cc:385] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.962841  5878 raft_consensus.cc:740] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.963831  5878 consensus_queue.cc:260] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.967811  5878 ts_tablet_manager.cc:1434] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:16:18.969336  5877 tablet_bootstrap.cc:492] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:18.970760  5877 ts_tablet_manager.cc:1403] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:16:18.971388  5878 tablet_bootstrap.cc:492] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:18.970017  5836 raft_consensus.cc:2468] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:18.973758  5877 raft_consensus.cc:359] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.975159  5877 raft_consensus.cc:385] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:18.975468  5877 raft_consensus.cc:740] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:18.975509  5729 leader_election.cc:304] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 5a7401e4a5d24132baf8d796e2662d36
I20260709 13:16:18.976488  5877 consensus_queue.cc:260] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.978295  5887 raft_consensus.cc:2804] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:18.978900  5887 raft_consensus.cc:697] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:18.979019  5878 tablet_bootstrap.cc:654] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.978915  5877 ts_tablet_manager.cc:1434] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:18.980594  5877 tablet_bootstrap.cc:492] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:18.980055  5887 consensus_queue.cc:237] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.980881  5921 raft_consensus.cc:493] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.984721  5921 raft_consensus.cc:515] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:18.988003  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc2af8629b64a0485ed32eeefbd5018" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:18.990127  5877 tablet_bootstrap.cc:654] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:18.991668  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc2af8629b64a0485ed32eeefbd5018" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:18.992555  5836 raft_consensus.cc:2393] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff4bbe6dda6f4dc495ce74f02673cb45 in current term 1: Already voted for candidate 5a7401e4a5d24132baf8d796e2662d36 in this term.
I20260709 13:16:18.993882  5921 leader_election.cc:290] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:18.996901  5729 leader_election.cc:304] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:18.998024  5921 raft_consensus.cc:3060] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.001322  5583 catalog_manager.cc:5697] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.003376  5877 tablet_bootstrap.cc:492] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:19.003916  5877 ts_tablet_manager.cc:1403] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:16:19.007381  5877 raft_consensus.cc:359] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.008065  5877 raft_consensus.cc:385] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:19.008348  5877 raft_consensus.cc:740] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:19.009088  5877 consensus_queue.cc:260] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.011251  5921 raft_consensus.cc:2749] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:19.011570  5877 ts_tablet_manager.cc:1434] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:19.017542  5900 raft_consensus.cc:493] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.018093  5900 raft_consensus.cc:515] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.019248  5878 tablet_bootstrap.cc:492] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:19.019920  5878 ts_tablet_manager.cc:1403] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.029s
I20260709 13:16:19.021219  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:19.021350  5900 leader_election.cc:290] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:19.021632  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:19.022009  5762 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:19.022430  5836 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:19.023514  5653 leader_election.cc:304] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:19.023407  5878 raft_consensus.cc:359] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:19.024264  5878 raft_consensus.cc:385] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:19.024469  5900 raft_consensus.cc:2804] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:19.024588  5878 raft_consensus.cc:740] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:19.024987  5900 raft_consensus.cc:493] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.025390  5900 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.025671  5878 consensus_queue.cc:260] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:19.027634  5878 ts_tablet_manager.cc:1434] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:19.033737  5900 raft_consensus.cc:515] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.036191  5900 leader_election.cc:290] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:19.036895  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:19.037597  5836 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.038873  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:19.038455  5584 catalog_manager.cc:5697] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.039417  5762 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.045364  5836 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:19.046676  5654 leader_election.cc:304] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:19.047217  5762 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:19.047662  5900 raft_consensus.cc:2804] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:19.048166  5900 raft_consensus.cc:697] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:19.049101  5900 consensus_queue.cc:237] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.058069  5584 catalog_manager.cc:5697] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.079509  5900 raft_consensus.cc:493] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.080056  5900 raft_consensus.cc:515] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:19.081955  5900 leader_election.cc:290] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:19.083076  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663ec201952e45a597e7b91d5d4b1e0d" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:19.083134  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663ec201952e45a597e7b91d5d4b1e0d" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:19.083895  5836 raft_consensus.cc:2468] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:19.083952  5762 raft_consensus.cc:2468] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:19.085044  5654 leader_election.cc:304] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:19.085955  5900 raft_consensus.cc:2804] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:19.086267  5900 raft_consensus.cc:493] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.086612  5900 raft_consensus.cc:3060] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.093042  5900 raft_consensus.cc:515] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:19.094851  5900 leader_election.cc:290] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Requested vote from peers ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:19.095695  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663ec201952e45a597e7b91d5d4b1e0d" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:19.096045  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663ec201952e45a597e7b91d5d4b1e0d" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:19.096434  5836 raft_consensus.cc:3060] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.096668  5762 raft_consensus.cc:3060] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.104935  5836 raft_consensus.cc:2468] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:19.104935  5762 raft_consensus.cc:2468] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:19.106757  5653 leader_election.cc:304] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:19.107597  5900 raft_consensus.cc:2804] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:19.108078  5900 raft_consensus.cc:697] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:19.108973  5900 consensus_queue.cc:237] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } }
I20260709 13:16:19.117534  5584 catalog_manager.cc:5697] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.155292  5881 consensus_queue.cc:1048] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.170740  5881 consensus_queue.cc:1048] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.209002  5687 raft_consensus.cc:1240] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Rejecting Update request from peer ed7c43bfd1cc4ad7893413f1984e9eab for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.210608  5881 consensus_queue.cc:1059] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.211380  5881 consensus_queue.cc:1243] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Peer 5a7401e4a5d24132baf8d796e2662d36 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:16:19.211843  5898 raft_consensus.cc:3055] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.212139  5898 raft_consensus.cc:740] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:19.212954  5898 consensus_queue.cc:260] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.213984  5898 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.228225  5900 consensus_queue.cc:1048] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.243877  5900 consensus_queue.cc:1048] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.288936  5762 raft_consensus.cc:1275] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:19.290548  5900 consensus_queue.cc:1048] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.294661  5900 raft_consensus.cc:493] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.295229  5900 raft_consensus.cc:515] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.298321  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53139aac7c8d4a1797facf74523f2106" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:19.298877  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53139aac7c8d4a1797facf74523f2106" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:19.299863  5836 raft_consensus.cc:2393] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a7401e4a5d24132baf8d796e2662d36 in current term 1: Already voted for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in this term.
I20260709 13:16:19.300143  5900 leader_election.cc:290] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:19.302680  5654 leader_election.cc:304] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36; no voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:19.305231  5836 raft_consensus.cc:1275] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:16:19.305723  5836 pending_rounds.cc:85] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: Aborting all ops after (but not including) 0
I20260709 13:16:19.306074  5836 pending_rounds.cc:107] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:16:19.305692  5900 raft_consensus.cc:3060] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.306452  5836 raft_consensus.cc:2889] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.308308  5883 consensus_queue.cc:1048] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.315858  5900 raft_consensus.cc:2749] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:19.360023  5921 consensus_queue.cc:1048] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.372834  5923 consensus_queue.cc:1048] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.376633  5887 consensus_queue.cc:1048] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.387609  5925 raft_consensus.cc:493] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.387986  5923 consensus_queue.cc:1048] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.388262  5925 raft_consensus.cc:515] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.392273  5925 leader_election.cc:290] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:19.392540  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9061b29a602b48da9fba20b71503c213" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:19.392920  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9061b29a602b48da9fba20b71503c213" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:19.393462  5837 raft_consensus.cc:2468] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:19.393823  5688 raft_consensus.cc:2468] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:19.395428  5726 leader_election.cc:304] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:19.396404  5925 raft_consensus.cc:2804] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:19.396807  5925 raft_consensus.cc:493] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.397147  5925 raft_consensus.cc:3060] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.407270  5925 raft_consensus.cc:515] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.412843  5923 consensus_queue.cc:1048] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.413889  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9061b29a602b48da9fba20b71503c213" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:19.414677  5687 raft_consensus.cc:3060] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.416893  5925 leader_election.cc:290] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:19.420032  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9061b29a602b48da9fba20b71503c213" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:19.420799  5837 raft_consensus.cc:3060] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:19.434993  5837 raft_consensus.cc:2468] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:19.436946  5729 leader_election.cc:304] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:19.437971  5921 raft_consensus.cc:2804] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:19.438493  5687 raft_consensus.cc:2468] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:19.438567  5921 raft_consensus.cc:697] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:19.440145  5921 consensus_queue.cc:237] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:19.440999  5923 consensus_queue.cc:1048] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.454466  5584 catalog_manager.cc:5697] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.539647  5900 consensus_queue.cc:1048] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:19.546171  5900 consensus_queue.cc:1048] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.553857  5902 consensus_queue.cc:1048] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.554549  5883 consensus_queue.cc:1048] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.766214  5837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
mode: GRACEFUL
new_leader_uuid: "5a7401e4a5d24132baf8d796e2662d36"
 from {username='slave'} at 127.0.0.1:52560
I20260709 13:16:19.767066  5837 raft_consensus.cc:606] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Received request to transfer leadership to TS 5a7401e4a5d24132baf8d796e2662d36
I20260709 13:16:19.784060  5688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44fac40839f246dbac6642b9ec140018"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
mode: GRACEFUL
new_leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
 from {username='slave'} at 127.0.0.1:51186
I20260709 13:16:19.784770  5688 raft_consensus.cc:606] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Received request to transfer leadership to TS ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:19.808537  5763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
mode: GRACEFUL
new_leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:37776
I20260709 13:16:19.809259  5763 raft_consensus.cc:606] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Received request to transfer leadership to TS ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:19.829751  5921 consensus_queue.cc:1048] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:19.843233  5923 consensus_queue.cc:1048] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:20.057833  5953 raft_consensus.cc:993] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36: : Instructing follower ff4bbe6dda6f4dc495ce74f02673cb45 to start an election
I20260709 13:16:20.058549  5900 raft_consensus.cc:1081] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Signalling peer ff4bbe6dda6f4dc495ce74f02673cb45 to start an election
I20260709 13:16:20.060444  5763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44fac40839f246dbac6642b9ec140018"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:16:20.061058  5763 raft_consensus.cc:493] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:20.061419  5763 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.068293  5763 raft_consensus.cc:515] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.070338  5763 leader_election.cc:290] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 2 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:20.071323  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:20.071673  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:20.072211  5688 raft_consensus.cc:3055] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:20.072326  5836 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.072634  5688 raft_consensus.cc:740] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:20.073649  5688 consensus_queue.cc:260] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.075196  5688 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.081524  5836 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 2.
I20260709 13:16:20.083088  5729 leader_election.cc:304] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:20.083664  5688 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 2.
I20260709 13:16:20.083925  5923 raft_consensus.cc:2804] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:20.084503  5923 raft_consensus.cc:697] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:20.085471  5923 consensus_queue.cc:237] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.092481  5586 catalog_manager.cc:5697] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 1 to 2, leader changed from 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129) to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.215909  5903 raft_consensus.cc:993] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab: : Instructing follower 5a7401e4a5d24132baf8d796e2662d36 to start an election
I20260709 13:16:20.216476  5966 raft_consensus.cc:1081] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Signalling peer 5a7401e4a5d24132baf8d796e2662d36 to start an election
I20260709 13:16:20.218256  5688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
 from {username='slave'} at 127.0.0.1:51170
I20260709 13:16:20.218808  5688 raft_consensus.cc:493] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:20.219089  5688 raft_consensus.cc:3060] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.226042  5688 raft_consensus.cc:515] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.227837  5688 leader_election.cc:290] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:20.228714  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:20.229041  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9eda4cb9d4688bb812e68834073dc" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:20.229526  5763 raft_consensus.cc:3060] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.229830  5836 raft_consensus.cc:3055] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:20.230209  5836 raft_consensus.cc:740] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:20.231166  5836 consensus_queue.cc:260] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.232316  5836 raft_consensus.cc:3060] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.235983  5763 raft_consensus.cc:2468] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 2.
I20260709 13:16:20.237370  5653 leader_election.cc:304] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:20.238152  5900 raft_consensus.cc:2804] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:20.238660  5900 raft_consensus.cc:697] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:20.239193  5836 raft_consensus.cc:2468] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 2.
I20260709 13:16:20.239502  5900 consensus_queue.cc:237] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.247668  5586 catalog_manager.cc:5697] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 1 to 2, leader changed from ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131) to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.249049  5921 raft_consensus.cc:993] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45: : Instructing follower ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:20.249614  5923 raft_consensus.cc:1081] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Signalling peer ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:20.251224  5836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:16:20.251852  5836 raft_consensus.cc:493] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:20.252305  5836 raft_consensus.cc:3060] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.259680  5836 raft_consensus.cc:515] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.261401  5836 leader_election.cc:290] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 2 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:20.262357  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:20.262661  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f513f4a9443c1ba392d85e007b6d2" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:20.263176  5688 raft_consensus.cc:3060] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.263329  5763 raft_consensus.cc:3055] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:20.263739  5763 raft_consensus.cc:740] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:20.264462  5763 consensus_queue.cc:260] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.265798  5763 raft_consensus.cc:3060] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.269744  5688 raft_consensus.cc:2468] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 2.
I20260709 13:16:20.271039  5800 leader_election.cc:304] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:20.271997  5966 raft_consensus.cc:2804] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:20.272450  5966 raft_consensus.cc:697] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:20.273375  5763 raft_consensus.cc:2468] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 2.
I20260709 13:16:20.273304  5966 consensus_queue.cc:237] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:20.282297  5586 catalog_manager.cc:5697] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 1 to 2, leader changed from ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130) to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 2 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.505903  5688 raft_consensus.cc:1275] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Refusing update from remote peer ff4bbe6dda6f4dc495ce74f02673cb45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.507408  5968 consensus_queue.cc:1048] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.517297  5836 raft_consensus.cc:1275] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Refusing update from remote peer ff4bbe6dda6f4dc495ce74f02673cb45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.519469  5968 consensus_queue.cc:1048] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.680035  5836 raft_consensus.cc:1275] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.681632  5953 consensus_queue.cc:1048] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.696659  5763 raft_consensus.cc:1275] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.698248  5953 consensus_queue.cc:1048] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.844599  5763 raft_consensus.cc:1275] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.846484  5966 consensus_queue.cc:1048] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:20.857895  5688 raft_consensus.cc:1275] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.859951  5966 consensus_queue.cc:1048] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.855667  5586 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50344:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:22.859177  5586 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:22.922886  5677 tablet_service.cc:1511] Processing CreateTablet for tablet 6550667d273249d8a9f883f65be91a45 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:22.925475  5677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6550667d273249d8a9f883f65be91a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.925215  5751 tablet_service.cc:1511] Processing CreateTablet for tablet 6550667d273249d8a9f883f65be91a45 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:22.926843  5820 tablet_service.cc:1511] Processing CreateTablet for tablet 6550667d273249d8a9f883f65be91a45 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:22.928006  5751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6550667d273249d8a9f883f65be91a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.928953  5820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6550667d273249d8a9f883f65be91a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.934091  5674 tablet_service.cc:1511] Processing CreateTablet for tablet 241e87db6f54489698c75fc2a5ae8d98 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:22.936065  5674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 241e87db6f54489698c75fc2a5ae8d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.938548  5822 tablet_service.cc:1511] Processing CreateTablet for tablet 241e87db6f54489698c75fc2a5ae8d98 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:22.940220  5822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 241e87db6f54489698c75fc2a5ae8d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.945056  5753 tablet_service.cc:1511] Processing CreateTablet for tablet 241e87db6f54489698c75fc2a5ae8d98 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:22.946801  5753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 241e87db6f54489698c75fc2a5ae8d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.953260  5821 tablet_service.cc:1511] Processing CreateTablet for tablet ad453434a5e84c7babf1074793c73691 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:22.954950  5821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad453434a5e84c7babf1074793c73691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.955405  5673 tablet_service.cc:1511] Processing CreateTablet for tablet ad453434a5e84c7babf1074793c73691 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:22.957458  5673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad453434a5e84c7babf1074793c73691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.957692  5746 tablet_service.cc:1511] Processing CreateTablet for tablet ad453434a5e84c7babf1074793c73691 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:22.959419  5746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad453434a5e84c7babf1074793c73691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.960533  5671 tablet_service.cc:1511] Processing CreateTablet for tablet 968a336b087a4b6db2ac7ea55617e535 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:22.962309  5671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968a336b087a4b6db2ac7ea55617e535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.963949  5749 tablet_service.cc:1511] Processing CreateTablet for tablet 968a336b087a4b6db2ac7ea55617e535 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:22.965456  5749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968a336b087a4b6db2ac7ea55617e535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.986318  5819 tablet_service.cc:1511] Processing CreateTablet for tablet 968a336b087a4b6db2ac7ea55617e535 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:22.988207  5819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968a336b087a4b6db2ac7ea55617e535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.989553  5672 tablet_service.cc:1511] Processing CreateTablet for tablet 48c957d4a3f4471da2079c384a18a5a7 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:22.991657  5672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c957d4a3f4471da2079c384a18a5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.047570  5827 tablet_service.cc:1511] Processing CreateTablet for tablet 48c957d4a3f4471da2079c384a18a5a7 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:23.049542  5827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c957d4a3f4471da2079c384a18a5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.056339  5678 tablet_service.cc:1511] Processing CreateTablet for tablet babf3691edac41fa99725dd0eff17526 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:23.058156  5678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet babf3691edac41fa99725dd0eff17526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.061015  5751 tablet_service.cc:1511] Processing CreateTablet for tablet babf3691edac41fa99725dd0eff17526 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:23.063984  5823 tablet_service.cc:1511] Processing CreateTablet for tablet babf3691edac41fa99725dd0eff17526 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:23.065729  5823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet babf3691edac41fa99725dd0eff17526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.067305  5751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet babf3691edac41fa99725dd0eff17526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.072075  5676 tablet_service.cc:1511] Processing CreateTablet for tablet fe2df1837efc403889f4aed8d1b42366 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:23.073623  5676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2df1837efc403889f4aed8d1b42366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.077692  5748 tablet_service.cc:1511] Processing CreateTablet for tablet fe2df1837efc403889f4aed8d1b42366 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:23.079298  5748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2df1837efc403889f4aed8d1b42366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.083600  5820 tablet_service.cc:1511] Processing CreateTablet for tablet fe2df1837efc403889f4aed8d1b42366 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:23.086971  5675 tablet_service.cc:1511] Processing CreateTablet for tablet 374bd357d576455d9f86a8bfb6e6d322 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:23.088637  5675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374bd357d576455d9f86a8bfb6e6d322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.090461  5749 tablet_service.cc:1511] Processing CreateTablet for tablet 48c957d4a3f4471da2079c384a18a5a7 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:23.091940  5749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c957d4a3f4471da2079c384a18a5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.103087  5995 tablet_bootstrap.cc:492] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.118522  5822 tablet_service.cc:1511] Processing CreateTablet for tablet 374bd357d576455d9f86a8bfb6e6d322 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:23.119541  5820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2df1837efc403889f4aed8d1b42366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.120146  5677 tablet_service.cc:1511] Processing CreateTablet for tablet 35f5edc99d3b40259b4f5a06ed104d93 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:23.121112  5822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374bd357d576455d9f86a8bfb6e6d322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.121665  5677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f5edc99d3b40259b4f5a06ed104d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.130467  5821 tablet_service.cc:1511] Processing CreateTablet for tablet 35f5edc99d3b40259b4f5a06ed104d93 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:23.132036  5821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f5edc99d3b40259b4f5a06ed104d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.137118  5995 tablet_bootstrap.cc:654] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.139575  5749 tablet_service.cc:1511] Processing CreateTablet for tablet 35f5edc99d3b40259b4f5a06ed104d93 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:23.141542  5751 tablet_service.cc:1511] Processing CreateTablet for tablet 374bd357d576455d9f86a8bfb6e6d322 (DEFAULT_TABLE table=soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:23.148092  5994 tablet_bootstrap.cc:492] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.152879  5749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f5edc99d3b40259b4f5a06ed104d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.186779  5996 tablet_bootstrap.cc:492] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.185731  5751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374bd357d576455d9f86a8bfb6e6d322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.191514  5994 tablet_bootstrap.cc:654] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.202648  5996 tablet_bootstrap.cc:654] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.203401  5995 tablet_bootstrap.cc:492] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.204207  5995 ts_tablet_manager.cc:1403] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.013s
I20260709 13:16:23.208408  5995 raft_consensus.cc:359] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.211311  5995 raft_consensus.cc:385] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.211678  5995 raft_consensus.cc:740] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.212771  5995 consensus_queue.cc:260] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.214545  5994 tablet_bootstrap.cc:492] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.215305  5994 ts_tablet_manager.cc:1403] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.004s
I20260709 13:16:23.216156  5995 ts_tablet_manager.cc:1434] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:16:23.221065  5995 tablet_bootstrap.cc:492] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.228947  5995 tablet_bootstrap.cc:654] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.230358  5994 raft_consensus.cc:359] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.231494  5994 raft_consensus.cc:385] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.231946  5994 raft_consensus.cc:740] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.233261  5994 consensus_queue.cc:260] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.240942  5994 ts_tablet_manager.cc:1434] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:16:23.247195  5996 tablet_bootstrap.cc:492] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.248746  5996 ts_tablet_manager.cc:1403] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.004s
I20260709 13:16:23.254268  5994 tablet_bootstrap.cc:492] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.255154  5996 raft_consensus.cc:359] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.256115  5996 raft_consensus.cc:385] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.256433  5996 raft_consensus.cc:740] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.257267  5996 consensus_queue.cc:260] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.264500  5996 ts_tablet_manager.cc:1434] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:16:23.265954  5996 tablet_bootstrap.cc:492] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.267994  5994 tablet_bootstrap.cc:654] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.268152  5995 tablet_bootstrap.cc:492] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.268833  5995 ts_tablet_manager.cc:1403] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.024s
I20260709 13:16:23.273249  5995 raft_consensus.cc:359] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.273655  5996 tablet_bootstrap.cc:654] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.274305  5995 raft_consensus.cc:385] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.274784  5995 raft_consensus.cc:740] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.274912  5979 raft_consensus.cc:493] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.275658  5979 raft_consensus.cc:515] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.276117  5995 consensus_queue.cc:260] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.283231  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:23.284377  5763 raft_consensus.cc:2468] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:23.286792  5995 ts_tablet_manager.cc:1434] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:16:23.288568  5995 tablet_bootstrap.cc:492] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.291064  5653 leader_election.cc:304] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.292654  5982 raft_consensus.cc:2804] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.293174  5982 raft_consensus.cc:493] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.293370  5994 tablet_bootstrap.cc:492] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.294153  5994 ts_tablet_manager.cc:1403] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.015s
I20260709 13:16:23.296646  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.297729  5836 raft_consensus.cc:2468] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:23.298321  5995 tablet_bootstrap.cc:654] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.298086  5994 raft_consensus.cc:359] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.299190  5994 raft_consensus.cc:385] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.299641  5994 raft_consensus.cc:740] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.300101  5979 leader_election.cc:290] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.301205  5982 raft_consensus.cc:3060] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.300825  5994 consensus_queue.cc:260] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.304437  5994 ts_tablet_manager.cc:1434] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:16:23.305568  5994 tablet_bootstrap.cc:492] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.305923  5995 tablet_bootstrap.cc:492] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.307166  5995 ts_tablet_manager.cc:1403] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:16:23.308876  5996 tablet_bootstrap.cc:492] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.309535  5996 ts_tablet_manager.cc:1403] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.016s
I20260709 13:16:23.311056  5995 raft_consensus.cc:359] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.311935  5995 raft_consensus.cc:385] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.312255  5995 raft_consensus.cc:740] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.313217  5996 raft_consensus.cc:359] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.313299  5995 consensus_queue.cc:260] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.313941  5994 tablet_bootstrap.cc:654] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.314263  5996 raft_consensus.cc:385] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.314687  5996 raft_consensus.cc:740] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.315497  5996 consensus_queue.cc:260] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.316457  5995 ts_tablet_manager.cc:1434] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:23.317857  5995 tablet_bootstrap.cc:492] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.318380  5996 ts_tablet_manager.cc:1434] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:16:23.319923  5996 tablet_bootstrap.cc:492] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.324275  5993 raft_consensus.cc:493] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.324911  5993 raft_consensus.cc:515] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.326704  5995 tablet_bootstrap.cc:654] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.330060  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6550667d273249d8a9f883f65be91a45" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.330971  5688 raft_consensus.cc:2468] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:23.331832  5996 tablet_bootstrap.cc:654] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.333182  5726 leader_election.cc:304] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.334689  5981 raft_consensus.cc:2804] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.335163  5981 raft_consensus.cc:493] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.335587  5981 raft_consensus.cc:3060] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.340044  5995 tablet_bootstrap.cc:492] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.340636  5995 ts_tablet_manager.cc:1403] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.015s
I20260709 13:16:23.344374  5993 leader_election.cc:290] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.348223  5995 raft_consensus.cc:359] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.349102  5995 raft_consensus.cc:385] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.349476  5995 raft_consensus.cc:740] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.313815  5982 raft_consensus.cc:515] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.351742  5995 consensus_queue.cc:260] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.355386  5995 ts_tablet_manager.cc:1434] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.001s
I20260709 13:16:23.356510  5995 tablet_bootstrap.cc:492] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.357810  5994 tablet_bootstrap.cc:492] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.358538  5994 ts_tablet_manager.cc:1403] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.006s
I20260709 13:16:23.362059  5996 tablet_bootstrap.cc:492] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.362764  5996 ts_tablet_manager.cc:1403] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.006s
I20260709 13:16:23.362774  5994 raft_consensus.cc:359] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.363852  5995 tablet_bootstrap.cc:654] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.363924  5994 raft_consensus.cc:385] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.364666  5994 raft_consensus.cc:740] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.365587  5994 consensus_queue.cc:260] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.366626  5996 raft_consensus.cc:359] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.367427  5996 raft_consensus.cc:385] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.367731  5996 raft_consensus.cc:740] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.368585  5996 consensus_queue.cc:260] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.369062  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6550667d273249d8a9f883f65be91a45" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.370098  5836 raft_consensus.cc:2468] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:23.371384  5996 ts_tablet_manager.cc:1434] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:16:23.372293  5994 ts_tablet_manager.cc:1434] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:16:23.372668  5996 tablet_bootstrap.cc:492] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.373581  5994 tablet_bootstrap.cc:492] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.374810  5981 raft_consensus.cc:515] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.378636  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6550667d273249d8a9f883f65be91a45" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:23.379319  5688 raft_consensus.cc:3060] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.382552  5981 leader_election.cc:290] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.390245  5688 raft_consensus.cc:2468] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:23.387267  5996 tablet_bootstrap.cc:654] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.394012  6008 raft_consensus.cc:493] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.398089  5726 leader_election.cc:304] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.398290  6008 raft_consensus.cc:515] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.399073  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6550667d273249d8a9f883f65be91a45" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:23.399876  5837 raft_consensus.cc:3060] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.401629  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:23.402290  5836 raft_consensus.cc:3060] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.399308  5981 raft_consensus.cc:2804] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:23.403079  5981 raft_consensus.cc:697] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:23.404165  5981 consensus_queue.cc:237] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.396237  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:23.405642  5763 raft_consensus.cc:3060] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.405705  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.406517  5966 raft_consensus.cc:493] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.407079  5966 raft_consensus.cc:515] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
W20260709 13:16:23.407948  5729 leader_election.cc:343] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:23.410804  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad453434a5e84c7babf1074793c73691" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.411944  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.413019  5686 raft_consensus.cc:2468] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:23.420209  5995 tablet_bootstrap.cc:492] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
W20260709 13:16:23.420944  5800 leader_election.cc:343] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:23.421795  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad453434a5e84c7babf1074793c73691" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
W20260709 13:16:23.430452  5802 leader_election.cc:343] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:23.431084  5802 leader_election.cc:304] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:23.422940  5726 leader_election.cc:304] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:23.414590  5966 leader_election.cc:290] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:23.416750  6008 leader_election.cc:290] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.425096  5837 raft_consensus.cc:2468] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:23.414783  5982 leader_election.cc:290] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.440245  5995 ts_tablet_manager.cc:1403] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.021s
I20260709 13:16:23.447373  5993 raft_consensus.cc:2804] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.451006  5996 tablet_bootstrap.cc:492] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.438990  5966 raft_consensus.cc:2749] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:23.453354  5993 raft_consensus.cc:493] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.454885  5993 raft_consensus.cc:3060] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.455108  5996 ts_tablet_manager.cc:1403] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.030s
I20260709 13:16:23.459287  5996 raft_consensus.cc:359] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.460287  5996 raft_consensus.cc:385] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.460660  5996 raft_consensus.cc:740] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.461702  5836 raft_consensus.cc:2468] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:23.461670  5996 consensus_queue.cc:260] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.463754  5654 leader_election.cc:304] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:23.464715  5996 ts_tablet_manager.cc:1434] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:23.465648  6005 raft_consensus.cc:2804] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:23.466043  5996 tablet_bootstrap.cc:492] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.459970  5994 tablet_bootstrap.cc:654] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.466413  6005 raft_consensus.cc:697] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:23.466368  5993 raft_consensus.cc:515] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.470639  5993 leader_election.cc:290] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.469484  6005 consensus_queue.cc:237] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.471820  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:23.472504  5686 raft_consensus.cc:3060] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.477211  5966 raft_consensus.cc:493] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.477790  5966 raft_consensus.cc:515] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.480000  5966 leader_election.cc:290] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:23.481817  5686 raft_consensus.cc:2468] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:23.481449  5586 catalog_manager.cc:5697] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.483361  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "babf3691edac41fa99725dd0eff17526" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.485019  5726 leader_election.cc:304] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
W20260709 13:16:23.486202  5800 leader_election.cc:343] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:23.486407  5981 raft_consensus.cc:2804] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:23.487015  5981 raft_consensus.cc:697] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:23.490334  5763 raft_consensus.cc:2468] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:23.493337  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:23.500659  5995 raft_consensus.cc:359] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
W20260709 13:16:23.494899  5802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.150.130:40223, user_credentials={real_user=slave}} blocked reactor thread for 64682.4us
I20260709 13:16:23.506016  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "babf3691edac41fa99725dd0eff17526" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
W20260709 13:16:23.507697  5729 leader_election.cc:343] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:23.507891  5802 leader_election.cc:343] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:23.508414  5802 leader_election.cc:304] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:23.509387  6012 raft_consensus.cc:2749] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:23.503966  5995 raft_consensus.cc:385] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.510136  5995 raft_consensus.cc:740] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.510986  5995 consensus_queue.cc:260] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.513058  5995 ts_tablet_manager.cc:1434] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 13:16:23.492847  5996 tablet_bootstrap.cc:654] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.513447  5584 catalog_manager.cc:5697] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.515581  5995 tablet_bootstrap.cc:492] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
W20260709 13:16:23.522962  5634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:23.526692  5995 tablet_bootstrap.cc:654] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.538667  5981 consensus_queue.cc:237] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.552237  5994 tablet_bootstrap.cc:492] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.553272  5994 ts_tablet_manager.cc:1403] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.180s	user 0.011s	sys 0.030s
I20260709 13:16:23.562870  5994 raft_consensus.cc:359] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.563781  5994 raft_consensus.cc:385] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.564122  5994 raft_consensus.cc:740] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.565032  5994 consensus_queue.cc:260] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.567754  5994 ts_tablet_manager.cc:1434] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 13:16:23.568214  5995 tablet_bootstrap.cc:492] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.569007  5994 tablet_bootstrap.cc:492] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.569087  5995 ts_tablet_manager.cc:1403] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.023s
I20260709 13:16:23.573189  5995 raft_consensus.cc:359] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.568401  5996 tablet_bootstrap.cc:492] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.574986  5996 ts_tablet_manager.cc:1403] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.025s
I20260709 13:16:23.574159  5995 raft_consensus.cc:385] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.578655  5994 tablet_bootstrap.cc:654] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.578694  5995 raft_consensus.cc:740] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.581274  5996 raft_consensus.cc:359] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.582468  5996 raft_consensus.cc:385] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.582847  5996 raft_consensus.cc:740] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.580137  5995 consensus_queue.cc:260] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.591944  5995 ts_tablet_manager.cc:1434] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:16:23.593181  5995 tablet_bootstrap.cc:492] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.593942  5994 tablet_bootstrap.cc:492] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.594583  5994 ts_tablet_manager.cc:1403] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 13:16:23.583957  5996 consensus_queue.cc:260] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.600160  5995 tablet_bootstrap.cc:654] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.597985  5994 raft_consensus.cc:359] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.601086  5994 raft_consensus.cc:385] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.601428  5994 raft_consensus.cc:740] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.602252  5996 ts_tablet_manager.cc:1434] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:16:23.603263  5994 consensus_queue.cc:260] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.603760  5996 tablet_bootstrap.cc:492] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.605870  5994 ts_tablet_manager.cc:1434] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:16:23.607024  5994 tablet_bootstrap.cc:492] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.614655  5994 tablet_bootstrap.cc:654] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.615343  5996 tablet_bootstrap.cc:654] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.636916  5996 tablet_bootstrap.cc:492] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.639722  5996 ts_tablet_manager.cc:1403] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.016s
I20260709 13:16:23.644701  5996 raft_consensus.cc:359] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.646296  5996 raft_consensus.cc:385] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.646821  5996 raft_consensus.cc:740] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.648020  5996 consensus_queue.cc:260] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.618209  5583 catalog_manager.cc:5697] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.652199  5996 ts_tablet_manager.cc:1434] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:16:23.660419  5996 tablet_bootstrap.cc:492] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.672149  5996 tablet_bootstrap.cc:654] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.672209  5994 tablet_bootstrap.cc:492] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.672955  5994 ts_tablet_manager.cc:1403] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.043s
I20260709 13:16:23.673707  5995 tablet_bootstrap.cc:492] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.674399  5995 ts_tablet_manager.cc:1403] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.081s	user 0.052s	sys 0.024s
I20260709 13:16:23.676847  5994 raft_consensus.cc:359] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.677778  5994 raft_consensus.cc:385] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.678102  5994 raft_consensus.cc:740] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.678148  5995 raft_consensus.cc:359] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.679045  5995 raft_consensus.cc:385] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.679076  5994 consensus_queue.cc:260] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.679411  5995 raft_consensus.cc:740] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.681499  5995 consensus_queue.cc:260] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.683000  5994 ts_tablet_manager.cc:1434] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:16:23.684123  5995 ts_tablet_manager.cc:1434] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:23.684283  5994 tablet_bootstrap.cc:492] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.685458  5995 tablet_bootstrap.cc:492] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.693262  5994 tablet_bootstrap.cc:654] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.694010  5995 tablet_bootstrap.cc:654] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.705669  5996 tablet_bootstrap.cc:492] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.706290  5996 ts_tablet_manager.cc:1403] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.019s
I20260709 13:16:23.713696  5996 raft_consensus.cc:359] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.714569  5996 raft_consensus.cc:385] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.714903  5996 raft_consensus.cc:740] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.715271  5994 tablet_bootstrap.cc:492] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.715376  5995 tablet_bootstrap.cc:492] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.716092  5995 ts_tablet_manager.cc:1403] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.011s
I20260709 13:16:23.716037  5994 ts_tablet_manager.cc:1403] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.002s
I20260709 13:16:23.715763  5996 consensus_queue.cc:260] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.718712  5996 ts_tablet_manager.cc:1434] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:23.719766  5995 raft_consensus.cc:359] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.720196  5996 tablet_bootstrap.cc:492] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.720558  5995 raft_consensus.cc:385] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.720978  5995 raft_consensus.cc:740] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.720260  5994 raft_consensus.cc:359] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.722088  5994 raft_consensus.cc:385] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.722519  5994 raft_consensus.cc:740] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.723536  5994 consensus_queue.cc:260] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.726188  5994 ts_tablet_manager.cc:1434] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:23.721765  5995 consensus_queue.cc:260] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.727774  5994 tablet_bootstrap.cc:492] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.728675  5995 ts_tablet_manager.cc:1434] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:16:23.730535  5995 tablet_bootstrap.cc:492] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab: Bootstrap starting.
I20260709 13:16:23.731801  5996 tablet_bootstrap.cc:654] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.736214  5994 tablet_bootstrap.cc:654] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.737700  5995 tablet_bootstrap.cc:654] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.759801  5996 tablet_bootstrap.cc:492] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.760268  5995 tablet_bootstrap.cc:492] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab: No bootstrap required, opened a new log
I20260709 13:16:23.760427  5996 ts_tablet_manager.cc:1403] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.010s
I20260709 13:16:23.761016  5995 ts_tablet_manager.cc:1403] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260709 13:16:23.764107  5996 raft_consensus.cc:359] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.764549  5995 raft_consensus.cc:359] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.765339  5995 raft_consensus.cc:385] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.765661  5995 raft_consensus.cc:740] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.765033  5996 raft_consensus.cc:385] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.766101  5996 raft_consensus.cc:740] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.766969  5996 consensus_queue.cc:260] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.766973  5995 consensus_queue.cc:260] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.769064  6012 raft_consensus.cc:493] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.769398  5996 ts_tablet_manager.cc:1434] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:16:23.769538  6012 raft_consensus.cc:515] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.770939  5996 tablet_bootstrap.cc:492] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36: Bootstrap starting.
I20260709 13:16:23.772348  5995 ts_tablet_manager.cc:1434] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 13:16:23.772742  5994 tablet_bootstrap.cc:492] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.773355  5994 ts_tablet_manager.cc:1403] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.011s
I20260709 13:16:23.775157  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.775696  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:23.776007  5686 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:23.777472  5800 leader_election.cc:304] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:23.778366  5966 raft_consensus.cc:2804] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.775409  6012 leader_election.cc:290] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:23.778816  5966 raft_consensus.cc:493] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.779263  5966 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.779323  5994 raft_consensus.cc:359] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.780176  5994 raft_consensus.cc:385] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.780475  5994 raft_consensus.cc:740] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.781332  5994 consensus_queue.cc:260] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.782338  5763 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:23.783721  5994 ts_tablet_manager.cc:1434] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:16:23.785795  5994 tablet_bootstrap.cc:492] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45: Bootstrap starting.
I20260709 13:16:23.793454  5994 tablet_bootstrap.cc:654] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.793591  5966 raft_consensus.cc:515] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.795145  5996 tablet_bootstrap.cc:654] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:23.797891  6013 raft_consensus.cc:493] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.798813  6013 raft_consensus.cc:515] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.800552  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:23.801937  6005 raft_consensus.cc:493] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.802587  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c957d4a3f4471da2079c384a18a5a7" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.802703  6005 raft_consensus.cc:515] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.803390  6013 leader_election.cc:290] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.803825  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c957d4a3f4471da2079c384a18a5a7" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.804575  5837 raft_consensus.cc:2468] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:23.805460  6005 leader_election.cc:290] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.806836  5729 leader_election.cc:304] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.806979  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.807687  5837 raft_consensus.cc:2468] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:23.808391  6013 raft_consensus.cc:2804] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.808835  6013 raft_consensus.cc:493] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.809203  6013 raft_consensus.cc:3060] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.809374  5654 leader_election.cc:304] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:23.803421  5688 raft_consensus.cc:2468] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:23.811932  6005 raft_consensus.cc:2804] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.812353  6005 raft_consensus.cc:493] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.812770  6005 raft_consensus.cc:3060] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.814101  5686 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.814941  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
W20260709 13:16:23.816977  5653 leader_election.cc:343] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:23.820534  5996 tablet_bootstrap.cc:492] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36: No bootstrap required, opened a new log
I20260709 13:16:23.821220  5996 ts_tablet_manager.cc:1403] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.015s
I20260709 13:16:23.821328  5981 consensus_queue.cc:1048] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.824960  5996 raft_consensus.cc:359] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.825752  5996 raft_consensus.cc:385] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.826108  5996 raft_consensus.cc:740] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.827242  5996 consensus_queue.cc:260] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.828987  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:23.829885  5763 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.830013  5996 ts_tablet_manager.cc:1434] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:23.832883  5994 tablet_bootstrap.cc:492] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45: No bootstrap required, opened a new log
I20260709 13:16:23.833500  5994 ts_tablet_manager.cc:1403] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.009s
I20260709 13:16:23.836992  5994 raft_consensus.cc:359] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.837709  5994 raft_consensus.cc:385] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:23.838037  5994 raft_consensus.cc:740] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.838567  5966 leader_election.cc:290] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:23.839013  5994 consensus_queue.cc:260] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.841590  5994 ts_tablet_manager.cc:1434] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:23.841495  6012 raft_consensus.cc:493] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.842289  6012 raft_consensus.cc:515] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.844333  5993 consensus_queue.cc:1048] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.840936  5686 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 1.
I20260709 13:16:23.837834  6013 raft_consensus.cc:515] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.845800  6012 leader_election.cc:290] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:23.848395  6013 leader_election.cc:290] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.849841  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c957d4a3f4471da2079c384a18a5a7" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:23.848390  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c957d4a3f4471da2079c384a18a5a7" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:23.850481  5835 raft_consensus.cc:3060] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.850867  5688 raft_consensus.cc:3060] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.856949  5687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.857872  5687 raft_consensus.cc:2393] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed7c43bfd1cc4ad7893413f1984e9eab in current term 1: Already voted for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in this term.
I20260709 13:16:23.859290  5800 leader_election.cc:304] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:23.859639  5835 raft_consensus.cc:2468] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:23.860944  5729 leader_election.cc:304] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.861847  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:23.865155  6013 raft_consensus.cc:2804] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:23.865693  6013 raft_consensus.cc:697] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:23.867425  5802 leader_election.cc:304] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:23.868081  5688 raft_consensus.cc:2468] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:23.868554  5966 raft_consensus.cc:2804] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:23.867527  6013 consensus_queue.cc:237] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.875430  6012 raft_consensus.cc:3060] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.876974  5982 raft_consensus.cc:493] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.877673  5982 raft_consensus.cc:515] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.880522  5982 leader_election.cc:290] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.882925  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad453434a5e84c7babf1074793c73691" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:23.883750  5762 raft_consensus.cc:2468] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:23.885607  5653 leader_election.cc:304] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.887080  5982 raft_consensus.cc:2804] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.887612  5982 raft_consensus.cc:493] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.888010  5982 raft_consensus.cc:3060] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.894083  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad453434a5e84c7babf1074793c73691" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.895082  5837 raft_consensus.cc:2468] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:23.897513  5979 consensus_queue.cc:1048] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.903688  5763 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 1.
I20260709 13:16:23.909096  5586 catalog_manager.cc:5697] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.938987  5993 raft_consensus.cc:493] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.939900  5993 raft_consensus.cc:515] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.941913  5979 consensus_queue.cc:1048] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.945219  5979 raft_consensus.cc:493] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.945837  5979 raft_consensus.cc:515] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.928699  6005 raft_consensus.cc:515] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.954843  6042 raft_consensus.cc:493] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.955547  6042 raft_consensus.cc:515] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.955875  5993 leader_election.cc:290] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.957973  6042 leader_election.cc:290] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:23.959414  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "babf3691edac41fa99725dd0eff17526" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.960294  5834 raft_consensus.cc:2468] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:23.960199  5982 raft_consensus.cc:515] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.960781  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:23.961565  5763 raft_consensus.cc:2468] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:23.963061  5802 leader_election.cc:304] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.963230  5982 leader_election.cc:290] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.963073  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "babf3691edac41fa99725dd0eff17526" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.955554  5979 leader_election.cc:290] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.964840  5686 raft_consensus.cc:2468] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 0.
I20260709 13:16:23.964599  6012 raft_consensus.cc:2749] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:23.964154  6042 raft_consensus.cc:2804] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.972558  5966 raft_consensus.cc:697] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:23.977509  5966 consensus_queue.cc:237] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:23.966387  5729 leader_election.cc:304] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:23.971180  6042 raft_consensus.cc:493] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.986554  6008 raft_consensus.cc:2804] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.988514  6008 raft_consensus.cc:493] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.988962  6008 raft_consensus.cc:3060] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.995043  6005 leader_election.cc:290] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:23.998072  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:23.998229  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" is_pre_election: true
I20260709 13:16:23.998814  5833 raft_consensus.cc:3060] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.999956  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36" is_pre_election: true
I20260709 13:16:23.990929  6042 raft_consensus.cc:3060] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.995186  5993 consensus_queue.cc:1048] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.002094  5686 raft_consensus.cc:2468] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 0.
I20260709 13:16:24.009860  5762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" is_pre_election: true
I20260709 13:16:24.012562  5761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad453434a5e84c7babf1074793c73691" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:24.015518  5761 raft_consensus.cc:3060] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:24.015621  5762 raft_consensus.cc:2468] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 0.
I20260709 13:16:24.016739  5760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:24.020150  5760 raft_consensus.cc:3060] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:24.009995  5833 raft_consensus.cc:2468] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:24.002177  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad453434a5e84c7babf1074793c73691" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:24.029388  6008 raft_consensus.cc:515] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.031613  5835 raft_consensus.cc:3060] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:24.036001  5760 raft_consensus.cc:2468] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:24.036108  5654 leader_election.cc:304] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:24.037302  5982 raft_consensus.cc:2804] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:24.041834  5653 leader_election.cc:304] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:24.044938  5979 raft_consensus.cc:2804] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:24.045334  5979 raft_consensus.cc:493] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.046255  5979 raft_consensus.cc:3060] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:24.037846  5982 raft_consensus.cc:697] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:24.059901  5981 consensus_queue.cc:1048] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:24.053378  5582 catalog_manager.cc:5697] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 0 to 1, leader changed from <none> to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 1 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.066654  5982 consensus_queue.cc:237] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.071630  5979 raft_consensus.cc:515] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.075937  6008 leader_election.cc:290] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:24.076925  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:24.059664  5761 raft_consensus.cc:2468] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:24.079730  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "babf3691edac41fa99725dd0eff17526" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:24.080380  5833 raft_consensus.cc:3060] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:24.068425  5835 raft_consensus.cc:2468] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:24.080401  5979 leader_election.cc:290] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:24.074679  6042 raft_consensus.cc:515] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.081795  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:24.081991  5654 leader_election.cc:304] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:24.082362  5836 raft_consensus.cc:2393] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a7401e4a5d24132baf8d796e2662d36 in current term 1: Already voted for candidate ed7c43bfd1cc4ad7893413f1984e9eab in this term.
I20260709 13:16:24.082471  5763 raft_consensus.cc:3060] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:24.083271  6041 raft_consensus.cc:2804] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:24.083530  6042 leader_election.cc:290] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:24.083849  6041 raft_consensus.cc:697] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:24.084906  6041 consensus_queue.cc:237] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.089847  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:24.090744  5688 raft_consensus.cc:2393] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed7c43bfd1cc4ad7893413f1984e9eab in current term 1: Already voted for candidate 5a7401e4a5d24132baf8d796e2662d36 in this term.
I20260709 13:16:24.092027  5761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:24.093689  5802 leader_election.cc:304] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:24.095139  6042 raft_consensus.cc:2749] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:24.096418  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "babf3691edac41fa99725dd0eff17526" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:24.097395  5688 raft_consensus.cc:3060] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:24.110981  5584 catalog_manager.cc:5697] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.122521  5688 raft_consensus.cc:2468] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:24.125859  5763 raft_consensus.cc:2468] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 1.
I20260709 13:16:24.128350  5726 leader_election.cc:304] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:24.137194  5993 raft_consensus.cc:2804] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:24.137548  5653 leader_election.cc:304] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:24.138541  5993 raft_consensus.cc:697] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:24.140295  6041 raft_consensus.cc:2804] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:24.140024  5993 consensus_queue.cc:237] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.140980  6041 raft_consensus.cc:697] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:24.142007  6041 consensus_queue.cc:237] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.147898  5833 raft_consensus.cc:2468] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 1.
I20260709 13:16:24.150532  5582 catalog_manager.cc:5697] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.171430  5586 catalog_manager.cc:5697] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 1 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.182384  5583 catalog_manager.cc:5697] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.316992  5993 consensus_queue.cc:1048] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:24.329663  6013 consensus_queue.cc:1048] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.365031  6042 consensus_queue.cc:1048] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:24.377094  6042 consensus_queue.cc:1048] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.445055  5763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6550667d273249d8a9f883f65be91a45"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
mode: GRACEFUL
new_leader_uuid: "5a7401e4a5d24132baf8d796e2662d36"
 from {username='slave'} at 127.0.0.1:37776
I20260709 13:16:24.445943  5763 raft_consensus.cc:606] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Received request to transfer leadership to TS 5a7401e4a5d24132baf8d796e2662d36
I20260709 13:16:24.457981  5763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
mode: GRACEFUL
new_leader_uuid: "5a7401e4a5d24132baf8d796e2662d36"
 from {username='slave'} at 127.0.0.1:37776
I20260709 13:16:24.458766  5763 raft_consensus.cc:606] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Received request to transfer leadership to TS 5a7401e4a5d24132baf8d796e2662d36
I20260709 13:16:24.470515  5837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
mode: GRACEFUL
new_leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
 from {username='slave'} at 127.0.0.1:52560
I20260709 13:16:24.471231  5837 raft_consensus.cc:606] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Received request to transfer leadership to TS ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:24.476878  5688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
mode: GRACEFUL
new_leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
 from {username='slave'} at 127.0.0.1:51186
I20260709 13:16:24.477545  5688 raft_consensus.cc:606] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Received request to transfer leadership to TS ff4bbe6dda6f4dc495ce74f02673cb45
I20260709 13:16:24.483923  5688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
mode: GRACEFUL
new_leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:51186
I20260709 13:16:24.484449  5688 raft_consensus.cc:606] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Received request to transfer leadership to TS ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:24.529966  6041 consensus_queue.cc:1048] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.543561  6041 consensus_queue.cc:1048] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.560158  5979 consensus_queue.cc:1048] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:24.568333  6005 raft_consensus.cc:993] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: : Instructing follower ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:24.568953  6005 raft_consensus.cc:1081] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Signalling peer ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:24.574673  5837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:16:24.576375  5837 raft_consensus.cc:493] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.576877  5837 raft_consensus.cc:3060] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.578971  6005 consensus_queue.cc:1048] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.587100  5837 raft_consensus.cc:515] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.592857  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:24.593515  5688 raft_consensus.cc:3055] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.593307  6013 consensus_queue.cc:1048] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.593956  5688 raft_consensus.cc:740] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:24.594914  5688 consensus_queue.cc:260] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.596191  5688 raft_consensus.cc:3060] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.607653  5837 leader_election.cc:290] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 2 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:24.610062  5688 raft_consensus.cc:2468] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 2.
I20260709 13:16:24.612026  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f5edc99d3b40259b4f5a06ed104d93" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:24.615785  5763 raft_consensus.cc:3060] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.616133  6005 consensus_queue.cc:1048] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:24.614711  6013 consensus_queue.cc:1048] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:24.624714  5763 raft_consensus.cc:2468] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 2.
I20260709 13:16:24.626502  5802 leader_election.cc:304] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:24.627820  6042 raft_consensus.cc:2804] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.628373  6042 raft_consensus.cc:697] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:24.629253  6042 consensus_queue.cc:237] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.630612  6041 raft_consensus.cc:993] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: : Instructing follower ff4bbe6dda6f4dc495ce74f02673cb45 to start an election
I20260709 13:16:24.631143  6041 raft_consensus.cc:1081] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Signalling peer ff4bbe6dda6f4dc495ce74f02673cb45 to start an election
I20260709 13:16:24.635529  5763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:16:24.636122  5763 raft_consensus.cc:493] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.636495  5763 raft_consensus.cc:3060] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.637225  6005 consensus_queue.cc:1048] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:24.642661  5582 catalog_manager.cc:5697] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 1 to 2, leader changed from 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129) to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 2 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.644889  5763 raft_consensus.cc:515] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.646155  5761 raft_consensus.cc:1240] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Rejecting Update request from peer 5a7401e4a5d24132baf8d796e2662d36 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:24.648128  6005 consensus_queue.cc:1059] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:24.648954  6005 raft_consensus.cc:3055] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.649247  6005 raft_consensus.cc:740] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:24.650066  6005 consensus_queue.cc:260] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.651032  5763 leader_election.cc:290] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 2 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:24.651155  6005 raft_consensus.cc:3060] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.652056  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:24.654927  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374bd357d576455d9f86a8bfb6e6d322" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:24.655556  5833 raft_consensus.cc:3060] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.662009  5833 raft_consensus.cc:2468] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 2.
I20260709 13:16:24.663292  5729 leader_election.cc:304] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:24.664196  6013 raft_consensus.cc:2804] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.664727  6013 raft_consensus.cc:697] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:24.665647  6013 consensus_queue.cc:237] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.670967  5686 raft_consensus.cc:2468] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 2.
I20260709 13:16:24.675081  5582 catalog_manager.cc:5697] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 1 to 2, leader changed from 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129) to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.748795  6008 raft_consensus.cc:993] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: : Instructing follower 5a7401e4a5d24132baf8d796e2662d36 to start an election
I20260709 13:16:24.749342  6013 raft_consensus.cc:1081] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Signalling peer 5a7401e4a5d24132baf8d796e2662d36 to start an election
I20260709 13:16:24.751021  5688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
 from {username='slave'} at 127.0.0.1:51182
I20260709 13:16:24.751523  5688 raft_consensus.cc:493] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.751770  5688 raft_consensus.cc:3060] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.758183  5688 raft_consensus.cc:515] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.759970  5688 leader_election.cc:290] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:24.761054  5763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:24.761242  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968a336b087a4b6db2ac7ea55617e535" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:24.761782  5763 raft_consensus.cc:3055] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.761909  5833 raft_consensus.cc:3060] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.762068  5763 raft_consensus.cc:740] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:24.762992  5763 consensus_queue.cc:260] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.764068  5763 raft_consensus.cc:3060] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.768996  5833 raft_consensus.cc:2468] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 2.
I20260709 13:16:24.769857  5763 raft_consensus.cc:2468] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 2.
I20260709 13:16:24.770563  5654 leader_election.cc:304] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:24.771571  6005 raft_consensus.cc:2804] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.772111  6005 raft_consensus.cc:697] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:24.773042  6005 consensus_queue.cc:237] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.780879  5583 catalog_manager.cc:5697] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 1 to 2, leader changed from ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130) to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.795176  6037 raft_consensus.cc:993] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: : Instructing follower ff4bbe6dda6f4dc495ce74f02673cb45 to start an election
I20260709 13:16:24.795783  6042 raft_consensus.cc:1081] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Signalling peer ff4bbe6dda6f4dc495ce74f02673cb45 to start an election
I20260709 13:16:24.795982  6008 raft_consensus.cc:993] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: : Instructing follower 5a7401e4a5d24132baf8d796e2662d36 to start an election
I20260709 13:16:24.796634  6013 raft_consensus.cc:1081] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Signalling peer 5a7401e4a5d24132baf8d796e2662d36 to start an election
I20260709 13:16:24.797669  5763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
 from {username='slave'} at 127.0.0.1:37760
I20260709 13:16:24.798321  5763 raft_consensus.cc:493] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.798218  5688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6550667d273249d8a9f883f65be91a45"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
 from {username='slave'} at 127.0.0.1:51182
I20260709 13:16:24.798960  5763 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.799119  5688 raft_consensus.cc:493] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.799553  5688 raft_consensus.cc:3060] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.807286  5763 raft_consensus.cc:515] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.807286  5688 raft_consensus.cc:515] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.809605  5688 leader_election.cc:290] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Requested vote from peers ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:24.810057  5763 leader_election.cc:290] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 2 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131:34975)
I20260709 13:16:24.810472  5761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6550667d273249d8a9f883f65be91a45" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:24.810810  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:24.811187  5761 raft_consensus.cc:3055] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.811474  5833 raft_consensus.cc:3055] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.811568  5761 raft_consensus.cc:740] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:24.811920  5833 raft_consensus.cc:740] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:24.812566  5761 consensus_queue.cc:260] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.812844  5833 consensus_queue.cc:260] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.813884  5761 raft_consensus.cc:3060] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.814266  5833 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.815629  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6550667d273249d8a9f883f65be91a45" candidate_uuid: "5a7401e4a5d24132baf8d796e2662d36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
I20260709 13:16:24.816294  5837 raft_consensus.cc:3060] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.816409  5688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:24.817157  5688 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.822227  5761 raft_consensus.cc:2468] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 2.
I20260709 13:16:24.822227  5833 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 2.
I20260709 13:16:24.823936  5729 leader_election.cc:304] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:24.823936  5653 leader_election.cc:304] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:24.824600  5837 raft_consensus.cc:2468] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7401e4a5d24132baf8d796e2662d36 in term 2.
I20260709 13:16:24.825098  6005 raft_consensus.cc:2804] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.825032  5688 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4bbe6dda6f4dc495ce74f02673cb45 in term 2.
I20260709 13:16:24.825984  6005 raft_consensus.cc:697] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Becoming Leader. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:24.827029  6005 consensus_queue.cc:237] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.825023  6013 raft_consensus.cc:2804] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.829838  6013 raft_consensus.cc:697] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Becoming Leader. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:24.830762  6013 consensus_queue.cc:237] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:24.836654  5583 catalog_manager.cc:5697] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 reported cstate change: term changed from 1 to 2, leader changed from ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130) to 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "5a7401e4a5d24132baf8d796e2662d36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.844509  5582 catalog_manager.cc:5697] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 reported cstate change: term changed from 1 to 2, leader changed from ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131) to ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130). New cstate: current_term: 2 leader_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:25.139600  5688 raft_consensus.cc:1275] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.140936  6042 consensus_queue.cc:1048] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.154680  5761 raft_consensus.cc:1275] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.156288  6037 consensus_queue.cc:1048] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:25.157840  5761 raft_consensus.cc:1275] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.159835  5979 consensus_queue.cc:1048] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.172279  5837 raft_consensus.cc:1275] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.174017  5979 consensus_queue.cc:1048] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.200795  5837 raft_consensus.cc:1275] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Refusing update from remote peer ff4bbe6dda6f4dc495ce74f02673cb45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.202322  6008 consensus_queue.cc:1048] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:25.211782  5688 raft_consensus.cc:1275] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Refusing update from remote peer ff4bbe6dda6f4dc495ce74f02673cb45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.214098  5993 consensus_queue.cc:1048] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.259425  5761 raft_consensus.cc:1275] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.260888  5979 consensus_queue.cc:1048] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.271962  5837 raft_consensus.cc:1275] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Refusing update from remote peer 5a7401e4a5d24132baf8d796e2662d36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.273803  6005 consensus_queue.cc:1048] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.346807  5837 raft_consensus.cc:1275] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Refusing update from remote peer ff4bbe6dda6f4dc495ce74f02673cb45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.348408  5993 consensus_queue.cc:1048] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.358047  5688 raft_consensus.cc:1275] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Refusing update from remote peer ff4bbe6dda6f4dc495ce74f02673cb45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.360189  6013 consensus_queue.cc:1048] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.488600  5582 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50344:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:16:27.511852  5582 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50344:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:16:27.667120 28250 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:16:27.721161  5654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.131:34975, user_credentials={real_user=slave}} blocked reactor thread for 78167us
I20260709 13:16:27.747962  6104 tablet.cc:1724] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:27.762542  6115 tablet.cc:1724] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:27.805248  5789 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:48c957d4a3f4471da2079c384a18a5a7)
W20260709 13:16:27.829870  5789 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:48c957d4a3f4471da2079c384a18a5a7)
W20260709 13:16:27.831655  5789 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:48c957d4a3f4471da2079c384a18a5a7)
I20260709 13:16:27.834378  6120 tablet.cc:1724] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:27.855273  5653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:40223, user_credentials={real_user=slave}} blocked reactor thread for 98637.6us
I20260709 13:16:27.877869  6128 tablet.cc:1724] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:27.916421  6137 tablet.cc:1724] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:27.900254  6130 tablet.cc:1724] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:27.920166  6127 tablet.cc:1724] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:27.966750  6122 log.cc:927] Time spent T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:16:27.951937  6131 tablet.cc:1724] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.005653  6139 tablet.cc:1724] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:27.971884  6115 tablet.cc:1724] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.044464  6104 tablet.cc:1724] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.061571  5688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
mode: GRACEFUL
new_leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:45242
I20260709 13:16:28.062482  5688 raft_consensus.cc:606] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Received request to transfer leadership to TS ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:28.050773  6140 tablet.cc:1724] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.069749  6137 tablet.cc:1724] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.066848  6144 tablet.cc:1724] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.082098  6128 tablet.cc:1724] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:27.976732  6141 tablet.cc:1724] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.087204  6139 tablet.cc:1724] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.094630  6131 tablet.cc:1724] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:28.101384  5726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:33441, user_credentials={real_user=slave}} blocked reactor thread for 130696us
I20260709 13:16:28.117120  5582 catalog_manager.cc:5789] TS ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223) does not have the latest schema for tablet fe2df1837efc403889f4aed8d1b42366 (table soft_deleted_table [id=a619fac242b3448882f5c8b398b57100]). Expected version 1 got 0
I20260709 13:16:28.117157  6128 tablet.cc:1724] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.121918  6120 tablet.cc:1724] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.126415  6140 tablet.cc:1724] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.126834  6144 tablet.cc:1724] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.127398  6139 tablet.cc:1724] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.128304  6137 tablet.cc:1724] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.155530  6130 tablet.cc:1724] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.154225  6115 tablet.cc:1724] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.198783  6127 tablet.cc:1724] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:28.224334  5761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
mode: GRACEFUL
new_leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:40834
I20260709 13:16:28.225378  5761 raft_consensus.cc:606] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Received request to transfer leadership to TS ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:28.227340 28250 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:16:28.228214 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:28.228420  5583 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a: soft_deleted_table [id=a619fac242b3448882f5c8b398b57100] alter complete (version 1)
I20260709 13:16:28.244138  5686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4"
dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
mode: GRACEFUL
new_leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:45242
I20260709 13:16:28.244820  5686 raft_consensus.cc:606] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Received request to transfer leadership to TS ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:28.248502  5761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44fac40839f246dbac6642b9ec140018"
dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
mode: GRACEFUL
new_leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:40834
I20260709 13:16:28.249694  5761 raft_consensus.cc:606] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Received request to transfer leadership to TS ed7c43bfd1cc4ad7893413f1984e9eab
I20260709 13:16:28.251098 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:28.251835 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:28.346045  6129 raft_consensus.cc:993] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: : Instructing follower ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.346791  6110 raft_consensus.cc:1081] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Signalling peer ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.348488  5833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:16:28.349114  5833 raft_consensus.cc:493] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.349458  5833 raft_consensus.cc:3060] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.356937  5833 raft_consensus.cc:515] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.358958  5833 leader_election.cc:290] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 2 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:28.359774  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:28.360627  5686 raft_consensus.cc:3055] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:28.360737  5761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e87db6f54489698c75fc2a5ae8d98" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:28.361042  5686 raft_consensus.cc:740] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:28.361626  5761 raft_consensus.cc:3060] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.362170  5686 consensus_queue.cc:260] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.363969  5686 raft_consensus.cc:3060] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.365442  6078 raft_consensus.cc:993] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: : Instructing follower ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.366295  6148 raft_consensus.cc:1081] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Signalling peer ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.368116  5833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:16:28.368701  5833 raft_consensus.cc:493] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.369097  5833 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.371049  5761 raft_consensus.cc:2468] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 2.
I20260709 13:16:28.371538  5686 raft_consensus.cc:2468] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 2.
I20260709 13:16:28.372387  5802 leader_election.cc:304] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:28.373548  6075 raft_consensus.cc:2804] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:28.374040  6075 raft_consensus.cc:697] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:28.374989  6075 consensus_queue.cc:237] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.376770  5833 raft_consensus.cc:515] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.379045  5833 leader_election.cc:290] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 3 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:28.380079  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:28.380625  5761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2df1837efc403889f4aed8d1b42366" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:28.380779  5686 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.381268  5761 raft_consensus.cc:3055] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.381598  5761 raft_consensus.cc:740] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:28.382539  5761 consensus_queue.cc:260] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.383731  5761 raft_consensus.cc:3060] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.385159  5583 catalog_manager.cc:5697] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 1 to 2, leader changed from 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129) to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 2 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.390300  5686 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 3.
I20260709 13:16:28.391057  5761 raft_consensus.cc:2468] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 3.
I20260709 13:16:28.392259  5802 leader_election.cc:304] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:28.393281  6113 raft_consensus.cc:2804] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:28.393778  6113 raft_consensus.cc:697] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:28.394562  6113 consensus_queue.cc:237] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.402726  5583 catalog_manager.cc:5697] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 2 to 3, leader changed from ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130) to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 3 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.643900  6077 raft_consensus.cc:993] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36: : Instructing follower ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.644549  6077 raft_consensus.cc:1081] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Signalling peer ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.646338  5833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:16:28.646939  5833 raft_consensus.cc:493] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.647279  5833 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.653388  5833 raft_consensus.cc:515] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.655212  5833 leader_election.cc:290] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 3 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:28.656172  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:28.656594  5761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17918d5cb5064b149b51886b78b6afd4" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:28.657063  5686 raft_consensus.cc:3055] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.657323  5761 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.657512  5686 raft_consensus.cc:740] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a7401e4a5d24132baf8d796e2662d36, State: Running, Role: LEADER
I20260709 13:16:28.658546  5686 consensus_queue.cc:260] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.659845  5686 raft_consensus.cc:3060] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.664047  5761 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 3.
I20260709 13:16:28.665495  5802 leader_election.cc:304] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed7c43bfd1cc4ad7893413f1984e9eab, ff4bbe6dda6f4dc495ce74f02673cb45; no voters: 
I20260709 13:16:28.666142  5686 raft_consensus.cc:2468] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 3.
I20260709 13:16:28.666366  6113 raft_consensus.cc:2804] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:28.667186  6113 raft_consensus.cc:697] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:28.668134  6113 consensus_queue.cc:237] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.678519  5583 catalog_manager.cc:5697] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 2 to 3, leader changed from 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129) to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 3 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.721467  6078 raft_consensus.cc:993] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45: : Instructing follower ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.722064  6148 raft_consensus.cc:1081] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Signalling peer ed7c43bfd1cc4ad7893413f1984e9eab to start an election
I20260709 13:16:28.723694  5833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44fac40839f246dbac6642b9ec140018"
dest_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:16:28.724226  5833 raft_consensus.cc:493] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.724512  5833 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.730902  5833 raft_consensus.cc:515] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.732654  5833 leader_election.cc:290] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 3 election: Requested vote from peers 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441), ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223)
I20260709 13:16:28.733907  5761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45"
I20260709 13:16:28.733932  5686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fac40839f246dbac6642b9ec140018" candidate_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a7401e4a5d24132baf8d796e2662d36"
I20260709 13:16:28.734727  5761 raft_consensus.cc:3055] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.734776  5686 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.735212  5761 raft_consensus.cc:740] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff4bbe6dda6f4dc495ce74f02673cb45, State: Running, Role: LEADER
I20260709 13:16:28.736159  5761 consensus_queue.cc:260] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.737294  5761 raft_consensus.cc:3060] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.741604  5686 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 3.
I20260709 13:16:28.742935  5800 leader_election.cc:304] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7401e4a5d24132baf8d796e2662d36, ed7c43bfd1cc4ad7893413f1984e9eab; no voters: 
I20260709 13:16:28.743476  5761 raft_consensus.cc:2468] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed7c43bfd1cc4ad7893413f1984e9eab in term 3.
I20260709 13:16:28.743817  6113 raft_consensus.cc:2804] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:28.744436  6113 raft_consensus.cc:697] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 LEADER]: Becoming Leader. State: Replica: ed7c43bfd1cc4ad7893413f1984e9eab, State: Running, Role: LEADER
I20260709 13:16:28.745434  6113 consensus_queue.cc:237] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } }
I20260709 13:16:28.754654  5583 catalog_manager.cc:5697] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab reported cstate change: term changed from 2 to 3, leader changed from ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130) to ed7c43bfd1cc4ad7893413f1984e9eab (127.27.150.131). New cstate: current_term: 3 leader_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed7c43bfd1cc4ad7893413f1984e9eab" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.824889  5761 raft_consensus.cc:1275] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:28.826658  6113 consensus_queue.cc:1048] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.836073  5686 raft_consensus.cc:1275] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:28.838255  6113 consensus_queue.cc:1048] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:28.922698  5686 raft_consensus.cc:1275] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:28.924145  6113 consensus_queue.cc:1048] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:28.933813  5761 raft_consensus.cc:1275] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:28.935758  6113 consensus_queue.cc:1048] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.153343  5761 raft_consensus.cc:1275] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:29.154973  6113 consensus_queue.cc:1048] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.160375  5686 raft_consensus.cc:1275] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:29.162307  6157 consensus_queue.cc:1048] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.258220  5761 raft_consensus.cc:1275] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:29.259814  6157 consensus_queue.cc:1048] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4bbe6dda6f4dc495ce74f02673cb45" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.270938  5686 raft_consensus.cc:1275] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Refusing update from remote peer ed7c43bfd1cc4ad7893413f1984e9eab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:29.272990  6157 consensus_queue.cc:1048] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7401e4a5d24132baf8d796e2662d36" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 33441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.330912 28250 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:16:29.337432 28250 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:16:29.337859 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:29.344429 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:16:29.344821 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:30.377435 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
W20260709 13:16:30.391505  5800 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:16:30.396888  5800 consensus_peers.cc:597] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:30.397861  5800 consensus_peers.cc:597] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.424062 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:30.425326 28250 tablet_replica.cc:333] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.426549 28250 raft_consensus.cc:2243] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.427318 28250 raft_consensus.cc:2272] T babf3691edac41fa99725dd0eff17526 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.429949 28250 tablet_replica.cc:333] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.430819 28250 raft_consensus.cc:2243] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.431308 28250 raft_consensus.cc:2272] T fe2df1837efc403889f4aed8d1b42366 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.433495 28250 tablet_replica.cc:333] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.434165 28250 raft_consensus.cc:2243] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.434708 28250 raft_consensus.cc:2272] T 48c957d4a3f4471da2079c384a18a5a7 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.437510 28250 tablet_replica.cc:333] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.438437 28250 raft_consensus.cc:2243] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.439700 28250 raft_consensus.cc:2272] T ad453434a5e84c7babf1074793c73691 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.441991 28250 tablet_replica.cc:333] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.442723 28250 raft_consensus.cc:2243] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.443287 28250 raft_consensus.cc:2272] T 374bd357d576455d9f86a8bfb6e6d322 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.445545 28250 tablet_replica.cc:333] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.446233 28250 raft_consensus.cc:2243] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.447173 28250 raft_consensus.cc:2272] T 968a336b087a4b6db2ac7ea55617e535 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.449309 28250 tablet_replica.cc:333] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.449923 28250 raft_consensus.cc:2243] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.450891 28250 raft_consensus.cc:2272] T 6550667d273249d8a9f883f65be91a45 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.452979 28250 tablet_replica.cc:333] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.453689 28250 raft_consensus.cc:2243] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.454162 28250 raft_consensus.cc:2272] T 44fac40839f246dbac6642b9ec140018 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.456679 28250 tablet_replica.cc:333] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.457386 28250 raft_consensus.cc:2243] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.457897 28250 raft_consensus.cc:2272] T 53139aac7c8d4a1797facf74523f2106 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.461067 28250 tablet_replica.cc:333] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.461738 28250 raft_consensus.cc:2243] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.462915 28250 raft_consensus.cc:2272] T 663ec201952e45a597e7b91d5d4b1e0d P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.465713 28250 tablet_replica.cc:333] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.466370 28250 raft_consensus.cc:2243] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.466929 28250 raft_consensus.cc:2272] T 9061b29a602b48da9fba20b71503c213 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.469419 28250 tablet_replica.cc:333] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.470052 28250 raft_consensus.cc:2243] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.470597 28250 raft_consensus.cc:2272] T e13f513f4a9443c1ba392d85e007b6d2 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.473012 28250 tablet_replica.cc:333] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.473577 28250 raft_consensus.cc:2243] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.474056 28250 raft_consensus.cc:2272] T ea77ad41ef444dcdafe165724bea5920 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.476501 28250 tablet_replica.cc:333] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.477082 28250 raft_consensus.cc:2243] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.478055 28250 raft_consensus.cc:2272] T f9d9eda4cb9d4688bb812e68834073dc P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.480391 28250 tablet_replica.cc:333] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.480966 28250 raft_consensus.cc:2243] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.481949 28250 raft_consensus.cc:2272] T 9bc2af8629b64a0485ed32eeefbd5018 P 5a7401e4a5d24132baf8d796e2662d36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.485221 28250 tablet_replica.cc:333] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.486021 28250 raft_consensus.cc:2243] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.486685 28250 raft_consensus.cc:2272] T 35f5edc99d3b40259b4f5a06ed104d93 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.489385 28250 tablet_replica.cc:333] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.490111 28250 raft_consensus.cc:2243] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.490707 28250 raft_consensus.cc:2272] T 241e87db6f54489698c75fc2a5ae8d98 P 5a7401e4a5d24132baf8d796e2662d36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.493431 28250 tablet_replica.cc:333] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36: stopping tablet replica
I20260709 13:16:30.494113 28250 raft_consensus.cc:2243] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.494707 28250 raft_consensus.cc:2272] T 17918d5cb5064b149b51886b78b6afd4 P 5a7401e4a5d24132baf8d796e2662d36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.543439 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
W20260709 13:16:30.557571  5726 consensus_peers.cc:597] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:30.564399  5726 consensus_peers.cc:597] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.592043 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
W20260709 13:16:30.598585  5726 consensus_peers.cc:597] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:30.609622  5726 consensus_peers.cc:597] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:30.620519  5726 consensus_peers.cc:597] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.637470 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:30.638789 28250 tablet_replica.cc:333] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.639951 28250 raft_consensus.cc:2243] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.640708 28250 raft_consensus.cc:2272] T fe2df1837efc403889f4aed8d1b42366 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.643411 28250 tablet_replica.cc:333] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.644095 28250 raft_consensus.cc:2243] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.645112 28250 raft_consensus.cc:2272] T 374bd357d576455d9f86a8bfb6e6d322 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.647374 28250 tablet_replica.cc:333] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.648013 28250 raft_consensus.cc:2243] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.648454 28250 raft_consensus.cc:2272] T ad453434a5e84c7babf1074793c73691 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.650689 28250 tablet_replica.cc:333] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.651320 28250 raft_consensus.cc:2243] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.652281 28250 raft_consensus.cc:2272] T 48c957d4a3f4471da2079c384a18a5a7 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.654687 28250 tablet_replica.cc:333] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.655341 28250 raft_consensus.cc:2243] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.656229 28250 raft_consensus.cc:2272] T babf3691edac41fa99725dd0eff17526 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.658396 28250 tablet_replica.cc:333] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.659108 28250 raft_consensus.cc:2243] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.659627 28250 raft_consensus.cc:2272] T 968a336b087a4b6db2ac7ea55617e535 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.661778 28250 tablet_replica.cc:333] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.662410 28250 raft_consensus.cc:2243] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.662896 28250 raft_consensus.cc:2272] T 663ec201952e45a597e7b91d5d4b1e0d P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.665453 28250 tablet_replica.cc:333] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.666162 28250 raft_consensus.cc:2243] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.666664 28250 raft_consensus.cc:2272] T 44fac40839f246dbac6642b9ec140018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.669215 28250 tablet_replica.cc:333] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.669852 28250 raft_consensus.cc:2243] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.670861 28250 raft_consensus.cc:2272] T 53139aac7c8d4a1797facf74523f2106 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.673316 28250 tablet_replica.cc:333] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.673938 28250 raft_consensus.cc:2243] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.674427 28250 raft_consensus.cc:2272] T 6550667d273249d8a9f883f65be91a45 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.676630 28250 tablet_replica.cc:333] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.677294 28250 raft_consensus.cc:2243] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.677800 28250 raft_consensus.cc:2272] T f9d9eda4cb9d4688bb812e68834073dc P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.680249 28250 tablet_replica.cc:333] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.680861 28250 raft_consensus.cc:2243] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.681862 28250 raft_consensus.cc:2272] T ea77ad41ef444dcdafe165724bea5920 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.684651 28250 tablet_replica.cc:333] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.685214 28250 raft_consensus.cc:2243] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.686405 28250 raft_consensus.cc:2272] T 9061b29a602b48da9fba20b71503c213 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.689736 28250 tablet_replica.cc:333] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.690553 28250 raft_consensus.cc:2243] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.691195 28250 raft_consensus.cc:2272] T e13f513f4a9443c1ba392d85e007b6d2 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.694674 28250 tablet_replica.cc:333] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.695550 28250 raft_consensus.cc:2243] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.696221 28250 raft_consensus.cc:2272] T 9bc2af8629b64a0485ed32eeefbd5018 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.699604 28250 tablet_replica.cc:333] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.700206 28250 raft_consensus.cc:2243] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.700690 28250 raft_consensus.cc:2272] T 35f5edc99d3b40259b4f5a06ed104d93 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.702827 28250 tablet_replica.cc:333] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.703353 28250 raft_consensus.cc:2243] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.703796 28250 raft_consensus.cc:2272] T 241e87db6f54489698c75fc2a5ae8d98 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.705884 28250 tablet_replica.cc:333] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45: stopping tablet replica
I20260709 13:16:30.706386 28250 raft_consensus.cc:2243] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.706957 28250 raft_consensus.cc:2272] T 17918d5cb5064b149b51886b78b6afd4 P ff4bbe6dda6f4dc495ce74f02673cb45 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:30.742779  5800 consensus_peers.cc:597] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.747954 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
W20260709 13:16:30.784936  5800 consensus_peers.cc:597] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.796906 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
W20260709 13:16:30.804903  5800 consensus_peers.cc:597] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:30.809132  5802 consensus_peers.cc:597] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Couldn't send request to peer ff4bbe6dda6f4dc495ce74f02673cb45. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:40223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:30.835301  5800 consensus_peers.cc:597] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer 5a7401e4a5d24132baf8d796e2662d36 (127.27.150.129:33441): Couldn't send request to peer 5a7401e4a5d24132baf8d796e2662d36. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:33441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.837802 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:30.838744 28250 tablet_replica.cc:333] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.839526 28250 raft_consensus.cc:2243] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.840552 28250 raft_consensus.cc:2272] T fe2df1837efc403889f4aed8d1b42366 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.843128 28250 tablet_replica.cc:333] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.843802 28250 raft_consensus.cc:2243] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.844493 28250 raft_consensus.cc:2272] T 48c957d4a3f4471da2079c384a18a5a7 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.847672 28250 tablet_replica.cc:333] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.848580 28250 raft_consensus.cc:2243] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.849246 28250 raft_consensus.cc:2272] T 968a336b087a4b6db2ac7ea55617e535 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:30.849453  5802 consensus_peers.cc:597] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab -> Peer ff4bbe6dda6f4dc495ce74f02673cb45 (127.27.150.130:40223): Couldn't send request to peer ff4bbe6dda6f4dc495ce74f02673cb45. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:40223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.851616 28250 tablet_replica.cc:333] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.852406 28250 raft_consensus.cc:2243] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.852919 28250 raft_consensus.cc:2272] T babf3691edac41fa99725dd0eff17526 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.855276 28250 tablet_replica.cc:333] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.855948 28250 raft_consensus.cc:2243] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.856441 28250 raft_consensus.cc:2272] T 374bd357d576455d9f86a8bfb6e6d322 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.858691 28250 tablet_replica.cc:333] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.859489 28250 raft_consensus.cc:2243] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.860117 28250 raft_consensus.cc:2272] T ad453434a5e84c7babf1074793c73691 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.862346 28250 tablet_replica.cc:333] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.862999 28250 raft_consensus.cc:2243] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.863881 28250 raft_consensus.cc:2272] T 44fac40839f246dbac6642b9ec140018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.866281 28250 tablet_replica.cc:333] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.866937 28250 raft_consensus.cc:2243] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.867381 28250 raft_consensus.cc:2272] T 53139aac7c8d4a1797facf74523f2106 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.869704 28250 tablet_replica.cc:333] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.870285 28250 raft_consensus.cc:2243] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.870774 28250 raft_consensus.cc:2272] T 9061b29a602b48da9fba20b71503c213 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.873111 28250 tablet_replica.cc:333] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.873657 28250 raft_consensus.cc:2243] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.874624 28250 raft_consensus.cc:2272] T e13f513f4a9443c1ba392d85e007b6d2 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.876778 28250 tablet_replica.cc:333] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.877319 28250 raft_consensus.cc:2243] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.877736 28250 raft_consensus.cc:2272] T 6550667d273249d8a9f883f65be91a45 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.879878 28250 tablet_replica.cc:333] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.880398 28250 raft_consensus.cc:2243] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.880806 28250 raft_consensus.cc:2272] T 663ec201952e45a597e7b91d5d4b1e0d P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.883256 28250 tablet_replica.cc:333] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.883769 28250 raft_consensus.cc:2243] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.884212 28250 raft_consensus.cc:2272] T ea77ad41ef444dcdafe165724bea5920 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.886561 28250 tablet_replica.cc:333] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.887157 28250 raft_consensus.cc:2243] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.887673 28250 raft_consensus.cc:2272] T f9d9eda4cb9d4688bb812e68834073dc P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.889997 28250 tablet_replica.cc:333] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.890589 28250 raft_consensus.cc:2243] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.891033 28250 raft_consensus.cc:2272] T 9bc2af8629b64a0485ed32eeefbd5018 P ed7c43bfd1cc4ad7893413f1984e9eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.893401 28250 tablet_replica.cc:333] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.893945 28250 raft_consensus.cc:2243] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.894908 28250 raft_consensus.cc:2272] T 35f5edc99d3b40259b4f5a06ed104d93 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.897109 28250 tablet_replica.cc:333] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.897688 28250 raft_consensus.cc:2243] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.898613 28250 raft_consensus.cc:2272] T 241e87db6f54489698c75fc2a5ae8d98 P ed7c43bfd1cc4ad7893413f1984e9eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.900761 28250 tablet_replica.cc:333] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab: stopping tablet replica
I20260709 13:16:30.901321 28250 raft_consensus.cc:2243] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.902241 28250 raft_consensus.cc:2272] T 17918d5cb5064b149b51886b78b6afd4 P ed7c43bfd1cc4ad7893413f1984e9eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.951624 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
I20260709 13:16:30.997574 28250 master.cc:562] Master@127.27.150.190:42597 shutting down...
I20260709 13:16:31.030172 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.031020 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.031440 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P 329f80056fe8496d9b7dfcc3a2a84b5a: stopping tablet replica
I20260709 13:16:31.055153 28250 master.cc:584] Master@127.27.150.190:42597 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13820 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:16:31.120919 28250 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.150.190:33959
I20260709 13:16:31.122255 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:31.129235  6173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.130096  6172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.131544  6175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:31.132961 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:31.134327 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:31.134600 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:31.134732 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602991134717 us; error 0 us; skew 500 ppm
I20260709 13:16:31.135262 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:31.137984 28250 webserver.cc:533] Webserver started at http://127.27.150.190:39493/ using document root <none> and password file <none>
I20260709 13:16:31.138547 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:31.138724 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:31.138972 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:31.140257 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/master-0-root/instance:
uuid: "2cc6cb598b494e2898eeddc555993cc1"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.145227 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:16:31.149098  6180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.149952 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:31.150259 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/master-0-root
uuid: "2cc6cb598b494e2898eeddc555993cc1"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.150630 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:31.170959 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:31.172921 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:31.222429 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.190:33959
I20260709 13:16:31.222625  6231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.190:33959 every 8 connection(s)
I20260709 13:16:31.228849  6232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.242065  6232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1: Bootstrap starting.
I20260709 13:16:31.248060  6232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.253340  6232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1: No bootstrap required, opened a new log
I20260709 13:16:31.256086  6232 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc6cb598b494e2898eeddc555993cc1" member_type: VOTER }
I20260709 13:16:31.256546  6232 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.256783  6232 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc6cb598b494e2898eeddc555993cc1, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.257469  6232 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc6cb598b494e2898eeddc555993cc1" member_type: VOTER }
I20260709 13:16:31.257979  6232 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:31.258216  6232 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:31.258525  6232 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.264561  6232 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc6cb598b494e2898eeddc555993cc1" member_type: VOTER }
I20260709 13:16:31.265089  6232 leader_election.cc:304] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cc6cb598b494e2898eeddc555993cc1; no voters: 
I20260709 13:16:31.266381  6232 leader_election.cc:290] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:31.266889  6235 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:31.268522  6235 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 1 LEADER]: Becoming Leader. State: Replica: 2cc6cb598b494e2898eeddc555993cc1, State: Running, Role: LEADER
I20260709 13:16:31.269167  6235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc6cb598b494e2898eeddc555993cc1" member_type: VOTER }
I20260709 13:16:31.269738  6232 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:31.274327  6236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cc6cb598b494e2898eeddc555993cc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc6cb598b494e2898eeddc555993cc1" member_type: VOTER } }
I20260709 13:16:31.274542  6237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cc6cb598b494e2898eeddc555993cc1. Latest consensus state: current_term: 1 leader_uuid: "2cc6cb598b494e2898eeddc555993cc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc6cb598b494e2898eeddc555993cc1" member_type: VOTER } }
I20260709 13:16:31.275396  6236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:31.275655  6237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:31.278817  6242 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:31.284113  6242 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:31.289395 28250 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:31.294222  6242 catalog_manager.cc:1383] Generated new cluster ID: 31dc4289c3464d19babe40084e76f23a
I20260709 13:16:31.294523  6242 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:31.317797  6242 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:31.319357  6242 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:31.332927  6242 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1: Generated new TSK 0
I20260709 13:16:31.333580  6242 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:31.357553 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:31.364766  6253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.366133  6254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.367976  6256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:31.368491 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:31.369674 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:31.369930 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:31.370105 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602991370084 us; error 0 us; skew 500 ppm
I20260709 13:16:31.370754 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:31.373325 28250 webserver.cc:533] Webserver started at http://127.27.150.129:44115/ using document root <none> and password file <none>
I20260709 13:16:31.374027 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:31.374264 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:31.374596 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:31.375898 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-0-root/instance:
uuid: "137b622b05d0431d9d18a772c0b71929"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.380900 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:31.384775  6261 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.385604 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:31.385915 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-0-root
uuid: "137b622b05d0431d9d18a772c0b71929"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.386229 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:31.408141 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:31.409751 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:31.411504 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:31.414196 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:31.414453 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.414723 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:31.414932 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.464046 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.129:36241
I20260709 13:16:31.464175  6323 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.129:36241 every 8 connection(s)
I20260709 13:16:31.470337 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:31.479290  6328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.480798  6329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.483359  6331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:31.484488 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:31.485671 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:31.485901 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:31.486096 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602991486075 us; error 0 us; skew 500 ppm
I20260709 13:16:31.486821 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:31.490217 28250 webserver.cc:533] Webserver started at http://127.27.150.130:40399/ using document root <none> and password file <none>
I20260709 13:16:31.490823 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:31.491066 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:31.491379 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:31.491716  6324 heartbeater.cc:344] Connected to a master server at 127.27.150.190:33959
I20260709 13:16:31.492187  6324 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:31.492803 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-1-root/instance:
uuid: "3f7da998da3b4056a4c75327b817935f"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.492988  6324 heartbeater.cc:507] Master 127.27.150.190:33959 requested a full tablet report, sending...
I20260709 13:16:31.495554  6197 ts_manager.cc:194] Registered new tserver with Master: 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241)
I20260709 13:16:31.497959  6197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53918
I20260709 13:16:31.498282 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:16:31.502534  6336 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.503365 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:31.503690 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-1-root
uuid: "3f7da998da3b4056a4c75327b817935f"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.504035 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:31.517186 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:31.518704 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:31.520373 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:31.522944 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:31.523180 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.523428 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:31.523610 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.572855 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.130:34795
I20260709 13:16:31.573035  6398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.130:34795 every 8 connection(s)
I20260709 13:16:31.578941 28250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:31.588810  6403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.589558  6402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.592144  6405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:31.593330 28250 server_base.cc:1061] running on GCE node
I20260709 13:16:31.594735 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:31.595006 28250 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:31.595217 28250 hybrid_clock.cc:648] HybridClock initialized: now 1783602991595182 us; error 0 us; skew 500 ppm
I20260709 13:16:31.595798 28250 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:31.596083  6399 heartbeater.cc:344] Connected to a master server at 127.27.150.190:33959
I20260709 13:16:31.596623  6399 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:31.597610  6399 heartbeater.cc:507] Master 127.27.150.190:33959 requested a full tablet report, sending...
I20260709 13:16:31.598749 28250 webserver.cc:533] Webserver started at http://127.27.150.131:33531/ using document root <none> and password file <none>
I20260709 13:16:31.599485 28250 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:31.599727 28250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:31.600057 28250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:31.600080  6197 ts_manager.cc:194] Registered new tserver with Master: 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:31.601547 28250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-2-root/instance:
uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.601855  6197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53924
I20260709 13:16:31.607554 28250 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:16:31.611718  6410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.612514 28250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:16:31.612826 28250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-2-root
uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-nvvq"
I20260709 13:16:31.613155 28250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskycZgh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602669097744-28250-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:31.629323 28250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:31.630759 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:31.632396 28250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:31.634974 28250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:31.635205 28250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.635465 28250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:31.635654 28250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.685815 28250 rpc_server.cc:307] RPC server started. Bound to: 127.27.150.131:36821
I20260709 13:16:31.686017  6472 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.150.131:36821 every 8 connection(s)
I20260709 13:16:31.702013  6473 heartbeater.cc:344] Connected to a master server at 127.27.150.190:33959
I20260709 13:16:31.702669  6473 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:31.703563  6473 heartbeater.cc:507] Master 127.27.150.190:33959 requested a full tablet report, sending...
I20260709 13:16:31.705722  6197 ts_manager.cc:194] Registered new tserver with Master: 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:31.705874 28250 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016351572s
I20260709 13:16:31.707433  6197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53936
I20260709 13:16:31.734157  6197 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53940:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:31.737108  6197 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:31.816136  6364 tablet_service.cc:1511] Processing CreateTablet for tablet d1068bc7923c445a9eeff83c931dfd70 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:31.817824  6364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1068bc7923c445a9eeff83c931dfd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.819722  6363 tablet_service.cc:1511] Processing CreateTablet for tablet c0e6672d215f41708263377f988c3e59 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:31.821411  6363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e6672d215f41708263377f988c3e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.821261  6288 tablet_service.cc:1511] Processing CreateTablet for tablet c0e6672d215f41708263377f988c3e59 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:31.822921  6288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e6672d215f41708263377f988c3e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.826874  6289 tablet_service.cc:1511] Processing CreateTablet for tablet d1068bc7923c445a9eeff83c931dfd70 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:31.827224  6362 tablet_service.cc:1511] Processing CreateTablet for tablet f24f28bacebd4688aef57deee7c6eede (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:31.828320  6289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1068bc7923c445a9eeff83c931dfd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.828600  6362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24f28bacebd4688aef57deee7c6eede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.832588  6287 tablet_service.cc:1511] Processing CreateTablet for tablet f24f28bacebd4688aef57deee7c6eede (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:31.834061  6287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24f28bacebd4688aef57deee7c6eede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.835572  6286 tablet_service.cc:1511] Processing CreateTablet for tablet ef8e4c132a84476b8d1cfc01dfe01320 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:31.836992  6286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8e4c132a84476b8d1cfc01dfe01320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.845273  6361 tablet_service.cc:1511] Processing CreateTablet for tablet ef8e4c132a84476b8d1cfc01dfe01320 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:31.846827  6361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8e4c132a84476b8d1cfc01dfe01320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.848660  6285 tablet_service.cc:1511] Processing CreateTablet for tablet 77ac867df8e641649b6ae40f1032a0f6 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:31.850109  6285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ac867df8e641649b6ae40f1032a0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.852373  6360 tablet_service.cc:1511] Processing CreateTablet for tablet 77ac867df8e641649b6ae40f1032a0f6 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:31.854661  6438 tablet_service.cc:1511] Processing CreateTablet for tablet d1068bc7923c445a9eeff83c931dfd70 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:31.856297  6438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1068bc7923c445a9eeff83c931dfd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.861197  6283 tablet_service.cc:1511] Processing CreateTablet for tablet 04be6659e6e146d7a9e5a70e5626b001 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:31.854781  6284 tablet_service.cc:1511] Processing CreateTablet for tablet f9823c0c44a042b7af959ae97ac81a38 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:31.863080  6284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9823c0c44a042b7af959ae97ac81a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.864005  6283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04be6659e6e146d7a9e5a70e5626b001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.866094  6359 tablet_service.cc:1511] Processing CreateTablet for tablet f9823c0c44a042b7af959ae97ac81a38 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:31.868146  6282 tablet_service.cc:1511] Processing CreateTablet for tablet 70bae1852eb8436ab50ee1ee370fa872 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:31.869871  6282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bae1852eb8436ab50ee1ee370fa872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.870352  6360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ac867df8e641649b6ae40f1032a0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.873559  6281 tablet_service.cc:1511] Processing CreateTablet for tablet 93b8d0d203444b0dacac87af25175ae6 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:31.875245  6281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b8d0d203444b0dacac87af25175ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.885456  6359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9823c0c44a042b7af959ae97ac81a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.886611  6437 tablet_service.cc:1511] Processing CreateTablet for tablet c0e6672d215f41708263377f988c3e59 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:31.886896  6358 tablet_service.cc:1511] Processing CreateTablet for tablet 04be6659e6e146d7a9e5a70e5626b001 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:31.888259  6437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e6672d215f41708263377f988c3e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.889511  6357 tablet_service.cc:1511] Processing CreateTablet for tablet 70bae1852eb8436ab50ee1ee370fa872 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:31.892145  6356 tablet_service.cc:1511] Processing CreateTablet for tablet 93b8d0d203444b0dacac87af25175ae6 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:31.894083  6436 tablet_service.cc:1511] Processing CreateTablet for tablet f24f28bacebd4688aef57deee7c6eede (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:31.895556  6436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24f28bacebd4688aef57deee7c6eede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.911482  6435 tablet_service.cc:1511] Processing CreateTablet for tablet ef8e4c132a84476b8d1cfc01dfe01320 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:31.913399  6435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8e4c132a84476b8d1cfc01dfe01320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.919584  6358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04be6659e6e146d7a9e5a70e5626b001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.927525  6357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bae1852eb8436ab50ee1ee370fa872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.927947  6434 tablet_service.cc:1511] Processing CreateTablet for tablet 77ac867df8e641649b6ae40f1032a0f6 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:31.929605  6434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ac867df8e641649b6ae40f1032a0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.931830  6356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b8d0d203444b0dacac87af25175ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.936142  6433 tablet_service.cc:1511] Processing CreateTablet for tablet f9823c0c44a042b7af959ae97ac81a38 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:31.937664  6433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9823c0c44a042b7af959ae97ac81a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.940058  6432 tablet_service.cc:1511] Processing CreateTablet for tablet 04be6659e6e146d7a9e5a70e5626b001 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:31.941610  6432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04be6659e6e146d7a9e5a70e5626b001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.946393  6431 tablet_service.cc:1511] Processing CreateTablet for tablet 70bae1852eb8436ab50ee1ee370fa872 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:31.947942  6431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bae1852eb8436ab50ee1ee370fa872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.952389  6430 tablet_service.cc:1511] Processing CreateTablet for tablet 93b8d0d203444b0dacac87af25175ae6 (DEFAULT_TABLE table=test-workload [id=377e8ea3bd934608b6e3af151316d13f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:31.953881  6430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b8d0d203444b0dacac87af25175ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.008116  6488 tablet_bootstrap.cc:492] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.018857  6488 tablet_bootstrap.cc:654] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.019402  6490 tablet_bootstrap.cc:492] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.026805  6491 tablet_bootstrap.cc:492] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.145812  6488 tablet_bootstrap.cc:492] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.159298  6488 ts_tablet_manager.cc:1403] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.152s	user 0.005s	sys 0.013s
I20260709 13:16:32.173684  6491 tablet_bootstrap.cc:654] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.165493  6488 raft_consensus.cc:359] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.185151  6488 raft_consensus.cc:385] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.187645  6490 tablet_bootstrap.cc:654] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.187987  6488 raft_consensus.cc:740] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.192731  6488 consensus_queue.cc:260] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.189000  6491 tablet_bootstrap.cc:492] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.197865  6491 ts_tablet_manager.cc:1403] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.005s
I20260709 13:16:32.207655  6491 raft_consensus.cc:359] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.208690  6491 raft_consensus.cc:385] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.209069  6491 raft_consensus.cc:740] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.210021  6491 consensus_queue.cc:260] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.215474  6490 tablet_bootstrap.cc:492] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.216622  6490 ts_tablet_manager.cc:1403] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.198s	user 0.019s	sys 0.004s
I20260709 13:16:32.224721  6488 ts_tablet_manager.cc:1434] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.065s	user 0.016s	sys 0.019s
I20260709 13:16:32.221728  6490 raft_consensus.cc:359] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.226204  6324 heartbeater.cc:499] Master 127.27.150.190:33959 was elected leader, sending a full tablet report...
I20260709 13:16:32.226646  6490 raft_consensus.cc:385] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.227030  6490 raft_consensus.cc:740] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.228114  6490 consensus_queue.cc:260] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.241204  6488 tablet_bootstrap.cc:492] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.253695  6488 tablet_bootstrap.cc:654] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.254252  6491 ts_tablet_manager.cc:1434] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.056s	user 0.033s	sys 0.015s
I20260709 13:16:32.254206  6473 heartbeater.cc:499] Master 127.27.150.190:33959 was elected leader, sending a full tablet report...
I20260709 13:16:32.268293  6399 heartbeater.cc:499] Master 127.27.150.190:33959 was elected leader, sending a full tablet report...
I20260709 13:16:32.268743  6490 ts_tablet_manager.cc:1434] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.031s
I20260709 13:16:32.268895  6491 tablet_bootstrap.cc:492] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.272090  6490 tablet_bootstrap.cc:492] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.280527  6490 tablet_bootstrap.cc:654] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.282002  6488 tablet_bootstrap.cc:492] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.282004  6491 tablet_bootstrap.cc:654] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.283025  6488 ts_tablet_manager.cc:1403] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.015s
W20260709 13:16:32.284087  6245 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:32.287559  6488 raft_consensus.cc:359] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.288949  6488 raft_consensus.cc:385] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.289326  6488 raft_consensus.cc:740] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.290531  6488 consensus_queue.cc:260] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.293893  6488 ts_tablet_manager.cc:1434] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:16:32.295076  6488 tablet_bootstrap.cc:492] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.295678  6491 tablet_bootstrap.cc:492] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.296366  6491 ts_tablet_manager.cc:1403] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.003s
I20260709 13:16:32.298163  6490 tablet_bootstrap.cc:492] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.298885  6490 ts_tablet_manager.cc:1403] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 13:16:32.300524  6491 raft_consensus.cc:359] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.301492  6491 raft_consensus.cc:385] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.301801  6491 raft_consensus.cc:740] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.302690  6490 raft_consensus.cc:359] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.303229  6488 tablet_bootstrap.cc:654] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.303000  6491 consensus_queue.cc:260] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.305363  6491 ts_tablet_manager.cc:1434] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:32.306564  6491 tablet_bootstrap.cc:492] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.306764  6490 raft_consensus.cc:385] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.307176  6490 raft_consensus.cc:740] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.308117  6490 consensus_queue.cc:260] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.310775  6490 ts_tablet_manager.cc:1434] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:16:32.312340  6490 tablet_bootstrap.cc:492] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.317116  6491 tablet_bootstrap.cc:654] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.317581  6497 raft_consensus.cc:493] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.318331  6497 raft_consensus.cc:515] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.323604  6490 tablet_bootstrap.cc:654] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.328595  6497 leader_election.cc:290] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
W20260709 13:16:32.342357  6400 tablet.cc:2406] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:32.360913  6488 tablet_bootstrap.cc:492] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.361670  6488 ts_tablet_manager.cc:1403] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.025s
I20260709 13:16:32.367525  6488 raft_consensus.cc:359] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.368204  6488 raft_consensus.cc:385] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.368557  6488 raft_consensus.cc:740] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.370067  6488 consensus_queue.cc:260] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.373473  6490 tablet_bootstrap.cc:492] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.374374  6490 ts_tablet_manager.cc:1403] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.014s
I20260709 13:16:32.378626  6494 raft_consensus.cc:493] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.378746  6490 raft_consensus.cc:359] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.379630  6494 raft_consensus.cc:515] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.380100  6490 raft_consensus.cc:385] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.380627  6490 raft_consensus.cc:740] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.381889  6490 consensus_queue.cc:260] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.385080  6490 ts_tablet_manager.cc:1434] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:32.385514  6494 leader_election.cc:290] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.386482  6490 tablet_bootstrap.cc:492] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.386898  6491 tablet_bootstrap.cc:492] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.387511  6491 ts_tablet_manager.cc:1403] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.022s
I20260709 13:16:32.390748  6488 ts_tablet_manager.cc:1434] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 13:16:32.392388  6488 tablet_bootstrap.cc:492] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.398710  6490 tablet_bootstrap.cc:654] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.401456  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.402580  6448 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:32.403246  6488 tablet_bootstrap.cc:654] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.404021  6491 raft_consensus.cc:359] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.404999  6491 raft_consensus.cc:385] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.405344  6491 raft_consensus.cc:740] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.406344  6491 consensus_queue.cc:260] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.408699  6339 leader_election.cc:304] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:32.410095  6497 raft_consensus.cc:2804] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.410509  6497 raft_consensus.cc:493] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.410903  6497 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.417151  6491 ts_tablet_manager.cc:1434] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:16:32.418637  6491 tablet_bootstrap.cc:492] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.424233  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.425488  6299 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:32.426121  6497 raft_consensus.cc:515] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.429057  6491 tablet_bootstrap.cc:654] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.437871  6497 leader_election.cc:290] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.441973  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:32.442224  6490 tablet_bootstrap.cc:492] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.442839  6299 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.443102  6490 ts_tablet_manager.cc:1403] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.003s
I20260709 13:16:32.445523  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:32.446534  6448 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.448686  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e6672d215f41708263377f988c3e59" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.449468  6374 raft_consensus.cc:2468] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:32.451197  6265 leader_election.cc:304] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:32.452740  6494 raft_consensus.cc:2804] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.453227  6494 raft_consensus.cc:493] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.453670  6494 raft_consensus.cc:3060] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.463078  6490 raft_consensus.cc:359] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.469142  6490 raft_consensus.cc:385] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.474818  6490 raft_consensus.cc:740] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.476509  6488 tablet_bootstrap.cc:492] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.476199  6490 consensus_queue.cc:260] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.477247  6488 ts_tablet_manager.cc:1403] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.034s
I20260709 13:16:32.468190  6448 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:32.478469  6299 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:32.481298  6488 raft_consensus.cc:359] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.482620  6488 raft_consensus.cc:385] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.483002  6488 raft_consensus.cc:740] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.483983  6488 consensus_queue.cc:260] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.486176  6339 leader_election.cc:304] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:32.487434  6491 tablet_bootstrap.cc:492] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.488237  6491 ts_tablet_manager.cc:1403] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.034s
I20260709 13:16:32.490782  6497 raft_consensus.cc:2804] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.492545  6491 raft_consensus.cc:359] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.493467  6491 raft_consensus.cc:385] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.493963  6491 raft_consensus.cc:740] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.494472  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e6672d215f41708263377f988c3e59" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.495530  6497 raft_consensus.cc:697] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:32.496276  6491 consensus_queue.cc:260] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.496661  6497 consensus_queue.cc:237] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
W20260709 13:16:32.497116  6264 leader_election.cc:343] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.499356  6515 raft_consensus.cc:493] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.500313  6515 raft_consensus.cc:515] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.500571  6494 raft_consensus.cc:515] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.503464  6491 ts_tablet_manager.cc:1434] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:16:32.504038  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.504848  6491 tablet_bootstrap.cc:492] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
W20260709 13:16:32.505944  6337 leader_election.cc:343] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.499814  6490 ts_tablet_manager.cc:1434] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.055s	user 0.012s	sys 0.000s
I20260709 13:16:32.508121  6490 tablet_bootstrap.cc:492] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.512825  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
W20260709 13:16:32.514919  6339 leader_election.cc:343] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.515533  6339 leader_election.cc:304] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f; no voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:32.520412  6491 tablet_bootstrap.cc:654] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.520489  6515 leader_election.cc:290] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.527046  6515 raft_consensus.cc:2749] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.534821  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e6672d215f41708263377f988c3e59" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:32.535868  6374 raft_consensus.cc:3060] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.541143  6197 catalog_manager.cc:5697] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 1 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.544116  6490 tablet_bootstrap.cc:654] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.547515  6497 raft_consensus.cc:493] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.548125  6497 raft_consensus.cc:515] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.550180  6488 ts_tablet_manager.cc:1434] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.072s	user 0.028s	sys 0.041s
I20260709 13:16:32.551411  6497 leader_election.cc:290] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.551687  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.552222  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.552452  6491 tablet_bootstrap.cc:492] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.553586  6491 ts_tablet_manager.cc:1403] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.010s
I20260709 13:16:32.553702  6488 tablet_bootstrap.cc:492] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
W20260709 13:16:32.554003  6339 leader_election.cc:343] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:32.554720  6337 leader_election.cc:343] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.555248  6337 leader_election.cc:304] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f; no voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:32.556589  6497 raft_consensus.cc:2749] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.557816  6514 raft_consensus.cc:493] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.562121  6514 raft_consensus.cc:515] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.557726  6491 raft_consensus.cc:359] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.561210  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e6672d215f41708263377f988c3e59" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
W20260709 13:16:32.568291  6264 leader_election.cc:343] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.568487  6514 leader_election.cc:290] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.549791  6494 leader_election.cc:290] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.570374  6491 raft_consensus.cc:385] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.563141  6488 tablet_bootstrap.cc:654] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.565999  6374 raft_consensus.cc:2468] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:32.569814  6373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.570501  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.571273  6491 raft_consensus.cc:740] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
W20260709 13:16:32.573398  6265 leader_election.cc:343] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.573938  6491 consensus_queue.cc:260] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
W20260709 13:16:32.574558  6264 leader_election.cc:343] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.575129  6264 leader_election.cc:304] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929; no voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:32.576385  6514 raft_consensus.cc:2749] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.577049  6265 leader_election.cc:304] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:32.579244  6491 ts_tablet_manager.cc:1434] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
I20260709 13:16:32.579806  6490 tablet_bootstrap.cc:492] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.580608  6491 tablet_bootstrap.cc:492] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.581157  6490 ts_tablet_manager.cc:1403] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.012s
I20260709 13:16:32.585454  6490 raft_consensus.cc:359] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.580304  6514 raft_consensus.cc:2804] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.586560  6514 raft_consensus.cc:697] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:32.587503  6514 consensus_queue.cc:237] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.593030  6490 raft_consensus.cc:385] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.593021  6491 tablet_bootstrap.cc:654] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.593812  6490 raft_consensus.cc:740] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.594837  6490 consensus_queue.cc:260] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.603147  6490 ts_tablet_manager.cc:1434] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:16:32.605978  6490 tablet_bootstrap.cc:492] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.607981  6491 tablet_bootstrap.cc:492] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.608850  6491 ts_tablet_manager.cc:1403] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 13:16:32.610689  6195 catalog_manager.cc:5697] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.613399  6488 tablet_bootstrap.cc:492] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.615278  6488 ts_tablet_manager.cc:1403] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.062s	user 0.033s	sys 0.011s
I20260709 13:16:32.613919  6491 raft_consensus.cc:359] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.617295  6491 raft_consensus.cc:385] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.617632  6491 raft_consensus.cc:740] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.618793  6488 raft_consensus.cc:359] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.619664  6488 raft_consensus.cc:385] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.618825  6491 consensus_queue.cc:260] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.620252  6488 raft_consensus.cc:740] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.625998  6490 tablet_bootstrap.cc:654] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.627118  6488 consensus_queue.cc:260] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.628258  6491 ts_tablet_manager.cc:1434] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:16:32.629534  6491 tablet_bootstrap.cc:492] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.633066  6488 ts_tablet_manager.cc:1434] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:16:32.634505  6488 tablet_bootstrap.cc:492] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.637526  6491 tablet_bootstrap.cc:654] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.646219  6490 tablet_bootstrap.cc:492] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.646853  6490 ts_tablet_manager.cc:1403] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.012s
I20260709 13:16:32.648387  6491 tablet_bootstrap.cc:492] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.649034  6491 ts_tablet_manager.cc:1403] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:16:32.649912  6488 tablet_bootstrap.cc:654] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.650516  6490 raft_consensus.cc:359] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.651384  6490 raft_consensus.cc:385] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.651680  6490 raft_consensus.cc:740] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.652448  6491 raft_consensus.cc:359] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.652607  6490 consensus_queue.cc:260] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.653434  6491 raft_consensus.cc:385] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.653851  6491 raft_consensus.cc:740] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.655032  6491 consensus_queue.cc:260] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.655553  6490 ts_tablet_manager.cc:1434] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:16:32.656173  6488 tablet_bootstrap.cc:492] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.656843  6488 ts_tablet_manager.cc:1403] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 13:16:32.657032  6490 tablet_bootstrap.cc:492] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.657464  6514 raft_consensus.cc:493] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.658070  6514 raft_consensus.cc:515] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.660321  6488 raft_consensus.cc:359] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.661129  6488 raft_consensus.cc:385] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.661298  6491 ts_tablet_manager.cc:1434] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:16:32.661451  6488 raft_consensus.cc:740] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.662887  6491 tablet_bootstrap.cc:492] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.662576  6488 consensus_queue.cc:260] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.666009  6490 tablet_bootstrap.cc:654] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.667603  6488 ts_tablet_manager.cc:1434] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:16:32.668854  6488 tablet_bootstrap.cc:492] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.670948  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8e4c132a84476b8d1cfc01dfe01320" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.671811  6448 raft_consensus.cc:2468] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:32.672397  6491 tablet_bootstrap.cc:654] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.673710  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8e4c132a84476b8d1cfc01dfe01320" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.676245  6488 tablet_bootstrap.cc:654] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.677946  6264 leader_election.cc:304] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:32.678826  6374 raft_consensus.cc:2468] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:32.679337  6494 raft_consensus.cc:2804] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.679900  6494 raft_consensus.cc:493] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.680401  6494 raft_consensus.cc:3060] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.682600  6514 leader_election.cc:290] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.683012  6496 raft_consensus.cc:493] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.695832  6496 raft_consensus.cc:515] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.700435  6496 leader_election.cc:290] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:32.684966  6491 tablet_bootstrap.cc:492] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.704054  6491 ts_tablet_manager.cc:1403] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.001s
I20260709 13:16:32.708019  6491 raft_consensus.cc:359] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.708774  6491 raft_consensus.cc:385] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.709062  6491 raft_consensus.cc:740] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.687608  6490 tablet_bootstrap.cc:492] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.710184  6490 ts_tablet_manager.cc:1403] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.004s
I20260709 13:16:32.713677  6490 raft_consensus.cc:359] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.714526  6490 raft_consensus.cc:385] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.716024  6490 raft_consensus.cc:740] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.716881  6490 consensus_queue.cc:260] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.719324  6490 ts_tablet_manager.cc:1434] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:32.720530  6490 tablet_bootstrap.cc:492] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.715150  6491 consensus_queue.cc:260] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.724278  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.724727  6491 ts_tablet_manager.cc:1434] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:16:32.725149  6374 raft_consensus.cc:2468] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 0.
I20260709 13:16:32.725952  6491 tablet_bootstrap.cc:492] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:32.726866  6414 leader_election.cc:304] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:32.727977  6496 raft_consensus.cc:2804] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.728372  6496 raft_consensus.cc:493] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.728698  6496 raft_consensus.cc:3060] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.730026  6514 raft_consensus.cc:493] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.730821  6514 raft_consensus.cc:515] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.733206  6514 leader_election.cc:290] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.734769  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24f28bacebd4688aef57deee7c6eede" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.735044  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24f28bacebd4688aef57deee7c6eede" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.735567  6448 raft_consensus.cc:2468] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
W20260709 13:16:32.736850  6265 leader_election.cc:343] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.737272  6488 tablet_bootstrap.cc:492] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.737588  6264 leader_election.cc:304] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:32.737932  6488 ts_tablet_manager.cc:1403] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.021s
I20260709 13:16:32.740238  6514 raft_consensus.cc:2804] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.690310  6494 raft_consensus.cc:515] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.740697  6514 raft_consensus.cc:493] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.740417  6491 tablet_bootstrap.cc:654] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.741114  6514 raft_consensus.cc:3060] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.741766  6488 raft_consensus.cc:359] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.742650  6488 raft_consensus.cc:385] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.742971  6488 raft_consensus.cc:740] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.743860  6488 consensus_queue.cc:260] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.744298  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8e4c132a84476b8d1cfc01dfe01320" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:32.745168  6374 raft_consensus.cc:3060] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.755745  6496 raft_consensus.cc:515] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.759111  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.741771  6490 tablet_bootstrap.cc:654] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.759749  6488 ts_tablet_manager.cc:1434] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 13:16:32.759760  6494 leader_election.cc:290] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.761641  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8e4c132a84476b8d1cfc01dfe01320" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:32.762322  6448 raft_consensus.cc:3060] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.763195  6497 raft_consensus.cc:493] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.763525  6488 tablet_bootstrap.cc:492] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.763737  6497 raft_consensus.cc:515] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.765993  6514 raft_consensus.cc:515] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.768862  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.769572  6373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24f28bacebd4688aef57deee7c6eede" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:32.771076  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
W20260709 13:16:32.771554  6265 leader_election.cc:343] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.769568  6447 raft_consensus.cc:2468] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:32.772419  6488 tablet_bootstrap.cc:654] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:32.772706  6411 leader_election.cc:343] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.774586  6339 leader_election.cc:304] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:32.775089  6374 raft_consensus.cc:2468] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:32.775959  6497 leader_election.cc:290] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.776048  6517 raft_consensus.cc:2804] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.776288  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.776634  6517 raft_consensus.cc:493] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.777912  6299 raft_consensus.cc:2468] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:32.778096  6517 raft_consensus.cc:3060] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.778651  6514 leader_election.cc:290] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
W20260709 13:16:32.779750  6411 leader_election.cc:343] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.781042  6496 leader_election.cc:290] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:32.782547  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:32.782415  6265 leader_election.cc:304] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:32.783696  6374 raft_consensus.cc:3060] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.784228  6514 raft_consensus.cc:2804] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.787773  6514 raft_consensus.cc:697] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:32.788990  6514 consensus_queue.cc:237] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.791157  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24f28bacebd4688aef57deee7c6eede" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:32.792085  6447 raft_consensus.cc:3060] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.796321  6517 raft_consensus.cc:515] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.790187  6448 raft_consensus.cc:2468] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:32.800136  6517 leader_election.cc:290] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.801448  6374 raft_consensus.cc:2468] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 1.
I20260709 13:16:32.804769  6494 raft_consensus.cc:493] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.805323  6494 raft_consensus.cc:515] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.806653  6491 tablet_bootstrap.cc:492] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:32.802291  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:32.802680  6497 raft_consensus.cc:493] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.807454  6491 ts_tablet_manager.cc:1403] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.022s
I20260709 13:16:32.807968  6490 tablet_bootstrap.cc:492] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.807905  6497 raft_consensus.cc:515] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.808655  6490 ts_tablet_manager.cc:1403] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.003s
I20260709 13:16:32.809326  6447 raft_consensus.cc:2468] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:32.810846  6264 leader_election.cc:304] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:32.811255  6491 raft_consensus.cc:359] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.812142  6491 raft_consensus.cc:385] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.811895  6414 leader_election.cc:304] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:32.812467  6491 raft_consensus.cc:740] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.812415  6518 raft_consensus.cc:2804] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.813055  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.813776  6490 raft_consensus.cc:359] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.814060  6491 consensus_queue.cc:260] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.815898  6490 raft_consensus.cc:385] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.816334  6490 raft_consensus.cc:740] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.814867  6446 raft_consensus.cc:3060] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.818857  6490 consensus_queue.cc:260] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.820305  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.821928  6447 raft_consensus.cc:2468] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:32.822954  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:32.823634  6299 raft_consensus.cc:3060] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.824004  6339 leader_election.cc:304] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:32.815784  6496 raft_consensus.cc:2804] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.828488  6494 leader_election.cc:290] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.828765  6490 ts_tablet_manager.cc:1434] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:16:32.814141  6298 raft_consensus.cc:2468] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:32.830314  6490 tablet_bootstrap.cc:492] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:32.825454  6497 leader_election.cc:290] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.826185  6517 raft_consensus.cc:2804] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.832588  6517 raft_consensus.cc:493] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.832944  6517 raft_consensus.cc:3060] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.833014  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.834508  6446 raft_consensus.cc:2468] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:32.836804  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.837539  6447 raft_consensus.cc:2468] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:32.842232  6491 ts_tablet_manager.cc:1434] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.015s
I20260709 13:16:32.842554  6488 tablet_bootstrap.cc:492] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.843233  6488 ts_tablet_manager.cc:1403] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.008s
I20260709 13:16:32.844725  6518 raft_consensus.cc:697] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
W20260709 13:16:32.844981  6265 leader_election.cc:343] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.847452  6496 raft_consensus.cc:697] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:32.848245  6541 raft_consensus.cc:493] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.848555  6496 consensus_queue.cc:237] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.848830  6541 raft_consensus.cc:515] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.851300  6541 leader_election.cc:290] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:32.853032  6264 leader_election.cc:304] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:32.855275  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e6672d215f41708263377f988c3e59" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.854959  6488 raft_consensus.cc:359] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.855954  6488 raft_consensus.cc:385] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.856238  6488 raft_consensus.cc:740] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.855424  6196 catalog_manager.cc:5697] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.857065  6488 consensus_queue.cc:260] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.865818  6490 tablet_bootstrap.cc:654] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.867231  6488 ts_tablet_manager.cc:1434] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:16:32.868435  6488 tablet_bootstrap.cc:492] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:32.868832  6517 raft_consensus.cc:515] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.879992  6539 raft_consensus.cc:2804] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.880820  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:32.881606  6298 raft_consensus.cc:3060] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.881130  6539 raft_consensus.cc:493] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.882706  6539 raft_consensus.cc:3060] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.888947  6517 leader_election.cc:290] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.884527  6299 raft_consensus.cc:2468] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:32.893062  6518 consensus_queue.cc:237] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.897032  6337 leader_election.cc:304] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:32.898658  6517 raft_consensus.cc:2804] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.899483  6517 raft_consensus.cc:697] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:32.900774  6517 consensus_queue.cc:237] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.909839  6298 raft_consensus.cc:2468] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:32.909477  6197 catalog_manager.cc:5697] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 1 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.911320  6337 leader_election.cc:304] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:32.912317  6497 raft_consensus.cc:2804] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.912863  6497 raft_consensus.cc:697] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:32.913825  6497 consensus_queue.cc:237] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.914861  6496 raft_consensus.cc:493] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.915235  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e6672d215f41708263377f988c3e59" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.919761  6374 raft_consensus.cc:2393] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in current term 1: Already voted for candidate 137b622b05d0431d9d18a772c0b71929 in this term.
I20260709 13:16:32.918359  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:32.926185  6488 tablet_bootstrap.cc:654] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.922559  6447 raft_consensus.cc:3060] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.930279  6195 catalog_manager.cc:5697] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 1 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.916200  6496 raft_consensus.cc:515] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.934597  6414 leader_election.cc:304] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:32.945371  6517 raft_consensus.cc:493] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.948762  6517 raft_consensus.cc:515] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.936378  6196 catalog_manager.cc:5697] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.951222  6517 leader_election.cc:290] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:32.954600  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24f28bacebd4688aef57deee7c6eede" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:32.955621  6446 raft_consensus.cc:2393] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f7da998da3b4056a4c75327b817935f in current term 1: Already voted for candidate 137b622b05d0431d9d18a772c0b71929 in this term.
I20260709 13:16:32.954640  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24f28bacebd4688aef57deee7c6eede" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.957345  6490 tablet_bootstrap.cc:492] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:32.957465  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:32.958307  6490 ts_tablet_manager.cc:1403] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.128s	user 0.035s	sys 0.042s
I20260709 13:16:32.958390  6299 raft_consensus.cc:2468] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 0.
I20260709 13:16:32.960011  6411 leader_election.cc:304] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:32.961103  6540 raft_consensus.cc:2804] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.961395  6540 raft_consensus.cc:493] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.961614  6540 raft_consensus.cc:3060] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.963747  6490 raft_consensus.cc:359] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.963932  6339 leader_election.cc:304] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f; no voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:32.964363  6496 leader_election.cc:290] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:32.974267  6490 raft_consensus.cc:385] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.974638  6517 raft_consensus.cc:3060] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.970072  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:32.975814  6490 raft_consensus.cc:740] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.976500  6374 raft_consensus.cc:2468] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 0.
I20260709 13:16:32.973737  6542 raft_consensus.cc:3060] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.985184  6517 raft_consensus.cc:2749] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.986284  6490 consensus_queue.cc:260] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.993918  6488 tablet_bootstrap.cc:492] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:32.994236  6490 ts_tablet_manager.cc:1434] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.006s
I20260709 13:16:32.994505  6488 ts_tablet_manager.cc:1403] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.022s
I20260709 13:16:32.996855  6447 raft_consensus.cc:2468] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:32.998039  6488 raft_consensus.cc:359] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:32.998821  6488 raft_consensus.cc:385] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.999068  6488 raft_consensus.cc:740] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.999804  6488 consensus_queue.cc:260] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.000171  6542 raft_consensus.cc:2749] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.988863  6540 raft_consensus.cc:515] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.001765  6488 ts_tablet_manager.cc:1434] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:33.003371  6540 leader_election.cc:290] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:32.989684  6539 raft_consensus.cc:515] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.004065  6195 catalog_manager.cc:5697] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 1 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.005759  6539 leader_election.cc:290] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:33.005728  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:33.006675  6299 raft_consensus.cc:3060] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.007597  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:33.008285  6374 raft_consensus.cc:3060] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.013896  6373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:33.014658  6373 raft_consensus.cc:3060] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.015581  6299 raft_consensus.cc:2468] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 1.
I20260709 13:16:33.017006  6411 leader_election.cc:304] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:33.017897  6540 raft_consensus.cc:2804] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.018409  6540 raft_consensus.cc:697] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:33.019325  6540 consensus_queue.cc:237] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.023547  6373 raft_consensus.cc:2468] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 1.
I20260709 13:16:33.028431  6374 raft_consensus.cc:2468] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:33.014658  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:33.030200  6447 raft_consensus.cc:3060] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.030515  6195 catalog_manager.cc:5697] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 1 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.034653  6517 consensus_queue.cc:1048] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.038616  6447 raft_consensus.cc:2468] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:33.040210  6264 leader_election.cc:304] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:33.041126  6539 raft_consensus.cc:2804] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.041637  6539 raft_consensus.cc:697] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:33.042599  6539 consensus_queue.cc:237] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.044163  6518 raft_consensus.cc:493] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.044606  6494 consensus_queue.cc:1048] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.044772  6518 raft_consensus.cc:515] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.049134  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:33.049960  6374 raft_consensus.cc:2393] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 137b622b05d0431d9d18a772c0b71929 in current term 1: Already voted for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in this term.
I20260709 13:16:33.051393  6518 leader_election.cc:290] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:33.053684  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:33.055411  6264 leader_election.cc:304] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929; no voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:33.056309  6518 raft_consensus.cc:3060] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.055698  6195 catalog_manager.cc:5697] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.070478  6517 consensus_queue.cc:1048] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.073933  6518 raft_consensus.cc:2749] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:33.118580  6494 consensus_queue.cc:1048] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.130301  6374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
mode: GRACEFUL
new_leader_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:56860
I20260709 13:16:33.131243  6374 raft_consensus.cc:606] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Received request to transfer leadership to TS 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:33.155660  6447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
mode: GRACEFUL
new_leader_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:48626
I20260709 13:16:33.156296  6447 raft_consensus.cc:606] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Received request to transfer leadership to TS 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:33.162142  6447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
mode: GRACEFUL
new_leader_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:48626
I20260709 13:16:33.162798  6447 raft_consensus.cc:606] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Received request to transfer leadership to TS 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:33.179883  6299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
mode: GRACEFUL
new_leader_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:54010
I20260709 13:16:33.180437  6299 raft_consensus.cc:606] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Received request to transfer leadership to TS 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:33.186766  6374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
mode: GRACEFUL
new_leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:56860
I20260709 13:16:33.187623  6374 raft_consensus.cc:606] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Received request to transfer leadership to TS 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:33.265066  6540 consensus_queue.cc:1048] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.279716  6542 consensus_queue.cc:1048] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.289441  6496 raft_consensus.cc:993] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: : Instructing follower 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:33.290055  6542 raft_consensus.cc:1081] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Signalling peer 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:33.291985  6374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:56848
I20260709 13:16:33.292744  6374 raft_consensus.cc:493] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.293156  6374 raft_consensus.cc:3060] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.299928  6374 raft_consensus.cc:515] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.301873  6374 leader_election.cc:290] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:33.302903  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:33.303438  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9823c0c44a042b7af959ae97ac81a38" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:33.303687  6299 raft_consensus.cc:3060] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.304217  6447 raft_consensus.cc:3055] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.304569  6447 raft_consensus.cc:740] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:33.305531  6447 consensus_queue.cc:260] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.307502  6447 raft_consensus.cc:3060] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.311923  6299 raft_consensus.cc:2468] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:33.313133  6337 leader_election.cc:304] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:33.313812  6447 raft_consensus.cc:2468] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:33.314167  6517 raft_consensus.cc:2804] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.314867  6517 raft_consensus.cc:697] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:33.315727  6517 consensus_queue.cc:237] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.322342  6197 catalog_manager.cc:5697] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 1 to 2, leader changed from 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131) to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 2 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.340400  6494 consensus_queue.cc:1048] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.352191  6518 consensus_queue.cc:1048] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.448596  6518 consensus_queue.cc:1048] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.455796  6518 consensus_queue.cc:1048] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.476552  6539 consensus_queue.cc:1048] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.481212  6494 consensus_queue.cc:1048] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.485409  6515 consensus_queue.cc:1048] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.504520  6494 raft_consensus.cc:993] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929: : Instructing follower 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:33.505101  6494 raft_consensus.cc:1081] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Signalling peer 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:33.505508  6497 consensus_queue.cc:1048] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.505867  6542 consensus_queue.cc:1048] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.508407  6517 consensus_queue.cc:1048] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.509879  6517 consensus_queue.cc:1048] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.512379  6374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:56840
I20260709 13:16:33.513227  6374 raft_consensus.cc:493] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.513641  6374 raft_consensus.cc:3060] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.523182  6515 raft_consensus.cc:993] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f: : Instructing follower 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:33.524039  6515 raft_consensus.cc:1081] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Signalling peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:33.526510  6446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:48612
I20260709 13:16:33.527148  6446 raft_consensus.cc:493] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.527539  6446 raft_consensus.cc:3060] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.523748  6374 raft_consensus.cc:515] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.537112  6299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:33.537827  6299 raft_consensus.cc:3055] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.538164  6299 raft_consensus.cc:740] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:33.539093  6299 consensus_queue.cc:260] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.539994  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bae1852eb8436ab50ee1ee370fa872" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:33.540786  6448 raft_consensus.cc:3060] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.541761  6542 consensus_queue.cc:1048] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.545806  6446 raft_consensus.cc:515] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.551738  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:33.551908  6374 leader_election.cc:290] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:33.552419  6298 raft_consensus.cc:3060] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.559230  6299 raft_consensus.cc:3060] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.560725  6448 raft_consensus.cc:2468] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:33.561522  6447 raft_consensus.cc:1240] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Rejecting Update request from peer 3f7da998da3b4056a4c75327b817935f for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:33.564922  6339 leader_election.cc:304] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:33.567483  6517 raft_consensus.cc:2804] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.568284  6517 raft_consensus.cc:697] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:33.569545  6517 consensus_queue.cc:237] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.563069  6446 leader_election.cc:290] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:33.570283  6299 raft_consensus.cc:2468] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:33.571031  6496 raft_consensus.cc:993] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: : Instructing follower 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:33.571599  6541 raft_consensus.cc:1081] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Signalling peer 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:33.573472  6373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:56848
I20260709 13:16:33.574307  6373 raft_consensus.cc:493] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.575523  6515 consensus_queue.cc:1059] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.575776  6373 raft_consensus.cc:3060] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.576531  6515 raft_consensus.cc:3055] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.575096  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b8d0d203444b0dacac87af25175ae6" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:33.576984  6515 raft_consensus.cc:740] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:33.575011  6298 raft_consensus.cc:2468] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 2.
I20260709 13:16:33.578001  6297 raft_consensus.cc:1240] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Rejecting Update request from peer 3f7da998da3b4056a4c75327b817935f for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:33.578205  6515 consensus_queue.cc:260] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.578821  6411 leader_election.cc:304] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:33.579643  6515 raft_consensus.cc:3060] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.580071  6496 raft_consensus.cc:2804] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.580682  6496 raft_consensus.cc:697] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:33.581684  6496 consensus_queue.cc:237] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.585253  6373 raft_consensus.cc:515] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.589072  6373 leader_election.cc:290] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:33.589438  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:33.590137  6297 raft_consensus.cc:3060] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.597003  6374 raft_consensus.cc:2468] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 2.
I20260709 13:16:33.597172  6515 raft_consensus.cc:993] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f: : Instructing follower 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:33.598004  6497 raft_consensus.cc:1081] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Signalling peer 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:33.597859  6195 catalog_manager.cc:5697] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 1 to 2, leader changed from 137b622b05d0431d9d18a772c0b71929 (127.27.150.129) to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 2 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.600179  6298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:53988
I20260709 13:16:33.600871  6298 raft_consensus.cc:493] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.601336  6298 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.602638  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ac867df8e641649b6ae40f1032a0f6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:33.605739  6447 raft_consensus.cc:3055] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.607748  6447 raft_consensus.cc:740] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:33.608764  6447 consensus_queue.cc:260] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.610376  6447 raft_consensus.cc:3060] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.610539  6297 raft_consensus.cc:2468] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:33.610936  6298 raft_consensus.cc:515] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.612283  6337 leader_election.cc:304] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:33.613274  6515 raft_consensus.cc:2804] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.613488  6298 leader_election.cc:290] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:33.615279  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:33.615463  6515 raft_consensus.cc:697] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:33.615993  6374 raft_consensus.cc:3055] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.616389  6374 raft_consensus.cc:740] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:33.616528  6515 consensus_queue.cc:237] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.617394  6374 consensus_queue.cc:260] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.618973  6374 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.619140  6447 raft_consensus.cc:2468] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:33.620769  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:33.621438  6448 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.621491  6196 catalog_manager.cc:5697] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 1 to 2, leader changed from 3f7da998da3b4056a4c75327b817935f (127.27.150.130) to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 2 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.628165  6374 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:33.629983  6265 leader_election.cc:304] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:33.632618  6494 raft_consensus.cc:2804] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.633383  6494 raft_consensus.cc:697] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:33.634895  6494 consensus_queue.cc:237] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:33.636292  6448 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:33.637526  6195 catalog_manager.cc:5697] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 1 to 2, leader changed from 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131) to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 2 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.648403  6196 catalog_manager.cc:5697] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 1 to 2, leader changed from 3f7da998da3b4056a4c75327b817935f (127.27.150.130) to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.740640  6297 raft_consensus.cc:1275] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.742195  6515 consensus_queue.cc:1048] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.753350  6448 raft_consensus.cc:1275] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.755213  6574 consensus_queue.cc:1048] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:33.989580  6297 raft_consensus.cc:1275] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.991161  6574 consensus_queue.cc:1048] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.997610  6297 raft_consensus.cc:1275] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.000445  6574 consensus_queue.cc:1048] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.001480  6448 raft_consensus.cc:1275] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.003284  6517 consensus_queue.cc:1048] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.010237  6446 raft_consensus.cc:1275] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.014889  6515 consensus_queue.cc:1048] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.042917  6374 raft_consensus.cc:1275] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.044386  6496 consensus_queue.cc:1048] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.054834  6297 raft_consensus.cc:1275] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.056900  6496 consensus_queue.cc:1048] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:34.173815  6374 raft_consensus.cc:1275] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.175496  6514 consensus_queue.cc:1048] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.186187  6446 raft_consensus.cc:1275] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.188867  6539 consensus_queue.cc:1048] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.224376  6195 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53950:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:36.227239  6195 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:36.288916  6284 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2183b426d944ba9745e778800bf10f (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:36.290150  6357 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2183b426d944ba9745e778800bf10f (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:36.291934  6357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2183b426d944ba9745e778800bf10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.292483  6432 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2183b426d944ba9745e778800bf10f (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:36.294104  6432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2183b426d944ba9745e778800bf10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.295571  6285 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce4041b80f4a27b1870eeabb3f7f6b (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:36.290751  6284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2183b426d944ba9745e778800bf10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.302997  6437 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce4041b80f4a27b1870eeabb3f7f6b (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:36.304674  6437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce4041b80f4a27b1870eeabb3f7f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.310088  6431 tablet_service.cc:1511] Processing CreateTablet for tablet d63a11fa62dc47ba8863ebab524d9ef4 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:36.311038  6434 tablet_service.cc:1511] Processing CreateTablet for tablet 484ebb0b1b004720867880389f4d6432 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:36.311664  6431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63a11fa62dc47ba8863ebab524d9ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.312569  6434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484ebb0b1b004720867880389f4d6432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.316319  6362 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce4041b80f4a27b1870eeabb3f7f6b (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:36.316397  6285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce4041b80f4a27b1870eeabb3f7f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.316625  6358 tablet_service.cc:1511] Processing CreateTablet for tablet d63a11fa62dc47ba8863ebab524d9ef4 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:36.317937  6362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce4041b80f4a27b1870eeabb3f7f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.318668  6358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63a11fa62dc47ba8863ebab524d9ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.319801  6356 tablet_service.cc:1511] Processing CreateTablet for tablet 484ebb0b1b004720867880389f4d6432 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:36.321421  6356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484ebb0b1b004720867880389f4d6432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.329008  6281 tablet_service.cc:1511] Processing CreateTablet for tablet d63a11fa62dc47ba8863ebab524d9ef4 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:36.330734  6281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63a11fa62dc47ba8863ebab524d9ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.334244  6287 tablet_service.cc:1511] Processing CreateTablet for tablet 484ebb0b1b004720867880389f4d6432 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 13:16:36.332902  6245 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:36.335840  6282 tablet_service.cc:1511] Processing CreateTablet for tablet d10f1ec876b54d6996b863b9d5e8feb6 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:36.335971  6287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484ebb0b1b004720867880389f4d6432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.338909  6282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10f1ec876b54d6996b863b9d5e8feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.349406  6361 tablet_service.cc:1511] Processing CreateTablet for tablet d10f1ec876b54d6996b863b9d5e8feb6 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:36.351114  6361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10f1ec876b54d6996b863b9d5e8feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.350832  6433 tablet_service.cc:1511] Processing CreateTablet for tablet d10f1ec876b54d6996b863b9d5e8feb6 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:36.352406  6433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10f1ec876b54d6996b863b9d5e8feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.366706  6594 tablet_bootstrap.cc:492] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.368933  6358 tablet_service.cc:1511] Processing CreateTablet for tablet fe9f7a3874ec4e93856cb5465934b5ec (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:36.370606  6358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9f7a3874ec4e93856cb5465934b5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.371223  6436 tablet_service.cc:1511] Processing CreateTablet for tablet fe9f7a3874ec4e93856cb5465934b5ec (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:36.372679  6436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9f7a3874ec4e93856cb5465934b5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.394064  6283 tablet_service.cc:1511] Processing CreateTablet for tablet fe9f7a3874ec4e93856cb5465934b5ec (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:36.396317  6283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9f7a3874ec4e93856cb5465934b5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.399516  6288 tablet_service.cc:1511] Processing CreateTablet for tablet 53eab256700c48e68d4a5fec136060a3 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:36.401677  6360 tablet_service.cc:1511] Processing CreateTablet for tablet 53eab256700c48e68d4a5fec136060a3 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:36.405716  6360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53eab256700c48e68d4a5fec136060a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.406680  6288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53eab256700c48e68d4a5fec136060a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.381991  6594 tablet_bootstrap.cc:654] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.417066  6437 tablet_service.cc:1511] Processing CreateTablet for tablet 53eab256700c48e68d4a5fec136060a3 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:36.418803  6437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53eab256700c48e68d4a5fec136060a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.423424  6286 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc50dfe58464bdbbb2ad07fcc3f78a6 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:36.425071  6286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc50dfe58464bdbbb2ad07fcc3f78a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.431396  6435 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc50dfe58464bdbbb2ad07fcc3f78a6 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:36.433143  6435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc50dfe58464bdbbb2ad07fcc3f78a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.441959  6289 tablet_service.cc:1511] Processing CreateTablet for tablet 28a5159497694ef8a8e145406ca08438 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:36.444676  6289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a5159497694ef8a8e145406ca08438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.445127  6438 tablet_service.cc:1511] Processing CreateTablet for tablet 28a5159497694ef8a8e145406ca08438 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:36.447556  6362 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc50dfe58464bdbbb2ad07fcc3f78a6 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:36.449074  6362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc50dfe58464bdbbb2ad07fcc3f78a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.449187  6356 tablet_service.cc:1511] Processing CreateTablet for tablet 28a5159497694ef8a8e145406ca08438 (DEFAULT_TABLE table=soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:36.450659  6356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a5159497694ef8a8e145406ca08438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.451932  6438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a5159497694ef8a8e145406ca08438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.466956  6593 tablet_bootstrap.cc:492] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.472458  6595 tablet_bootstrap.cc:492] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:36.485853  6595 tablet_bootstrap.cc:654] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.491643  6593 tablet_bootstrap.cc:654] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.532207  6595 tablet_bootstrap.cc:492] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:36.532892  6595 ts_tablet_manager.cc:1403] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.005s
I20260709 13:16:36.536724  6595 raft_consensus.cc:359] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.537693  6595 raft_consensus.cc:385] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.538111  6593 tablet_bootstrap.cc:492] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.538115  6595 raft_consensus.cc:740] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.539081  6593 ts_tablet_manager.cc:1403] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.011s
I20260709 13:16:36.538265  6594 tablet_bootstrap.cc:492] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:36.539845  6594 ts_tablet_manager.cc:1403] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.016s
I20260709 13:16:36.539417  6595 consensus_queue.cc:260] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.542256  6595 ts_tablet_manager.cc:1434] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:16:36.542927  6593 raft_consensus.cc:359] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.543529  6595 tablet_bootstrap.cc:492] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:36.543821  6593 raft_consensus.cc:385] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.544937  6593 raft_consensus.cc:740] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.545801  6593 consensus_queue.cc:260] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.548868  6593 ts_tablet_manager.cc:1434] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:36.555557  6594 raft_consensus.cc:359] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.556625  6594 raft_consensus.cc:385] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.557014  6594 raft_consensus.cc:740] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.558017  6594 consensus_queue.cc:260] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.560129  6593 tablet_bootstrap.cc:492] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.560894  6594 ts_tablet_manager.cc:1434] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:16:36.572269  6594 tablet_bootstrap.cc:492] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.574343  6593 tablet_bootstrap.cc:654] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.579914  6595 tablet_bootstrap.cc:654] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.580194  6594 tablet_bootstrap.cc:654] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.591550  6593 tablet_bootstrap.cc:492] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.592196  6593 ts_tablet_manager.cc:1403] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.012s
I20260709 13:16:36.594520  6595 tablet_bootstrap.cc:492] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:36.595283  6595 ts_tablet_manager.cc:1403] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.004s
I20260709 13:16:36.596117  6593 raft_consensus.cc:359] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.596980  6594 tablet_bootstrap.cc:492] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:36.597023  6593 raft_consensus.cc:385] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.597587  6594 ts_tablet_manager.cc:1403] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.008s
I20260709 13:16:36.597558  6593 raft_consensus.cc:740] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.598623  6593 consensus_queue.cc:260] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.599040  6595 raft_consensus.cc:359] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.599870  6595 raft_consensus.cc:385] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.600241  6595 raft_consensus.cc:740] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.601424  6593 ts_tablet_manager.cc:1434] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:36.601114  6594 raft_consensus.cc:359] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.601121  6595 consensus_queue.cc:260] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.602178  6594 raft_consensus.cc:385] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.602635  6594 raft_consensus.cc:740] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.602751  6593 tablet_bootstrap.cc:492] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.603585  6594 consensus_queue.cc:260] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.604810  6595 ts_tablet_manager.cc:1434] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:36.606122  6595 tablet_bootstrap.cc:492] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:36.606273  6594 ts_tablet_manager.cc:1434] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:36.607504  6594 tablet_bootstrap.cc:492] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.609341  6580 raft_consensus.cc:493] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.609912  6580 raft_consensus.cc:515] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.611825  6593 tablet_bootstrap.cc:654] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.615022  6594 tablet_bootstrap.cc:654] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.615161  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10f1ec876b54d6996b863b9d5e8feb6" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:36.617417  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10f1ec876b54d6996b863b9d5e8feb6" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
W20260709 13:16:36.619378  6264 leader_election.cc:343] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:36.621461  6265 leader_election.cc:343] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.622078  6265 leader_election.cc:304] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929; no voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:36.623322  6581 raft_consensus.cc:2749] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:36.624433  6580 leader_election.cc:290] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:36.628008  6594 tablet_bootstrap.cc:492] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:36.628719  6594 ts_tablet_manager.cc:1403] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:16:36.632323  6595 tablet_bootstrap.cc:654] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.632565  6594 raft_consensus.cc:359] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.633495  6594 raft_consensus.cc:385] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.633850  6594 raft_consensus.cc:740] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.634742  6594 consensus_queue.cc:260] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.637542  6594 ts_tablet_manager.cc:1434] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:36.638202  6496 raft_consensus.cc:493] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.638913  6594 tablet_bootstrap.cc:492] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.638764  6496 raft_consensus.cc:515] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.641959  6593 tablet_bootstrap.cc:492] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.642099  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:36.642709  6593 ts_tablet_manager.cc:1403] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.040s	user 0.035s	sys 0.004s
I20260709 13:16:36.643743  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
W20260709 13:16:36.643893  6411 leader_election.cc:343] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.644485  6374 raft_consensus.cc:2468] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 0.
I20260709 13:16:36.646073  6414 leader_election.cc:304] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:36.646517  6593 raft_consensus.cc:359] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.647372  6593 raft_consensus.cc:385] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.647810  6593 raft_consensus.cc:740] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.648608  6496 leader_election.cc:290] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:36.652633  6496 raft_consensus.cc:2804] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:36.653002  6496 raft_consensus.cc:493] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.653329  6496 raft_consensus.cc:3060] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.648901  6594 tablet_bootstrap.cc:654] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.649164  6593 consensus_queue.cc:260] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.663059  6593 ts_tablet_manager.cc:1434] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 13:16:36.664438  6593 tablet_bootstrap.cc:492] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.664255  6496 raft_consensus.cc:515] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.665674  6595 tablet_bootstrap.cc:492] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:36.667091  6595 ts_tablet_manager.cc:1403] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.009s
I20260709 13:16:36.669528  6496 leader_election.cc:290] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:36.670921  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
W20260709 13:16:36.672719  6411 leader_election.cc:343] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.673187  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:36.673895  6374 raft_consensus.cc:3060] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.674536  6593 tablet_bootstrap.cc:654] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.681103  6595 raft_consensus.cc:359] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.682395  6595 raft_consensus.cc:385] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.689301  6374 raft_consensus.cc:2468] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 1.
I20260709 13:16:36.690060  6595 raft_consensus.cc:740] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.691749  6414 leader_election.cc:304] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:36.691320  6595 consensus_queue.cc:260] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.693236  6496 raft_consensus.cc:2804] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:36.695457  6496 raft_consensus.cc:697] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:36.695953  6595 ts_tablet_manager.cc:1434] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 13:16:36.699048  6594 tablet_bootstrap.cc:492] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:36.699893  6594 ts_tablet_manager.cc:1403] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.008s
I20260709 13:16:36.703676  6595 tablet_bootstrap.cc:492] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:36.696580  6496 consensus_queue.cc:237] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.706677  6594 raft_consensus.cc:359] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.719491  6594 raft_consensus.cc:385] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.719928  6594 raft_consensus.cc:740] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.721557  6594 consensus_queue.cc:260] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.723815  6593 tablet_bootstrap.cc:492] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.724645  6594 ts_tablet_manager.cc:1434] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:16:36.724704  6593 ts_tablet_manager.cc:1403] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.036s
I20260709 13:16:36.723735  6197 catalog_manager.cc:5697] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 1 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.725404  6595 tablet_bootstrap.cc:654] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.726197  6594 tablet_bootstrap.cc:492] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.728765  6593 raft_consensus.cc:359] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.729504  6593 raft_consensus.cc:385] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.729856  6593 raft_consensus.cc:740] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.730942  6593 consensus_queue.cc:260] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.732928  6496 raft_consensus.cc:493] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.733441  6496 raft_consensus.cc:515] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.735747  6496 leader_election.cc:290] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:36.737468  6593 ts_tablet_manager.cc:1434] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:36.738780  6593 tablet_bootstrap.cc:492] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.739089  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:36.739641  6594 tablet_bootstrap.cc:654] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:36.740718  6414 leader_election.cc:343] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.741675  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:36.742514  6297 raft_consensus.cc:2468] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 0.
I20260709 13:16:36.744683  6411 leader_election.cc:304] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:36.745930  6496 raft_consensus.cc:2804] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:36.746290  6496 raft_consensus.cc:493] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.746336  6593 tablet_bootstrap.cc:654] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.746783  6496 raft_consensus.cc:3060] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.747107  6594 tablet_bootstrap.cc:492] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:36.747774  6594 ts_tablet_manager.cc:1403] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:16:36.752338  6594 raft_consensus.cc:359] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.753378  6594 raft_consensus.cc:385] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.753779  6594 raft_consensus.cc:740] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.754722  6594 consensus_queue.cc:260] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.755954  6496 raft_consensus.cc:515] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.757270  6594 ts_tablet_manager.cc:1434] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 13:16:36.758646  6594 tablet_bootstrap.cc:492] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.759334  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:36.760123  6297 raft_consensus.cc:3060] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.768527  6594 tablet_bootstrap.cc:654] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.770473  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
W20260709 13:16:36.772087  6414 leader_election.cc:343] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.772773  6496 leader_election.cc:290] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:36.768622  6297 raft_consensus.cc:2468] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 1.
I20260709 13:16:36.774890  6411 leader_election.cc:304] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:36.776221  6496 raft_consensus.cc:2804] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:36.776973  6496 raft_consensus.cc:697] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:36.778553  6496 consensus_queue.cc:237] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.779647  6595 tablet_bootstrap.cc:492] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:36.780277  6595 ts_tablet_manager.cc:1403] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.012s
I20260709 13:16:36.784260  6594 tablet_bootstrap.cc:492] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:36.784935  6594 ts_tablet_manager.cc:1403] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.012s
I20260709 13:16:36.788558  6594 raft_consensus.cc:359] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.789263  6594 raft_consensus.cc:385] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.789628  6594 raft_consensus.cc:740] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.789718  6606 raft_consensus.cc:493] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.790298  6606 raft_consensus.cc:515] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.790584  6594 consensus_queue.cc:260] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.792429  6593 tablet_bootstrap.cc:492] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.793237  6593 ts_tablet_manager.cc:1403] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.017s
I20260709 13:16:36.788105  6595 raft_consensus.cc:359] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.794674  6595 raft_consensus.cc:385] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.794999  6595 raft_consensus.cc:740] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.795784  6595 consensus_queue.cc:260] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.797272  6593 raft_consensus.cc:359] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.797679  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:36.798120  6593 raft_consensus.cc:385] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.798367  6595 ts_tablet_manager.cc:1434] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:16:36.798496  6593 raft_consensus.cc:740] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.798686  6374 raft_consensus.cc:2468] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 0.
I20260709 13:16:36.799675  6595 tablet_bootstrap.cc:492] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:36.801208  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:36.799423  6593 consensus_queue.cc:260] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.806190  6593 ts_tablet_manager.cc:1434] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:36.807535  6593 tablet_bootstrap.cc:492] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.815207  6593 tablet_bootstrap.cc:654] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.815313  6197 catalog_manager.cc:5697] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 1 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.815412  6414 leader_election.cc:304] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:36.823618  6595 tablet_bootstrap.cc:654] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:36.826864  6411 leader_election.cc:343] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.828820  6496 raft_consensus.cc:2804] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:36.829463  6496 raft_consensus.cc:493] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.829918  6496 raft_consensus.cc:3060] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.831331  6593 tablet_bootstrap.cc:492] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.831933  6593 ts_tablet_manager.cc:1403] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 13:16:36.818575  6606 leader_election.cc:290] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:36.835546  6593 raft_consensus.cc:359] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.836342  6593 raft_consensus.cc:385] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.836621  6593 raft_consensus.cc:740] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.837385  6593 consensus_queue.cc:260] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.840236  6594 ts_tablet_manager.cc:1434] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.055s	user 0.013s	sys 0.020s
I20260709 13:16:36.841305  6594 tablet_bootstrap.cc:492] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.841733  6595 tablet_bootstrap.cc:492] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:36.842357  6595 ts_tablet_manager.cc:1403] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.005s
I20260709 13:16:36.845772  6595 raft_consensus.cc:359] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.846496  6595 raft_consensus.cc:385] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.846786  6595 raft_consensus.cc:740] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.847548  6595 consensus_queue.cc:260] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.848459  6496 raft_consensus.cc:515] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.849478  6594 tablet_bootstrap.cc:654] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.850183  6595 ts_tablet_manager.cc:1434] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:36.851531  6595 tablet_bootstrap.cc:492] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:36.851877  6593 ts_tablet_manager.cc:1434] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:16:36.852085  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:36.853040  6593 tablet_bootstrap.cc:492] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
W20260709 13:16:36.853870  6411 leader_election.cc:343] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.860124  6595 tablet_bootstrap.cc:654] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.860944  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:36.861663  6374 raft_consensus.cc:3060] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.863579  6593 tablet_bootstrap.cc:654] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.879016  6593 tablet_bootstrap.cc:492] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.879657  6593 ts_tablet_manager.cc:1403] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.006s
I20260709 13:16:36.887030  6496 leader_election.cc:290] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:36.887558  6593 raft_consensus.cc:359] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.888461  6593 raft_consensus.cc:385] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.888734  6593 raft_consensus.cc:740] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.889478  6593 consensus_queue.cc:260] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.890219  6374 raft_consensus.cc:2468] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 1.
I20260709 13:16:36.892206  6593 ts_tablet_manager.cc:1434] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:16:36.892606  6414 leader_election.cc:304] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:36.893479  6593 tablet_bootstrap.cc:492] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.894840  6517 raft_consensus.cc:493] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.895653  6517 raft_consensus.cc:515] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.900979  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9f7a3874ec4e93856cb5465934b5ec" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:36.901991  6448 raft_consensus.cc:2468] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:36.902722  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9f7a3874ec4e93856cb5465934b5ec" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:36.903770  6339 leader_election.cc:304] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:36.904717  6581 raft_consensus.cc:493] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.905037  6599 raft_consensus.cc:2804] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:36.905843  6599 raft_consensus.cc:493] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.905347  6581 raft_consensus.cc:515] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.906422  6599 raft_consensus.cc:3060] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:36.909250  6337 leader_election.cc:343] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.911094  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:36.912544  6593 tablet_bootstrap.cc:654] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.905006  6517 leader_election.cc:290] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:36.914067  6373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:36.915354  6373 raft_consensus.cc:2393] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 137b622b05d0431d9d18a772c0b71929 in current term 1: Already voted for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in this term.
I20260709 13:16:36.917383  6265 leader_election.cc:304] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929; no voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:36.919096  6580 raft_consensus.cc:3060] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.894809  6496 raft_consensus.cc:2804] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:36.920137  6496 raft_consensus.cc:697] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:36.921396  6496 consensus_queue.cc:237] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.932804  6580 raft_consensus.cc:2749] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:36.934796  6599 raft_consensus.cc:515] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.935473  6593 tablet_bootstrap.cc:492] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.937516  6595 tablet_bootstrap.cc:492] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:36.941419  6581 leader_election.cc:290] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:36.945567  6595 ts_tablet_manager.cc:1403] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.094s	user 0.032s	sys 0.052s
I20260709 13:16:36.947230  6599 leader_election.cc:290] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:36.948071  6593 ts_tablet_manager.cc:1403] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
I20260709 13:16:36.950555  6594 tablet_bootstrap.cc:492] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:36.951210  6594 ts_tablet_manager.cc:1403] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.110s	user 0.031s	sys 0.027s
I20260709 13:16:36.951306  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9f7a3874ec4e93856cb5465934b5ec" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:36.952970  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9f7a3874ec4e93856cb5465934b5ec" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:36.953646  6448 raft_consensus.cc:3060] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.953459  6595 raft_consensus.cc:359] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.954365  6595 raft_consensus.cc:385] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.954245  6593 raft_consensus.cc:359] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
W20260709 13:16:36.952921  6337 leader_election.cc:343] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.954840  6595 raft_consensus.cc:740] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.954759  6594 raft_consensus.cc:359] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.955664  6593 raft_consensus.cc:385] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.955736  6594 raft_consensus.cc:385] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.955976  6593 raft_consensus.cc:740] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.956497  6594 raft_consensus.cc:740] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.956034  6595 consensus_queue.cc:260] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.957165  6593 consensus_queue.cc:260] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.957800  6594 consensus_queue.cc:260] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.958979  6593 ts_tablet_manager.cc:1434] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:16:36.960041  6593 tablet_bootstrap.cc:492] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: Bootstrap starting.
I20260709 13:16:36.960991  6594 ts_tablet_manager.cc:1434] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:36.962481  6594 tablet_bootstrap.cc:492] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:36.966049  6595 ts_tablet_manager.cc:1434] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.006s
I20260709 13:16:36.967125  6593 tablet_bootstrap.cc:654] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.968154  6197 catalog_manager.cc:5697] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 1 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.970257  6594 tablet_bootstrap.cc:654] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.971451  6595 tablet_bootstrap.cc:492] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:36.979650  6593 tablet_bootstrap.cc:492] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: No bootstrap required, opened a new log
I20260709 13:16:36.980239  6593 ts_tablet_manager.cc:1403] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:16:36.983846  6593 raft_consensus.cc:359] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.984611  6593 raft_consensus.cc:385] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.984908  6593 raft_consensus.cc:740] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.985836  6593 consensus_queue.cc:260] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:36.987579  6593 ts_tablet_manager.cc:1434] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:36.991910  6448 raft_consensus.cc:2468] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:36.995097  6339 leader_election.cc:304] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:36.997296  6599 raft_consensus.cc:2804] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:36.997825  6599 raft_consensus.cc:697] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:36.998752  6599 consensus_queue.cc:237] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.000047  6594 tablet_bootstrap.cc:492] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:37.000679  6594 ts_tablet_manager.cc:1403] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.038s	user 0.029s	sys 0.007s
I20260709 13:16:37.003082  6595 tablet_bootstrap.cc:654] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.003582  6594 raft_consensus.cc:359] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.004204  6594 raft_consensus.cc:385] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.004431  6594 raft_consensus.cc:740] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.005102  6594 consensus_queue.cc:260] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.007277  6594 ts_tablet_manager.cc:1434] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:16:37.008692  6594 tablet_bootstrap.cc:492] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Bootstrap starting.
I20260709 13:16:37.014487  6594 tablet_bootstrap.cc:654] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.015126  6595 tablet_bootstrap.cc:492] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:37.015445  6599 raft_consensus.cc:493] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.015776  6595 ts_tablet_manager.cc:1403] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.005s
I20260709 13:16:37.015998  6599 raft_consensus.cc:515] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.019322  6599 leader_election.cc:290] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.020464  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10f1ec876b54d6996b863b9d5e8feb6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:37.021169  6297 raft_consensus.cc:2468] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:37.022248  6594 tablet_bootstrap.cc:492] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: No bootstrap required, opened a new log
I20260709 13:16:37.022785  6594 ts_tablet_manager.cc:1403] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:16:37.022549  6595 raft_consensus.cc:359] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.023351  6595 raft_consensus.cc:385] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.023658  6595 raft_consensus.cc:740] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.024416  6580 raft_consensus.cc:493] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.024499  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10f1ec876b54d6996b863b9d5e8feb6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:37.024818  6595 consensus_queue.cc:260] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.025097  6580 raft_consensus.cc:515] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.025333  6448 raft_consensus.cc:2468] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:37.026017  6594 raft_consensus.cc:359] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.026782  6594 raft_consensus.cc:385] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.026875  6339 leader_election.cc:304] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:37.027153  6594 raft_consensus.cc:740] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.027593  6580 leader_election.cc:290] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.027972  6594 consensus_queue.cc:260] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.021212  6581 raft_consensus.cc:493] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.029428  6581 raft_consensus.cc:515] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.030499  6594 ts_tablet_manager.cc:1434] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:37.031543  6581 leader_election.cc:290] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.033403  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63a11fa62dc47ba8863ebab524d9ef4" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:37.033565  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63a11fa62dc47ba8863ebab524d9ef4" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:37.034138  6448 raft_consensus.cc:2468] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:37.034281  6374 raft_consensus.cc:2468] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:37.034866  6595 ts_tablet_manager.cc:1434] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:16:37.035208  6599 raft_consensus.cc:2804] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.023672  6196 catalog_manager.cc:5697] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 1 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.035776  6599 raft_consensus.cc:493] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.036449  6599 raft_consensus.cc:3060] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.036023  6265 leader_election.cc:304] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.038466  6628 raft_consensus.cc:2804] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.038942  6628 raft_consensus.cc:493] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.039258  6628 raft_consensus.cc:3060] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.044322  6595 tablet_bootstrap.cc:492] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:37.038123  6373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:37.047408  6373 raft_consensus.cc:2468] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:37.048970  6265 leader_election.cc:304] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.049925  6581 raft_consensus.cc:493] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.050462  6581 raft_consensus.cc:515] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.052667  6581 leader_election.cc:290] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.053141  6581 raft_consensus.cc:2804] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.054015  6517 raft_consensus.cc:493] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.054607  6517 raft_consensus.cc:515] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.056968  6517 leader_election.cc:290] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.057219  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:37.058003  6446 raft_consensus.cc:2468] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:37.055873  6599 raft_consensus.cc:515] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.059922  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:37.058422  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:37.060663  6599 leader_election.cc:290] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.060818  6448 raft_consensus.cc:2468] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:37.058470  6628 raft_consensus.cc:515] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.053439  6581 raft_consensus.cc:493] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.062743  6581 raft_consensus.cc:3060] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.062950  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10f1ec876b54d6996b863b9d5e8feb6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:37.063449  6297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:37.064288  6595 tablet_bootstrap.cc:654] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.063683  6298 raft_consensus.cc:3060] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.064926  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10f1ec876b54d6996b863b9d5e8feb6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.065588  6446 raft_consensus.cc:3060] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.059964  6373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:37.063561  6628 leader_election.cc:290] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.067873  6373 raft_consensus.cc:2468] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 0.
I20260709 13:16:37.064468  6297 raft_consensus.cc:2393] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f7da998da3b4056a4c75327b817935f in current term 1: Already voted for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in this term.
I20260709 13:16:37.071676  6337 leader_election.cc:304] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f; no voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:37.073534  6599 raft_consensus.cc:3060] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.073765  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63a11fa62dc47ba8863ebab524d9ef4" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:37.074662  6374 raft_consensus.cc:3060] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.080638  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63a11fa62dc47ba8863ebab524d9ef4" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.081364  6448 raft_consensus.cc:3060] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.070823  6264 leader_election.cc:304] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:37.077832  6581 raft_consensus.cc:515] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.096118  6628 raft_consensus.cc:2804] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.096634  6628 raft_consensus.cc:493] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.096730  6581 leader_election.cc:290] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.097018  6628 raft_consensus.cc:3060] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.097055  6496 consensus_queue.cc:1048] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.099819  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.100623  6447 raft_consensus.cc:3060] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.102739  6371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:37.103513  6371 raft_consensus.cc:3060] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.107242  6448 raft_consensus.cc:2468] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:37.111127  6374 raft_consensus.cc:2468] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:37.114980  6628 raft_consensus.cc:515] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.115660  6265 leader_election.cc:304] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.114014  6298 raft_consensus.cc:2468] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:37.117389  6599 raft_consensus.cc:2749] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.118024  6337 leader_election.cc:304] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.118741  6581 raft_consensus.cc:2804] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.118974  6517 raft_consensus.cc:2804] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.119649  6517 raft_consensus.cc:697] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:37.120010  6628 leader_election.cc:290] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.120492  6581 raft_consensus.cc:697] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.120671  6517 consensus_queue.cc:237] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.121140  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:37.121907  6374 raft_consensus.cc:3060] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.122068  6581 consensus_queue.cc:237] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.126701  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.127425  6448 raft_consensus.cc:3060] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.127614  6446 raft_consensus.cc:2468] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:37.128850  6447 raft_consensus.cc:2468] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:37.130326  6264 leader_election.cc:304] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:37.131287  6628 raft_consensus.cc:2804] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.131825  6628 raft_consensus.cc:697] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.133507  6628 consensus_queue.cc:237] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.132571  6595 tablet_bootstrap.cc:492] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:37.140998  6595 ts_tablet_manager.cc:1403] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.097s	user 0.034s	sys 0.006s
I20260709 13:16:37.138172  6448 raft_consensus.cc:2468] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:37.145608  6371 raft_consensus.cc:2468] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:37.137466  6374 raft_consensus.cc:2468] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 1.
I20260709 13:16:37.145262  6595 raft_consensus.cc:359] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.146893  6580 raft_consensus.cc:493] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.147089  6595 raft_consensus.cc:385] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.147634  6595 raft_consensus.cc:740] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.147571  6580 raft_consensus.cc:515] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.148433  6265 leader_election.cc:304] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.149330  6628 raft_consensus.cc:2804] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.149945  6628 raft_consensus.cc:697] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.150375  6580 leader_election.cc:290] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.148729  6595 consensus_queue.cc:260] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.153615  6628 consensus_queue.cc:237] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.157853  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9f7a3874ec4e93856cb5465934b5ec" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f7da998da3b4056a4c75327b817935f" is_pre_election: true
I20260709 13:16:37.160120  6595 ts_tablet_manager.cc:1434] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:16:37.161331  6595 tablet_bootstrap.cc:492] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929: Bootstrap starting.
I20260709 13:16:37.163460  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9f7a3874ec4e93856cb5465934b5ec" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:37.164341  6448 raft_consensus.cc:2393] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 137b622b05d0431d9d18a772c0b71929 in current term 1: Already voted for candidate 3f7da998da3b4056a4c75327b817935f in this term.
I20260709 13:16:37.175357  6264 leader_election.cc:304] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929; no voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:37.176942  6496 consensus_queue.cc:1048] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.178959  6595 tablet_bootstrap.cc:654] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.182621  6636 raft_consensus.cc:3060] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.169732  6196 catalog_manager.cc:5697] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.191776  6595 tablet_bootstrap.cc:492] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929: No bootstrap required, opened a new log
I20260709 13:16:37.192461  6595 ts_tablet_manager.cc:1403] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.006s
I20260709 13:16:37.195801  6595 raft_consensus.cc:359] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.196308  6595 raft_consensus.cc:385] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.196547  6595 raft_consensus.cc:740] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.197216  6595 consensus_queue.cc:260] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.196710  6194 catalog_manager.cc:5697] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 1 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.199296  6595 ts_tablet_manager.cc:1434] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:37.208711  6636 raft_consensus.cc:2749] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.215133  6194 catalog_manager.cc:5697] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.216709  6194 catalog_manager.cc:5697] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 1 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.219060  6517 raft_consensus.cc:493] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.219693  6517 raft_consensus.cc:515] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.221808  6517 leader_election.cc:290] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.222759  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a5159497694ef8a8e145406ca08438" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929" is_pre_election: true
I20260709 13:16:37.223548  6298 raft_consensus.cc:2468] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:37.223659  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a5159497694ef8a8e145406ca08438" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" is_pre_election: true
I20260709 13:16:37.224517  6447 raft_consensus.cc:2468] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 0.
I20260709 13:16:37.224937  6337 leader_election.cc:304] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.226184  6517 raft_consensus.cc:2804] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.226594  6517 raft_consensus.cc:493] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.226934  6517 raft_consensus.cc:3060] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.235927  6517 raft_consensus.cc:515] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.238489  6517 leader_election.cc:290] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.238713  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a5159497694ef8a8e145406ca08438" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:37.239223  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a5159497694ef8a8e145406ca08438" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.239506  6298 raft_consensus.cc:3060] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.239953  6447 raft_consensus.cc:3060] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.248167  6447 raft_consensus.cc:2468] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:37.248167  6298 raft_consensus.cc:2468] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 1.
I20260709 13:16:37.249485  6339 leader_election.cc:304] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:37.250283  6517 raft_consensus.cc:2804] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.250788  6517 raft_consensus.cc:697] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:37.251518  6517 consensus_queue.cc:237] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.263024  6194 catalog_manager.cc:5697] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 1 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.272323  6496 consensus_queue.cc:1048] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.285465  6615 consensus_queue.cc:1048] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.337797  6447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
mode: GRACEFUL
new_leader_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:48626
I20260709 13:16:37.338656  6447 raft_consensus.cc:606] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Received request to transfer leadership to TS 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:37.345202  6447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
mode: GRACEFUL
new_leader_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:48626
I20260709 13:16:37.345929  6447 raft_consensus.cc:606] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Received request to transfer leadership to TS 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:37.356316  6447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "484ebb0b1b004720867880389f4d6432"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
mode: GRACEFUL
new_leader_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:48626
I20260709 13:16:37.357005  6447 raft_consensus.cc:606] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Received request to transfer leadership to TS 137b622b05d0431d9d18a772c0b71929
I20260709 13:16:37.369472  6298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
mode: GRACEFUL
new_leader_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:54010
I20260709 13:16:37.370117  6298 raft_consensus.cc:606] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Received request to transfer leadership to TS 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:37.376050  6298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
mode: GRACEFUL
new_leader_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:54010
I20260709 13:16:37.376593  6298 raft_consensus.cc:606] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Received request to transfer leadership to TS 3f7da998da3b4056a4c75327b817935f
I20260709 13:16:37.382798  6371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28a5159497694ef8a8e145406ca08438"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
mode: GRACEFUL
new_leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:56860
I20260709 13:16:37.383474  6371 raft_consensus.cc:606] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Received request to transfer leadership to TS 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:37.483752  6615 consensus_queue.cc:1048] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.497797  6298 raft_consensus.cc:3060] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.517637  6606 consensus_queue.cc:1048] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.526105  6647 raft_consensus.cc:993] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: : Instructing follower 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:37.526741  6606 raft_consensus.cc:1081] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Signalling peer 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:37.528426  6298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:16:37.528985  6298 raft_consensus.cc:493] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.529306  6298 raft_consensus.cc:3060] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.536649  6298 raft_consensus.cc:515] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.538677  6298 leader_election.cc:290] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.539553  6371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:37.540356  6447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce4041b80f4a27b1870eeabb3f7f6b" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.540436  6371 raft_consensus.cc:3060] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.541123  6447 raft_consensus.cc:3055] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.541512  6447 raft_consensus.cc:740] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:37.542390  6447 consensus_queue.cc:260] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.544129  6447 raft_consensus.cc:3060] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.546761  6517 consensus_queue.cc:1048] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.549474  6371 raft_consensus.cc:2468] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:37.550812  6265 leader_election.cc:304] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.551836  6636 raft_consensus.cc:2804] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.552415  6636 raft_consensus.cc:697] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.553315  6636 consensus_queue.cc:237] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.554108  6447 raft_consensus.cc:2468] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:37.560909  6599 consensus_queue.cc:1048] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.568646  6636 consensus_queue.cc:1048] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.571393  6193 catalog_manager.cc:5697] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 1 to 2, leader changed from 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131) to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.584136  6628 raft_consensus.cc:993] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: : Instructing follower 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:37.584712  6628 raft_consensus.cc:1081] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Signalling peer 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:37.590301  6371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:56840
I20260709 13:16:37.591632  6371 raft_consensus.cc:493] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.592111  6371 raft_consensus.cc:3060] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.594553  6580 consensus_queue.cc:1048] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.596170  6580 consensus_queue.cc:1048] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.600209  6517 consensus_queue.cc:1048] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.601413  6371 raft_consensus.cc:515] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.602913  6372 raft_consensus.cc:1240] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Rejecting Update request from peer 137b622b05d0431d9d18a772c0b71929 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.606642  6371 leader_election.cc:290] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.607385  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:37.607221  6580 consensus_queue.cc:1059] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.608343  6298 raft_consensus.cc:3055] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.608124  6444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc50dfe58464bdbbb2ad07fcc3f78a6" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.608896  6298 raft_consensus.cc:740] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.610612  6298 consensus_queue.cc:260] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.612099  6298 raft_consensus.cc:3060] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.611981  6636 consensus_queue.cc:1048] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.625430  6298 raft_consensus.cc:2468] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:37.626897  6337 leader_election.cc:304] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:37.630607  6517 raft_consensus.cc:2804] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.631090  6517 raft_consensus.cc:697] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:37.631866  6517 consensus_queue.cc:237] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.635491  6580 raft_consensus.cc:993] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: : Instructing follower 3f7da998da3b4056a4c75327b817935f to start an election
I20260709 13:16:37.636138  6628 raft_consensus.cc:1081] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Signalling peer 3f7da998da3b4056a4c75327b817935f to start an election
W20260709 13:16:37.636158  6581 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:16:37.638248  6371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
 from {username='slave'} at 127.0.0.1:56840
I20260709 13:16:37.640519  6371 raft_consensus.cc:493] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.640908  6371 raft_consensus.cc:3060] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.649637  6371 raft_consensus.cc:515] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.650774  6372 raft_consensus.cc:1240] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Rejecting Update request from peer 137b622b05d0431d9d18a772c0b71929 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.655671  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:37.655658  6636 consensus_queue.cc:1059] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.655782  6371 leader_election.cc:290] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.656895  6298 raft_consensus.cc:3055] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.657361  6298 raft_consensus.cc:740] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.658257  6298 consensus_queue.cc:260] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.659273  6298 raft_consensus.cc:3060] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.655664  6445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53eab256700c48e68d4a5fec136060a3" candidate_uuid: "3f7da998da3b4056a4c75327b817935f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.660871  6194 catalog_manager.cc:5697] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 1 to 2, leader changed from 137b622b05d0431d9d18a772c0b71929 (127.27.150.129) to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 2 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.662279  6445 raft_consensus.cc:3060] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:37.664901  6636 consensus_queue.cc:1175] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:16:37.666723  6517 consensus_queue.cc:1048] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.671824  6445 raft_consensus.cc:2468] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:37.673199  6339 leader_election.cc:304] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:37.674227  6517 raft_consensus.cc:2804] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.675189  6517 raft_consensus.cc:697] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Becoming Leader. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:37.676123  6517 consensus_queue.cc:237] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.681113  6298 raft_consensus.cc:2468] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f7da998da3b4056a4c75327b817935f in term 2.
I20260709 13:16:37.681324  6628 consensus_queue.cc:1048] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:37.681850  6580 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:16:37.692612  6599 consensus_queue.cc:1048] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.702975  6196 catalog_manager.cc:5697] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f reported cstate change: term changed from 1 to 2, leader changed from 137b622b05d0431d9d18a772c0b71929 (127.27.150.129) to 3f7da998da3b4056a4c75327b817935f (127.27.150.130). New cstate: current_term: 2 leader_uuid: "3f7da998da3b4056a4c75327b817935f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.707697  6630 consensus_queue.cc:1048] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.717799  6580 consensus_queue.cc:1048] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:37.723443  6496 raft_consensus.cc:993] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: : Instructing follower 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:37.724056  6496 raft_consensus.cc:1081] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Signalling peer 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:37.729185  6298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:16:37.729847  6298 raft_consensus.cc:493] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.730348  6298 raft_consensus.cc:3060] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.736785  6517 raft_consensus.cc:993] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: : Instructing follower 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:37.737409  6517 raft_consensus.cc:1081] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Signalling peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:37.739717  6445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28a5159497694ef8a8e145406ca08438"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:48612
I20260709 13:16:37.740417  6445 raft_consensus.cc:493] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.740839  6445 raft_consensus.cc:3060] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.743256  6298 raft_consensus.cc:515] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.745213  6298 leader_election.cc:290] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.746090  6371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:37.746349  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2183b426d944ba9745e778800bf10f" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.746898  6371 raft_consensus.cc:3060] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.747567  6446 raft_consensus.cc:3055] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.747942  6446 raft_consensus.cc:740] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:37.748905  6446 consensus_queue.cc:260] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.748996  6445 raft_consensus.cc:515] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.750444  6446 raft_consensus.cc:3060] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.752307  6298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a5159497694ef8a8e145406ca08438" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:37.753135  6298 raft_consensus.cc:3060] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.755112  6371 raft_consensus.cc:2468] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:37.756229  6445 leader_election.cc:290] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:37.757155  6265 leader_election.cc:304] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.758111  6628 raft_consensus.cc:2804] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.758643  6628 raft_consensus.cc:697] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.759588  6628 consensus_queue.cc:237] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.763020  6298 raft_consensus.cc:2468] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 2.
I20260709 13:16:37.766424  6411 leader_election.cc:304] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:37.767354  6606 raft_consensus.cc:2804] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.767841  6606 raft_consensus.cc:697] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:37.768707  6606 consensus_queue.cc:237] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.769474  6446 raft_consensus.cc:2468] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:37.769090  6197 catalog_manager.cc:5697] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 1 to 2, leader changed from 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131) to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.766732  6371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a5159497694ef8a8e145406ca08438" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:37.770828  6371 raft_consensus.cc:3055] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.771287  6371 raft_consensus.cc:740] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:37.772161  6371 consensus_queue.cc:260] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.773658  6371 raft_consensus.cc:3060] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.777788  6196 catalog_manager.cc:5697] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 1 to 2, leader changed from 3f7da998da3b4056a4c75327b817935f (127.27.150.130) to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 2 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.781998  6371 raft_consensus.cc:2468] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 2.
I20260709 13:16:37.868328  6647 raft_consensus.cc:993] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: : Instructing follower 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:37.868953  6647 raft_consensus.cc:1081] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Signalling peer 137b622b05d0431d9d18a772c0b71929 to start an election
I20260709 13:16:37.870707  6298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "484ebb0b1b004720867880389f4d6432"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:16:37.871352  6298 raft_consensus.cc:493] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.871768  6298 raft_consensus.cc:3060] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.878168  6298 raft_consensus.cc:515] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.880550  6298 leader_election.cc:290] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131:36821)
I20260709 13:16:37.880936  6371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:37.881196  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484ebb0b1b004720867880389f4d6432" candidate_uuid: "137b622b05d0431d9d18a772c0b71929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
I20260709 13:16:37.881788  6371 raft_consensus.cc:3060] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.882006  6446 raft_consensus.cc:3055] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.882565  6446 raft_consensus.cc:740] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:37.883481  6446 consensus_queue.cc:260] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.884584  6446 raft_consensus.cc:3060] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.889592  6371 raft_consensus.cc:2468] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:37.890998  6265 leader_election.cc:304] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 3f7da998da3b4056a4c75327b817935f; no voters: 
I20260709 13:16:37.891530  6446 raft_consensus.cc:2468] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 137b622b05d0431d9d18a772c0b71929 in term 2.
I20260709 13:16:37.891814  6628 raft_consensus.cc:2804] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.892423  6628 raft_consensus.cc:697] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Becoming Leader. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:37.893352  6628 consensus_queue.cc:237] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:37.901258  6196 catalog_manager.cc:5697] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 reported cstate change: term changed from 1 to 2, leader changed from 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131) to 137b622b05d0431d9d18a772c0b71929 (127.27.150.129). New cstate: current_term: 2 leader_uuid: "137b622b05d0431d9d18a772c0b71929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.011963  6371 raft_consensus.cc:1275] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.013458  6628 consensus_queue.cc:1048] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.017665  6446 raft_consensus.cc:3060] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.023383  6445 raft_consensus.cc:1275] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.027343  6446 raft_consensus.cc:1275] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.028079  6636 consensus_queue.cc:1048] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:38.029798  6517 consensus_queue.cc:1048] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.044538  6298 raft_consensus.cc:1275] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.047552  6630 consensus_queue.cc:1048] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.065507  6444 raft_consensus.cc:1275] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.066926  6630 consensus_queue.cc:1048] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.078565  6298 raft_consensus.cc:1275] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 3f7da998da3b4056a4c75327b817935f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.080381  6599 consensus_queue.cc:1048] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.207523  6372 raft_consensus.cc:1275] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.208845  6647 consensus_queue.cc:1048] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.219889  6298 raft_consensus.cc:1275] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.223637  6606 consensus_queue.cc:1048] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.237555  6372 raft_consensus.cc:1275] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.238979  6628 consensus_queue.cc:1048] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.248767  6446 raft_consensus.cc:1275] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.250670  6636 consensus_queue.cc:1048] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.355772  6446 raft_consensus.cc:1275] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.357159  6580 consensus_queue.cc:1048] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.366958  6372 raft_consensus.cc:1275] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Refusing update from remote peer 137b622b05d0431d9d18a772c0b71929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.368952  6580 consensus_queue.cc:1048] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.387661  6196 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53950:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:16:40.411342  6196 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53950:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:16:40.445806 28250 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:40.645054  6265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:34795, user_credentials={real_user=slave}} blocked reactor thread for 53070.1us
W20260709 13:16:40.679833  6709 log.cc:927] Time spent T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:16:40.713349  6713 log.cc:927] Time spent T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:16:40.755959  6712 log.cc:927] Time spent T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
I20260709 13:16:40.779084  6723 tablet.cc:1724] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.793931  6726 tablet.cc:1724] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.836990  6720 tablet.cc:1724] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:40.830094  6718 log.cc:927] Time spent T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:16:40.862202  6729 tablet.cc:1724] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.881367  6740 tablet.cc:1724] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:40.887989  6337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.129:36241, user_credentials={real_user=slave}} blocked reactor thread for 63887.4us
I20260709 13:16:40.888484  6730 tablet.cc:1724] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.904052  6737 tablet.cc:1724] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.961061  6735 tablet.cc:1724] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.965942  6720 tablet.cc:1724] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:40.972711  6265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.150.130:34795, user_credentials={real_user=slave}} blocked reactor thread for 44047.9us
I20260709 13:16:40.983368  6739 tablet.cc:1724] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.984925  6741 tablet.cc:1724] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.993572  6732 tablet.cc:1724] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:40.989200  6372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001"
dest_uuid: "3f7da998da3b4056a4c75327b817935f"
mode: GRACEFUL
new_leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:54330
I20260709 13:16:41.000191  6372 raft_consensus.cc:606] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Received request to transfer leadership to TS 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:40.985886  6723 tablet.cc:1724] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.009421  6726 tablet.cc:1724] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.025502  6743 tablet.cc:1724] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.041239  6729 tablet.cc:1724] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.055078  6740 tablet.cc:1724] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.079905  6720 tablet.cc:1724] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.093209  6720 tablet.cc:1724] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.069839  6723 tablet.cc:1724] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.103113  6743 tablet.cc:1724] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.078912  6730 tablet.cc:1724] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.110213  6737 tablet.cc:1724] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.085806  6741 tablet.cc:1724] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.123980  6296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70"
dest_uuid: "137b622b05d0431d9d18a772c0b71929"
mode: GRACEFUL
new_leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:33360
I20260709 13:16:41.124846  6296 raft_consensus.cc:606] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Received request to transfer leadership to TS 6ddf6ed87e7c4c5c8a62ab573da0bb8c
I20260709 13:16:41.128607 28250 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:41.129402 28250 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:41.131399  6735 tablet.cc:1724] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.123689  6732 tablet.cc:1724] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.147244  6741 tablet.cc:1724] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:41.165665  6194 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1: soft_deleted_table [id=02b13c70ece440f59f8311f5eab1f364] alter complete (version 1)
I20260709 13:16:41.365927  6738 raft_consensus.cc:993] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f: : Instructing follower 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:41.366593  6706 raft_consensus.cc:1081] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Signalling peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:41.368137  6446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:48612
I20260709 13:16:41.368723  6446 raft_consensus.cc:493] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:41.369043  6446 raft_consensus.cc:3060] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.375330  6446 raft_consensus.cc:515] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:41.377036  6446 leader_election.cc:290] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 2 election: Requested vote from peers 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241), 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795)
I20260709 13:16:41.377912  6296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:41.378203  6372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04be6659e6e146d7a9e5a70e5626b001" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:41.378697  6296 raft_consensus.cc:3060] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.378958  6372 raft_consensus.cc:3055] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:41.379319  6372 raft_consensus.cc:740] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f7da998da3b4056a4c75327b817935f, State: Running, Role: LEADER
I20260709 13:16:41.380100  6372 consensus_queue.cc:260] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:41.381222  6372 raft_consensus.cc:3060] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.385154  6296 raft_consensus.cc:2468] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 2.
I20260709 13:16:41.386547  6411 leader_election.cc:304] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 137b622b05d0431d9d18a772c0b71929, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:41.387648  6736 raft_consensus.cc:2804] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:41.388140  6736 raft_consensus.cc:697] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:41.388373  6372 raft_consensus.cc:2468] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 2.
I20260709 13:16:41.389055  6736 consensus_queue.cc:237] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:41.398878  6196 catalog_manager.cc:5697] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 1 to 2, leader changed from 3f7da998da3b4056a4c75327b817935f (127.27.150.130) to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 2 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.456205  6669 raft_consensus.cc:993] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929: : Instructing follower 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:41.457049  6744 raft_consensus.cc:1081] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Signalling peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c to start an election
I20260709 13:16:41.458915  6446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70"
dest_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c"
 from {username='slave'} at 127.0.0.1:48618
I20260709 13:16:41.459461  6446 raft_consensus.cc:493] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:41.459772  6446 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.467227  6446 raft_consensus.cc:515] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:41.468717  6446 leader_election.cc:290] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 3 election: Requested vote from peers 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795), 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241)
I20260709 13:16:41.469699  6374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f7da998da3b4056a4c75327b817935f"
I20260709 13:16:41.469851  6296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1068bc7923c445a9eeff83c931dfd70" candidate_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "137b622b05d0431d9d18a772c0b71929"
I20260709 13:16:41.470517  6374 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.470741  6296 raft_consensus.cc:3055] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:41.471107  6296 raft_consensus.cc:740] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 137b622b05d0431d9d18a772c0b71929, State: Running, Role: LEADER
I20260709 13:16:41.471904  6296 consensus_queue.cc:260] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:41.473021  6296 raft_consensus.cc:3060] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.476377  6374 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 3.
I20260709 13:16:41.477586  6414 leader_election.cc:304] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7da998da3b4056a4c75327b817935f, 6ddf6ed87e7c4c5c8a62ab573da0bb8c; no voters: 
I20260709 13:16:41.478376  6736 raft_consensus.cc:2804] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:41.478904  6736 raft_consensus.cc:697] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 3 LEADER]: Becoming Leader. State: Replica: 6ddf6ed87e7c4c5c8a62ab573da0bb8c, State: Running, Role: LEADER
I20260709 13:16:41.479336  6296 raft_consensus.cc:2468] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ddf6ed87e7c4c5c8a62ab573da0bb8c in term 3.
I20260709 13:16:41.479898  6736 consensus_queue.cc:237] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } }
I20260709 13:16:41.493857  6196 catalog_manager.cc:5697] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c reported cstate change: term changed from 2 to 3, leader changed from 137b622b05d0431d9d18a772c0b71929 (127.27.150.129) to 6ddf6ed87e7c4c5c8a62ab573da0bb8c (127.27.150.131). New cstate: current_term: 3 leader_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ddf6ed87e7c4c5c8a62ab573da0bb8c" member_type: VOTER last_known_addr { host: "127.27.150.131" port: 36821 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.815784  6296 raft_consensus.cc:1275] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:41.817184  6736 consensus_queue.cc:1048] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:41.831485  6374 raft_consensus.cc:1275] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:41.833415  6754 consensus_queue.cc:1048] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:41.884781  6374 raft_consensus.cc:1275] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 3 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:41.886044  6754 consensus_queue.cc:1048] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7da998da3b4056a4c75327b817935f" member_type: VOTER last_known_addr { host: "127.27.150.130" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:41.895710  6296 raft_consensus.cc:1275] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 3 FOLLOWER]: Refusing update from remote peer 6ddf6ed87e7c4c5c8a62ab573da0bb8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:41.897552  6754 consensus_queue.cc:1048] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "137b622b05d0431d9d18a772c0b71929" member_type: VOTER last_known_addr { host: "127.27.150.129" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:42.265045 28250 tablet_server.cc:179] TabletServer@127.27.150.129:0 shutting down...
I20260709 13:16:42.303932 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:42.307953 28250 tablet_replica.cc:333] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
W20260709 13:16:42.309442  6337 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:16:42.311596 28250 raft_consensus.cc:2243] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.313606 28250 raft_consensus.cc:2272] T 28a5159497694ef8a8e145406ca08438 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:42.319689  6337 consensus_peers.cc:597] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.320830 28250 tablet_replica.cc:333] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.322786 28250 raft_consensus.cc:2243] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.323911 28250 raft_consensus.cc:2272] T fe9f7a3874ec4e93856cb5465934b5ec P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:42.324172  6411 consensus_peers.cc:597] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.329079 28250 tablet_replica.cc:333] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.331175 28250 raft_consensus.cc:2243] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.332242 28250 raft_consensus.cc:2272] T 53eab256700c48e68d4a5fec136060a3 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.336580 28250 tablet_replica.cc:333] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.337603 28250 raft_consensus.cc:2243] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.338733 28250 raft_consensus.cc:2272] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:42.340022  6337 consensus_peers.cc:597] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.342720 28250 tablet_replica.cc:333] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.343622 28250 raft_consensus.cc:2243] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.345335 28250 raft_consensus.cc:2272] T 484ebb0b1b004720867880389f4d6432 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.348929 28250 tablet_replica.cc:333] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.350205 28250 raft_consensus.cc:2243] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.351722 28250 raft_consensus.cc:2272] T ef8e4c132a84476b8d1cfc01dfe01320 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.356164 28250 tablet_replica.cc:333] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.357616 28250 raft_consensus.cc:2243] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.358807 28250 raft_consensus.cc:2272] T d10f1ec876b54d6996b863b9d5e8feb6 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:42.359493  6411 consensus_peers.cc:597] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.363870 28250 tablet_replica.cc:333] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.365612 28250 raft_consensus.cc:2243] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.366632 28250 raft_consensus.cc:2272] T 93b8d0d203444b0dacac87af25175ae6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.370652 28250 tablet_replica.cc:333] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.371695 28250 raft_consensus.cc:2243] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.373941 28250 raft_consensus.cc:2272] T f24f28bacebd4688aef57deee7c6eede P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:42.378334  6337 consensus_peers.cc:597] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.378690 28250 tablet_replica.cc:333] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.379581 28250 raft_consensus.cc:2243] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.380203 28250 raft_consensus.cc:2272] T f9823c0c44a042b7af959ae97ac81a38 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.383638 28250 tablet_replica.cc:333] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.384320 28250 raft_consensus.cc:2243] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.386096 28250 raft_consensus.cc:2272] T d63a11fa62dc47ba8863ebab524d9ef4 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.390596 28250 tablet_replica.cc:333] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.391647 28250 raft_consensus.cc:2243] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.392691 28250 raft_consensus.cc:2272] T 70bae1852eb8436ab50ee1ee370fa872 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.398132 28250 tablet_replica.cc:333] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.399477 28250 raft_consensus.cc:2243] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.402359 28250 raft_consensus.cc:2272] T 7c2183b426d944ba9745e778800bf10f P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.407137 28250 tablet_replica.cc:333] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.407949 28250 raft_consensus.cc:2243] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.408766 28250 raft_consensus.cc:2272] T 77ac867df8e641649b6ae40f1032a0f6 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:42.410120  6337 consensus_peers.cc:597] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.412436 28250 tablet_replica.cc:333] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.413234 28250 raft_consensus.cc:2243] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.414309 28250 raft_consensus.cc:2272] T 8fce4041b80f4a27b1870eeabb3f7f6b P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.417358 28250 tablet_replica.cc:333] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.417966 28250 raft_consensus.cc:2243] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.418565 28250 raft_consensus.cc:2272] T 04be6659e6e146d7a9e5a70e5626b001 P 137b622b05d0431d9d18a772c0b71929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.422696 28250 tablet_replica.cc:333] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.423381 28250 raft_consensus.cc:2243] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.424710 28250 raft_consensus.cc:2272] T c0e6672d215f41708263377f988c3e59 P 137b622b05d0431d9d18a772c0b71929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.427893 28250 tablet_replica.cc:333] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929: stopping tablet replica
I20260709 13:16:42.428508 28250 raft_consensus.cc:2243] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.429112 28250 raft_consensus.cc:2272] T d1068bc7923c445a9eeff83c931dfd70 P 137b622b05d0431d9d18a772c0b71929 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.489775 28250 tablet_server.cc:196] TabletServer@127.27.150.129:0 shutdown complete.
I20260709 13:16:42.555531 28250 tablet_server.cc:179] TabletServer@127.27.150.130:0 shutting down...
I20260709 13:16:42.604040 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:42.605211 28250 tablet_replica.cc:333] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.606683 28250 raft_consensus.cc:2243] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.607858 28250 raft_consensus.cc:2272] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.610873 28250 tablet_replica.cc:333] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.611603 28250 raft_consensus.cc:2243] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.612723 28250 raft_consensus.cc:2272] T 53eab256700c48e68d4a5fec136060a3 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.615551 28250 tablet_replica.cc:333] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.616475 28250 raft_consensus.cc:2243] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.617223 28250 raft_consensus.cc:2272] T 28a5159497694ef8a8e145406ca08438 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.620055 28250 tablet_replica.cc:333] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.620709 28250 raft_consensus.cc:2243] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.622022 28250 raft_consensus.cc:2272] T fe9f7a3874ec4e93856cb5465934b5ec P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.625053 28250 tablet_replica.cc:333] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.625622 28250 raft_consensus.cc:2243] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.626271 28250 raft_consensus.cc:2272] T 484ebb0b1b004720867880389f4d6432 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.629050 28250 tablet_replica.cc:333] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.629657 28250 raft_consensus.cc:2243] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.630934 28250 raft_consensus.cc:2272] T 77ac867df8e641649b6ae40f1032a0f6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.633802 28250 tablet_replica.cc:333] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.634495 28250 raft_consensus.cc:2243] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.635192 28250 raft_consensus.cc:2272] T 7c2183b426d944ba9745e778800bf10f P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.638352 28250 tablet_replica.cc:333] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.639204 28250 raft_consensus.cc:2243] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.640033 28250 raft_consensus.cc:2272] T f24f28bacebd4688aef57deee7c6eede P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.643442 28250 tablet_replica.cc:333] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.644150 28250 raft_consensus.cc:2243] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:16:42.645072  6411 consensus_peers.cc:597] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.645308 28250 raft_consensus.cc:2272] T 70bae1852eb8436ab50ee1ee370fa872 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.648389 28250 tablet_replica.cc:333] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.649170 28250 raft_consensus.cc:2243] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.649811 28250 raft_consensus.cc:2272] T d63a11fa62dc47ba8863ebab524d9ef4 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.652599 28250 tablet_replica.cc:333] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.653366 28250 raft_consensus.cc:2243] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.654507 28250 raft_consensus.cc:2272] T d10f1ec876b54d6996b863b9d5e8feb6 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.657208 28250 tablet_replica.cc:333] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.657800 28250 raft_consensus.cc:2243] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.658318 28250 raft_consensus.cc:2272] T ef8e4c132a84476b8d1cfc01dfe01320 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.661077 28250 tablet_replica.cc:333] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.661746 28250 raft_consensus.cc:2243] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.662319 28250 raft_consensus.cc:2272] T 93b8d0d203444b0dacac87af25175ae6 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.665015 28250 tablet_replica.cc:333] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.665645 28250 raft_consensus.cc:2243] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.666260 28250 raft_consensus.cc:2272] T 8fce4041b80f4a27b1870eeabb3f7f6b P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.668934 28250 tablet_replica.cc:333] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.669533 28250 raft_consensus.cc:2243] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.670082 28250 raft_consensus.cc:2272] T 04be6659e6e146d7a9e5a70e5626b001 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.673436 28250 tablet_replica.cc:333] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.674057 28250 raft_consensus.cc:2243] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.675208 28250 raft_consensus.cc:2272] T f9823c0c44a042b7af959ae97ac81a38 P 3f7da998da3b4056a4c75327b817935f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.677758 28250 tablet_replica.cc:333] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.678334 28250 raft_consensus.cc:2243] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.678947 28250 raft_consensus.cc:2272] T c0e6672d215f41708263377f988c3e59 P 3f7da998da3b4056a4c75327b817935f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.681490 28250 tablet_replica.cc:333] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f: stopping tablet replica
I20260709 13:16:42.682047 28250 raft_consensus.cc:2243] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.682608 28250 raft_consensus.cc:2272] T d1068bc7923c445a9eeff83c931dfd70 P 3f7da998da3b4056a4c75327b817935f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.736258 28250 tablet_server.cc:196] TabletServer@127.27.150.130:0 shutdown complete.
I20260709 13:16:42.792148 28250 tablet_server.cc:179] TabletServer@127.27.150.131:0 shutting down...
I20260709 13:16:42.834564 28250 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:42.835376 28250 tablet_replica.cc:333] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.836367 28250 raft_consensus.cc:2243] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.837085 28250 raft_consensus.cc:2272] T 3cc50dfe58464bdbbb2ad07fcc3f78a6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.840046 28250 tablet_replica.cc:333] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.840854 28250 raft_consensus.cc:2243] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.841560 28250 raft_consensus.cc:2272] T 53eab256700c48e68d4a5fec136060a3 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.845201 28250 tablet_replica.cc:333] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.846256 28250 raft_consensus.cc:2243] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.847886 28250 raft_consensus.cc:2272] T 28a5159497694ef8a8e145406ca08438 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:42.850281  6411 consensus_peers.cc:597] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c -> Peer 137b622b05d0431d9d18a772c0b71929 (127.27.150.129:36241): Couldn't send request to peer 137b622b05d0431d9d18a772c0b71929. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.129:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:42.851796  6414 consensus_peers.cc:597] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c -> Peer 3f7da998da3b4056a4c75327b817935f (127.27.150.130:34795): Couldn't send request to peer 3f7da998da3b4056a4c75327b817935f. Status: Network error: Client connection negotiation failed: client connection to 127.27.150.130:34795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.852380 28250 tablet_replica.cc:333] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.853193 28250 raft_consensus.cc:2243] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.853690 28250 raft_consensus.cc:2272] T fe9f7a3874ec4e93856cb5465934b5ec P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.856544 28250 tablet_replica.cc:333] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.857205 28250 raft_consensus.cc:2243] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.857717 28250 raft_consensus.cc:2272] T c0e6672d215f41708263377f988c3e59 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.860380 28250 tablet_replica.cc:333] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.860988 28250 raft_consensus.cc:2243] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.861545 28250 raft_consensus.cc:2272] T 8fce4041b80f4a27b1870eeabb3f7f6b P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.864200 28250 tablet_replica.cc:333] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.864813 28250 raft_consensus.cc:2243] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.865761 28250 raft_consensus.cc:2272] T 04be6659e6e146d7a9e5a70e5626b001 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.868427 28250 tablet_replica.cc:333] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.869032 28250 raft_consensus.cc:2243] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.869568 28250 raft_consensus.cc:2272] T 7c2183b426d944ba9745e778800bf10f P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.872575 28250 tablet_replica.cc:333] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.873483 28250 raft_consensus.cc:2243] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.874145 28250 raft_consensus.cc:2272] T 77ac867df8e641649b6ae40f1032a0f6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.877399 28250 tablet_replica.cc:333] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.878041 28250 raft_consensus.cc:2243] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.878710 28250 raft_consensus.cc:2272] T 484ebb0b1b004720867880389f4d6432 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.881222 28250 tablet_replica.cc:333] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.881915 28250 raft_consensus.cc:2243] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.882606 28250 raft_consensus.cc:2272] T d63a11fa62dc47ba8863ebab524d9ef4 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.885142 28250 tablet_replica.cc:333] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.885744 28250 raft_consensus.cc:2243] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.886269 28250 raft_consensus.cc:2272] T 70bae1852eb8436ab50ee1ee370fa872 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.888648 28250 tablet_replica.cc:333] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.889240 28250 raft_consensus.cc:2243] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.889778 28250 raft_consensus.cc:2272] T f9823c0c44a042b7af959ae97ac81a38 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.892273 28250 tablet_replica.cc:333] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.892880 28250 raft_consensus.cc:2243] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.893374 28250 raft_consensus.cc:2272] T f24f28bacebd4688aef57deee7c6eede P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.896494 28250 tablet_replica.cc:333] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.897073 28250 raft_consensus.cc:2243] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.898124 28250 raft_consensus.cc:2272] T 93b8d0d203444b0dacac87af25175ae6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.900810 28250 tablet_replica.cc:333] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.901366 28250 raft_consensus.cc:2243] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.901922 28250 raft_consensus.cc:2272] T d10f1ec876b54d6996b863b9d5e8feb6 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.904445 28250 tablet_replica.cc:333] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.905018 28250 raft_consensus.cc:2243] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.905561 28250 raft_consensus.cc:2272] T ef8e4c132a84476b8d1cfc01dfe01320 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.908373 28250 tablet_replica.cc:333] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c: stopping tablet replica
I20260709 13:16:42.908938 28250 raft_consensus.cc:2243] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.909970 28250 raft_consensus.cc:2272] T d1068bc7923c445a9eeff83c931dfd70 P 6ddf6ed87e7c4c5c8a62ab573da0bb8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.958952 28250 tablet_server.cc:196] TabletServer@127.27.150.131:0 shutdown complete.
I20260709 13:16:43.012198 28250 master.cc:562] Master@127.27.150.190:33959 shutting down...
I20260709 13:16:43.039471 28250 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:43.040263 28250 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.040591 28250 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2cc6cb598b494e2898eeddc555993cc1: stopping tablet replica
I20260709 13:16:43.064373 28250 master.cc:584] Master@127.27.150.190:33959 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12010 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25831 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (333836 ms total)
[  PASSED  ] 8 tests.
I20260709 13:16:43.133596 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 429 messages since previous log ~15 seconds ago
I20260709 13:16:43.133865 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 427 messages since previous log ~15 seconds ago
I20260709 13:16:43.134024 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 425 messages since previous log ~15 seconds ago
I20260709 13:16:43.134192 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:16:43.134357 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:16:43.134938 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~80 seconds ago
I20260709 13:16:43.135129 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~159 seconds ago
I20260709 13:16:43.135282 28250 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 3 messages since previous log ~199 seconds ago
I20260709 13:16:43.135435 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 3 messages since previous log ~199 seconds ago
I20260709 13:16:43.135582 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 3 messages since previous log ~197 seconds ago
I20260709 13:16:43.135812 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:16:43.135979 28250 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
